2023-12-19T15:57:47.382 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T15:57:47.382 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087 -- /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/orig.config.yaml 2023-12-19T15:57:47.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:57:47.508 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087 branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7497087' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e owner: scheduled_vshankar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 430 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e sleep_before_teardown: 0 subset: 301/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7ubHdMglsVfADcIX6+TdDQP7AHO9OIje4N+g6wC7pIhNSkUzrRjeTf9EbRvWOJHucTfdljWCbDgOYMGe3c7n4= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4JsTmELUGAxtWiLy97OLPdKNJuCwF4+uobIfinfHx9ozX0ZziFF0TJYfE2SG8DTLC9C9KAPUJCdxK/nFn0eW8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_13:22:41 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T15:57:47.509 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa; will attempt to use it 2023-12-19T15:57:47.510 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks 2023-12-19T15:57:47.510 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T15:57:47.511 INFO:teuthology.task.internal:Checking packages... 2023-12-19T15:57:47.536 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '568df92b7e50b2108bce4c77c393ff294d6a5e5e' 2023-12-19T15:57:47.536 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T15:57:47.536 INFO:teuthology.packaging:ref: None 2023-12-19T15:57:47.536 INFO:teuthology.packaging:tag: None 2023-12-19T15:57:47.536 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T15:57:47.537 INFO:teuthology.packaging:sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T15:57:47.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T15:57:47.672 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-132-g568df92b-1jammy 2023-12-19T15:57:47.673 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T15:57:47.680 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T15:57:47.680 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T15:57:47.697 INFO:teuthology.task.internal:Saving configuration 2023-12-19T15:57:47.715 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T15:57:47.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:57:47.748 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:52:19.970286', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMfWdRX4b3+f1RncBu9kVQdvNXSVp/YQJqKybKQFMe7D'} 2023-12-19T15:57:47.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:52:19.972092', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG8JgtGZezZv+bZoeZ6gbPY4G9cu5JPXj4NHeRuprWxm'} 2023-12-19T15:57:47.773 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T15:57:47.781 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-19T15:57:47.781 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-19T15:57:47.781 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T15:57:47.863 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f68cb1b9b80>, signals=[15]) 2023-12-19T15:57:47.863 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T15:57:47.871 INFO:teuthology.task.internal:Opening connections... 2023-12-19T15:57:47.871 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T15:57:47.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:57:47.951 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T15:57:47.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:57:48.028 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T15:57:48.035 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-12-19T15:57:48.040 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-12-19T15:57:48.040 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-12-19T15:57:48.087 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T15:57:48.088 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy 2023-12-19T15:57:48.089 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-12-19T15:57:48.108 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-12-19T15:57:48.113 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-12-19T15:57:48.113 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-12-19T15:57:48.158 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T15:57:48.159 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T15:57:48.159 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T15:57:48.159 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T15:57:48.159 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2023-12-19T15:57:48.159 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-12-19T15:57:48.182 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T15:57:48.194 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T15:57:48.209 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T15:57:48.210 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:57:48.212 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:57:48.217 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T15:57:48.228 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T15:57:48.228 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:57:48.261 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:57:48.282 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T15:57:48.341 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T15:57:48.358 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T15:57:48.358 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-19T15:57:48.358 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:57:48.359 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:57:48.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:57:48.363 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:48.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T15:57:48.364 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-12-19T15:57:48.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:57:48.365 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:48.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T15:57:48.365 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2023-12-19T15:57:48.411 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-56-generic 2023-12-19T15:57:48.411 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:48.412 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T15:57:48.412 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:48.416 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-56-generic 2023-12-19T15:57:48.416 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:48.416 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T15:57:48.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:48.549 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-12-19T15:57:48.550 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T15:57:48.570 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-19T15:57:48.657 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-12-19T15:57:48.657 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T15:57:48.676 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-19T15:57:48.703 INFO:teuthology.orchestra.run.smithi119.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-19T15:57:48.703 INFO:teuthology.orchestra.run.smithi119.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-19T15:57:48.703 INFO:teuthology.orchestra.run.smithi119.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-19T15:57:48.703 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2023-12-19T15:57:48.703 INFO:teuthology.orchestra.run.smithi119.stderr:hint: git config --global init.defaultBranch 2023-12-19T15:57:48.704 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2023-12-19T15:57:48.704 INFO:teuthology.orchestra.run.smithi119.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-19T15:57:48.704 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-19T15:57:48.704 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2023-12-19T15:57:48.704 INFO:teuthology.orchestra.run.smithi119.stderr:hint: git branch -m 2023-12-19T15:57:48.704 INFO:teuthology.orchestra.run.smithi119.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T15:57:48.706 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T15:57:48.773 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git config --global init.defaultBranch 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-19T15:57:48.789 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-12-19T15:57:48.790 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git branch -m 2023-12-19T15:57:48.790 INFO:teuthology.orchestra.run.smithi143.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T15:57:48.792 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T15:57:48.829 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T15:57:48.857 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T15:57:48.910 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T16:00:16.926 INFO:teuthology.orchestra.run.smithi143.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T16:00:16.927 INFO:teuthology.orchestra.run.smithi143.stderr: * [new branch] main -> origin/main 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T16:00:16.960 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T16:00:16.961 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T16:00:16.962 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T16:00:16.965 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T16:00:16.965 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T16:00:16.966 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T16:00:16.967 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T16:00:16.968 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T16:00:20.956 INFO:teuthology.orchestra.run.smithi143.stderr:Updating files: 51% (1679/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2120/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2653/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T16:00:20.961 INFO:teuthology.orchestra.run.smithi143.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T16:00:20.982 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-19T16:00:20.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T16:00:21.132 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:21.132 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T16:00:21.136 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi143.front.sepia.ceph.com to complete... 2023-12-19T16:00:21.848 INFO:teuthology.orchestra.run.smithi119.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T16:00:21.848 INFO:teuthology.orchestra.run.smithi119.stderr: * [new branch] main -> origin/main 2023-12-19T16:00:21.879 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T16:00:21.879 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T16:00:21.879 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T16:00:21.879 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T16:00:21.880 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T16:00:21.880 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T16:00:21.880 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T16:00:21.880 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T16:00:21.880 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T16:00:21.881 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T16:00:21.881 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T16:00:21.881 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T16:00:21.881 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T16:00:21.882 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T16:00:21.882 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T16:00:21.882 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T16:00:21.882 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T16:00:21.883 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T16:00:21.883 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T16:00:21.883 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T16:00:21.883 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T16:00:21.883 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T16:00:21.883 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T16:00:21.884 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T16:00:21.884 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T16:00:21.884 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T16:00:21.884 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T16:00:21.884 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T16:00:21.885 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T16:00:21.886 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T16:00:21.887 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T16:00:21.887 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T16:00:21.887 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T16:00:21.887 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T16:00:21.887 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T16:00:21.887 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T16:00:21.888 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T16:00:21.888 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T16:00:21.888 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T16:00:21.888 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T16:00:21.888 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T16:00:21.888 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T16:00:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19 16:00:22 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-19T16:00:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:FINISHED --2023-12-19 16:00:22-- 2023-12-19T16:00:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:Total wall clock time: 1.6s 2023-12-19T16:00:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:Downloaded: 1 files, 37M in 1.5s (25.1 MB/s) 2023-12-19T16:00:22.848 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-19T16:00:22.848 DEBUG:teuthology.orchestra.run.smithi143:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T16:00:23.051 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T16:00:25.068 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-19T16:00:25.073 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T16:00:25.213 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T16:00:25.878 INFO:teuthology.orchestra.run.smithi119.stderr:Updating files: 51% (1672/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2118/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2653/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T16:00:25.882 INFO:teuthology.orchestra.run.smithi119.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T16:00:25.903 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-19T16:00:25.904 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T16:00:26.043 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:26.043 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T16:00:26.046 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-12-19T16:00:28.499 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T16:00:28.627 INFO:teuthology.orchestra.run.smithi143.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19 16:00:30 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-19T16:00:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:FINISHED --2023-12-19 16:00:30-- 2023-12-19T16:00:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:Total wall clock time: 4.4s 2023-12-19T16:00:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:Downloaded: 1 files, 37M in 4.1s (9.01 MB/s) 2023-12-19T16:00:30.450 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-19T16:00:30.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T16:00:30.748 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T16:00:32.768 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-19T16:00:32.772 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T16:00:32.979 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T16:00:36.025 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T16:00:36.161 INFO:teuthology.orchestra.run.smithi119.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:48.400 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:48.440 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2023-12-19T16:00:48.734 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:48.754 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.050 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:49.066 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:49.127 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:49.132 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:49.299 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:49.299 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:49.299 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:49.338 INFO:teuthology.orchestra.run.smithi143.stderr:done 2023-12-19T16:00:49.503 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T16:00:49.511 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-19T16:00:49.511 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-19T16:00:49.511 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-19T16:00:49.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-19T16:00:49.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-19T16:00:49.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T16:00:49.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T16:00:49.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T16:00:49.549 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T16:00:49.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T16:00:49.632 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T16:00:49.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T16:00:49.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T16:00:49.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T16:00:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T16:00:49.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T16:00:49.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T16:00:49.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T16:00:49.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T16:00:49.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T16:00:49.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T16:00:49.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T16:00:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T16:00:49.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T16:00:49.646 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T16:00:49.647 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T16:00:49.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T16:00:49.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T16:00:49.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T16:00:49.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T16:00:49.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T16:00:49.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T16:00:49.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T16:00:49.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T16:00:49.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T16:00:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T16:00:49.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T16:00:49.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T16:00:49.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T16:00:49.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T16:00:49.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T16:00:49.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T16:00:49.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T16:00:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T16:00:49.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T16:00:49.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T16:00:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T16:00:49.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T16:00:49.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T16:00:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T16:00:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T16:00:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T16:00:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T16:00:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T16:00:49.676 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T16:00:49.677 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T16:00:49.678 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T16:00:49.679 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T16:00:49.680 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T16:00:49.681 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T16:00:49.682 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T16:00:49.683 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T16:00:49.684 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T16:00:49.685 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T16:00:49.686 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T16:00:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T16:00:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T16:00:49.689 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T16:00:49.690 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T16:00:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T16:00:49.692 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T16:00:49.693 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T16:00:49.694 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T16:00:49.695 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T16:00:49.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T16:00:49.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T16:00:49.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T16:00:49.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T16:00:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T16:00:49.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T16:00:49.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T16:00:49.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T16:00:49.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T16:00:49.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T16:00:49.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T16:00:49.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T16:00:49.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T16:00:49.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T16:00:49.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T16:00:49.770 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T16:00:49.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T16:00:49.771 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T16:00:49.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T16:00:49.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T16:00:49.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T16:00:49.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T16:00:49.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T16:00:49.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T16:00:49.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T16:00:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T16:00:49.780 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T16:00:49.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T16:00:49.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T16:00:49.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T16:00:49.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T16:00:49.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T16:00:49.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T16:00:49.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T16:00:49.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T16:00:49.789 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T16:00:49.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T16:00:49.791 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T16:00:49.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T16:00:49.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T16:00:49.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T16:00:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T16:00:49.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T16:00:49.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T16:00:49.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T16:00:49.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T16:00:49.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T16:00:49.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T16:00:49.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T16:00:49.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T16:00:49.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T16:00:49.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T16:00:49.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T16:00:49.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T16:00:49.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T16:00:49.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T16:00:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T16:00:49.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T16:00:49.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T16:00:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T16:00:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T16:00:49.815 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T16:00:49.816 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T16:00:49.817 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T16:00:49.818 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T16:00:49.819 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T16:00:49.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T16:00:49.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T16:00:49.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T16:00:49.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T16:00:49.864 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T16:00:49.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T16:00:49.866 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T16:00:49.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T16:00:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T16:00:49.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T16:00:49.870 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T16:00:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T16:00:49.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T16:00:49.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T16:00:49.874 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T16:00:49.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T16:00:49.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T16:00:49.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T16:00:49.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T16:00:49.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T16:00:49.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T16:00:49.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T16:00:49.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T16:00:49.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T16:00:49.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T16:00:49.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T16:00:49.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T16:00:49.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T16:00:49.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T16:00:49.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T16:00:49.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T16:00:49.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T16:00:49.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T16:00:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T16:00:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T16:00:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T16:00:49.896 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T16:00:49.897 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T16:00:49.898 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T16:00:49.899 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T16:00:49.900 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T16:00:49.901 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T16:00:49.902 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T16:00:49.903 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.903 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.903 DEBUG:teuthology.orchestra.run.smithi143:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T16:00:49.910 INFO:teuthology.orchestra.run.smithi143.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:49.910 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:49.910 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:49.911 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T16:00:49.911 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T16:00:49.911 DEBUG:teuthology.orchestra.run.smithi143:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T16:00:49.953 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi143.front.sepia.ceph.com to complete... 2023-12-19T16:00:50.329 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:50.330 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:50.356 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2023-12-19T16:00:50.530 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:50.537 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:50.760 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:50.765 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:50.806 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:50.811 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:50.939 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:50.940 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:50.940 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:50.955 INFO:teuthology.orchestra.run.smithi143.stderr:done 2023-12-19T16:00:56.359 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:56.375 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:56.399 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-12-19T16:00:56.717 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:56.735 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:57.033 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:57.094 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:57.099 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:57.276 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-12-19T16:00:57.446 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T16:00:57.454 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-19T16:00:57.454 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-19T16:00:57.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.466 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.467 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-19T16:00:57.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-19T16:00:57.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-19T16:00:57.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T16:00:57.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T16:00:57.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T16:00:57.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T16:00:57.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T16:00:57.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T16:00:57.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T16:00:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T16:00:57.491 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T16:00:57.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T16:00:57.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T16:00:57.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T16:00:57.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T16:00:57.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T16:00:57.540 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T16:00:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T16:00:57.542 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T16:00:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T16:00:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T16:00:57.545 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T16:00:57.546 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T16:00:57.547 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T16:00:57.548 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T16:00:57.549 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T16:00:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T16:00:57.551 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T16:00:57.552 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T16:00:57.553 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T16:00:57.554 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T16:00:57.555 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T16:00:57.555 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T16:00:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T16:00:57.557 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T16:00:57.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T16:00:57.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T16:00:57.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T16:00:57.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T16:00:57.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T16:00:57.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T16:00:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T16:00:57.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T16:00:57.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T16:00:57.567 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T16:00:57.568 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T16:00:57.569 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T16:00:57.570 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T16:00:57.571 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T16:00:57.572 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T16:00:57.573 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T16:00:57.574 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T16:00:57.575 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T16:00:57.576 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T16:00:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T16:00:57.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T16:00:57.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T16:00:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T16:00:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T16:00:57.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T16:00:57.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T16:00:57.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T16:00:57.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T16:00:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T16:00:57.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T16:00:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T16:00:57.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T16:00:57.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T16:00:57.644 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T16:00:57.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T16:00:57.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T16:00:57.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T16:00:57.648 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T16:00:57.649 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T16:00:57.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T16:00:57.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T16:00:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T16:00:57.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T16:00:57.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T16:00:57.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T16:00:57.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T16:00:57.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T16:00:57.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T16:00:57.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T16:00:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T16:00:57.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T16:00:57.663 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T16:00:57.664 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T16:00:57.665 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T16:00:57.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T16:00:57.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T16:00:57.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T16:00:57.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T16:00:57.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T16:00:57.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T16:00:57.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T16:00:57.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T16:00:57.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T16:00:57.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T16:00:57.722 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T16:00:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T16:00:57.724 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T16:00:57.725 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T16:00:57.726 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T16:00:57.727 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T16:00:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T16:00:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T16:00:57.730 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T16:00:57.731 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T16:00:57.732 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T16:00:57.733 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T16:00:57.734 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T16:00:57.735 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T16:00:57.736 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T16:00:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T16:00:57.738 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T16:00:57.739 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T16:00:57.740 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T16:00:57.741 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T16:00:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T16:00:57.743 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T16:00:57.744 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T16:00:57.745 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T16:00:57.746 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T16:00:57.747 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T16:00:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T16:00:57.749 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T16:00:57.750 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T16:00:57.751 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T16:00:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T16:00:57.753 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T16:00:57.754 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T16:00:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T16:00:57.756 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T16:00:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T16:00:57.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T16:00:57.763 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T16:00:57.763 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T16:00:57.763 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T16:00:57.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T16:00:57.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T16:00:57.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T16:00:57.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T16:00:57.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T16:00:57.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T16:00:57.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T16:00:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T16:00:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T16:00:57.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T16:00:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T16:00:57.822 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T16:00:57.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T16:00:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T16:00:57.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T16:00:57.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T16:00:57.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T16:00:57.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-19T16:00:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-19T16:00:57.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:57.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T16:00:57.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T16:00:57.830 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.830 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.831 DEBUG:teuthology.orchestra.run.smithi119:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T16:00:57.847 INFO:teuthology.orchestra.run.smithi119.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:57.848 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T16:00:57.848 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.848 DEBUG:teuthology.orchestra.run.smithi119:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T16:00:57.891 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-12-19T16:00:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:58.249 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-12-19T16:00:58.450 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:58.457 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:58.687 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:58.733 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:58.738 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:58.891 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:58.891 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:58.891 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:58.907 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-12-19T16:01:00.073 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-12-19T16:01:22.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-19T16:01:22.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:01:22.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:01:30.081 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-19T16:01:30.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-19T16:01:30.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:01:40.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T16:01:49.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:01:49.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:01:52.689 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T16:02:04.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:02:04.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:23.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T16:02:30.090 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T16:02:38.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:02:38.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:38.643 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-12-19T16:02:39.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-19T16:02:39.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:39.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:02:39.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-19T16:02:39.622 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2023-12-19T16:02:39.670 INFO:teuthology.orchestra.run.smithi143.stdout:6.6.0-gcd68252d7b4d 2023-12-19T16:02:39.670 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T16:02:39.670 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T16:02:39.670 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T16:02:40.671 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-19T16:02:40.671 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-19T16:02:40.746 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2023-12-19T16:02:40.801 DEBUG:teuthology.parallel:result is None 2023-12-19T16:02:41.482 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-19T16:02:42.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-19T16:02:42.623 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-19T16:02:42.623 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-12-19T16:02:42.630 INFO:teuthology.orchestra.run.smithi119.stdout:6.6.0-gcd68252d7b4d 2023-12-19T16:02:42.631 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T16:02:42.631 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T16:02:42.631 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T16:02:43.632 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-19T16:02:43.632 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-19T16:02:43.889 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-12-19T16:02:43.958 DEBUG:teuthology.parallel:result is None 2023-12-19T16:02:43.959 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T16:02:43.966 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T16:02:43.966 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T16:02:43.970 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T16:02:43.980 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T16:02:43.987 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T16:02:43.995 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T16:02:43.995 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T16:02:44.024 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T16:02:44.077 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T16:02:44.084 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T16:02:44.084 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T16:02:44.088 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T16:02:44.108 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:44.121 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:44.152 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:44.167 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:44.170 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T16:02:44.177 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T16:02:44.177 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T16:02:44.181 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T16:02:44.240 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T16:02:44.256 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T16:02:44.256 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T16:02:44.260 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T16:02:44.292 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T16:02:44.322 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T16:02:44.377 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:02:44.378 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T16:02:44.453 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T16:02:44.463 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T16:02:44.515 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:02:44.515 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T16:02:44.650 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-12-19T16:02:44.653 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2023-12-19T16:02:44.804 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T16:02:44.815 INFO:teuthology.task.internal:Starting timer... 2023-12-19T16:02:44.816 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T16:02:44.831 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T16:02:44.843 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2023-12-19T16:02:44.843 DEBUG:teuthology.task.selinux:Excluding smithi143: OS 'ubuntu' does not support SELinux 2023-12-19T16:02:44.843 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T16:02:44.843 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-19T16:02:44.843 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T16:02:44.844 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T16:02:44.854 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-19T16:02:44.861 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-19T16:02:45.007 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T16:02:45.025 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T16:02:45.027 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi119.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T16:11:32.376 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2023-12-19T16:11:32.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-19T16:11:32.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:32.456 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-19T16:11:32.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-19T16:11:32.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:11:32.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:32.667 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-12-19T16:11:32.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T16:11:32.793 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T16:11:32.803 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T16:11:32.803 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:11:32.803 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:11:32.807 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:11:32.807 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:11:32.843 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-19T16:11:32.843 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Command line: ntpd -gq 2023-12-19T16:11:32.843 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: ---------------------------------------------------- 2023-12-19T16:11:32.843 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: ntp-4 is maintained by Network Time Foundation, 2023-12-19T16:11:32.843 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-19T16:11:32.844 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: corporation. Support and training for ntp-4 are 2023-12-19T16:11:32.844 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: available at https://www.nwtime.org/support 2023-12-19T16:11:32.844 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: ---------------------------------------------------- 2023-12-19T16:11:32.844 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: proto: precision = 0.042 usec (-24) 2023-12-19T16:11:32.845 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: basedate set to 2022-02-04 2023-12-19T16:11:32.845 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: gps base set to 2022-02-06 (week 2196) 2023-12-19T16:11:32.845 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:32.845 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:32.845 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:32.846 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:32.846 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T16:11:32.846 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T16:11:32.847 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T16:11:32.847 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2023-12-19T16:11:32.847 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listen normally on 4 lo [::1]:123 2023-12-19T16:11:32.847 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2023-12-19T16:11:32.847 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:32 ntpd[27969]: Listening on routing socket on fd #22 for interface updates 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Command line: ntpd -gq 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: ---------------------------------------------------- 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: ntp-4 is maintained by Network Time Foundation, 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: corporation. Support and training for ntp-4 are 2023-12-19T16:11:32.876 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: available at https://www.nwtime.org/support 2023-12-19T16:11:32.877 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: ---------------------------------------------------- 2023-12-19T16:11:32.877 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: proto: precision = 0.042 usec (-24) 2023-12-19T16:11:32.877 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: basedate set to 2022-02-04 2023-12-19T16:11:32.877 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: gps base set to 2022-02-06 (week 2196) 2023-12-19T16:11:32.878 INFO:teuthology.orchestra.run.smithi143.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:32.878 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:32.878 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:32.878 INFO:teuthology.orchestra.run.smithi143.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listen normally on 3 enp3s0f1 172.21.15.143:123 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listen normally on 4 lo [::1]:123 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7783%5]:123 2023-12-19T16:11:32.879 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:32 ntpd[27991]: Listening on routing socket on fd #22 for interface updates 2023-12-19T16:11:33.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:33.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:33 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:33.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:33 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:33.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:33 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:33 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:33 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:33 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:33.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:33 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:34.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:34 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:34.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:34 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:35.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:35 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:35.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:35 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:35 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:35 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:35.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:35 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:35.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:35 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:35.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:35 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:36.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:36 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:36 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:36 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:36 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:36 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:36.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:36 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:36.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:36.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:36.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:36.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:37.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:37 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:37 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:37 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:37 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:37 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:37 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:37.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:37 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:38.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:38 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:38 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:38 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:38 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:38 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:38.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:38 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:38.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:38.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:38.878 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:39.845 INFO:teuthology.orchestra.run.smithi119.stdout:19 Dec 16:11:39 ntpd[27969]: ntpd: time slew -0.002142 s 2023-12-19T16:11:39.845 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew -0.002142s 2023-12-19T16:11:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T16:11:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:19 Dec 16:11:39 ntpd[27969]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T16:11:39.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.876 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:39.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:39.877 INFO:teuthology.orchestra.run.smithi143.stdout:19 Dec 16:11:39 ntpd[27991]: ntpd: time slew -0.001692 s 2023-12-19T16:11:39.877 INFO:teuthology.orchestra.run.smithi143.stdout:ntpd: time slew -0.001692s 2023-12-19T16:11:39.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T16:11:39.877 INFO:teuthology.orchestra.run.smithi143.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T16:11:39.934 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:11:39.934 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2023-12-19T16:11:39.934 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.934 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.934 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.934 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.994 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:11:39.994 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2023-12-19T16:11:39.994 INFO:teuthology.orchestra.run.smithi143.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.995 INFO:teuthology.orchestra.run.smithi143.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.995 INFO:teuthology.orchestra.run.smithi143.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.995 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:39.996 INFO:teuthology.run_tasks:Running task install... 2023-12-19T16:11:40.004 DEBUG:teuthology.task.install:project ceph 2023-12-19T16:11:40.004 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}} 2023-12-19T16:11:40.004 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'} 2023-12-19T16:11:40.004 INFO:teuthology.task.install:Using flavor: default 2023-12-19T16:11:40.010 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T16:11:40.010 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T16:11:40.011 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2023-12-19T16:11:40.011 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-key list | grep Ceph 2023-12-19T16:11:40.115 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-19T16:11:40.141 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-19T16:11:40.175 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T16:11:40.175 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T16:11:40.176 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T16:11:40.176 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T16:11:40.176 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:11:40.193 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T16:11:40.194 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T16:11:40.194 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T16:11:40.194 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T16:11:40.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:11:40.326 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default/ 2023-12-19T16:11:40.326 INFO:teuthology.task.install.deb:Package version is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:40.345 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default/ 2023-12-19T16:11:40.345 INFO:teuthology.task.install.deb:Package version is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:40.452 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:11:40.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T16:11:40.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2023-12-19T16:11:40.519 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:11:40.519 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T16:11:40.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2023-12-19T16:11:40.686 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-19T16:11:40.735 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-19T16:11:40.773 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy InRelease 2023-12-19T16:11:40.810 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-19T16:11:40.843 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy InRelease 2023-12-19T16:11:40.845 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-19T16:11:40.847 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-19T16:11:40.880 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-19T16:11:40.884 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-19T16:11:40.920 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-19T16:11:40.926 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-19T16:11:40.931 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2023-12-19T16:11:40.959 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2023-12-19T16:11:41.008 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-19T16:11:41.018 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-19T16:11:41.342 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 28.5 kB in 1s (49.3 kB/s) 2023-12-19T16:11:41.558 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-19T16:11:41.574 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-19T16:11:41.591 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-19T16:11:42.042 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 28.5 kB in 1s (21.2 kB/s) 2023-12-19T16:11:42.272 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-12-19T16:11:42.287 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-132-g568df92b-1jammy cephadm=18.2.1-132-g568df92b-1jammy ceph-mds=18.2.1-132-g568df92b-1jammy ceph-mgr=18.2.1-132-g568df92b-1jammy ceph-common=18.2.1-132-g568df92b-1jammy ceph-fuse=18.2.1-132-g568df92b-1jammy ceph-test=18.2.1-132-g568df92b-1jammy ceph-volume=18.2.1-132-g568df92b-1jammy radosgw=18.2.1-132-g568df92b-1jammy python3-rados=18.2.1-132-g568df92b-1jammy python3-rgw=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy python3-rbd=18.2.1-132-g568df92b-1jammy libcephfs2=18.2.1-132-g568df92b-1jammy libcephfs-dev=18.2.1-132-g568df92b-1jammy librados2=18.2.1-132-g568df92b-1jammy librbd1=18.2.1-132-g568df92b-1jammy rbd-fuse=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy cephfs-shell=18.2.1-132-g568df92b-1jammy cephfs-top=18.2.1-132-g568df92b-1jammy cephfs-mirror=18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:42.362 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-12-19T16:11:42.530 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2023-12-19T16:11:42.530 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:11:42.686 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:11:42.687 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2023-12-19T16:11:42.687 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T16:11:42.687 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-19T16:11:42.687 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:42.687 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-19T16:11:42.688 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-19T16:11:42.688 INFO:teuthology.orchestra.run.smithi143.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-19T16:11:42.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-19T16:11:42.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-19T16:11:42.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-19T16:11:42.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-19T16:11:42.689 INFO:teuthology.orchestra.run.smithi143.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: python3-watchdog 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2023-12-19T16:11:42.690 INFO:teuthology.orchestra.run.smithi143.stdout: btrfs-tools 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-19T16:11:42.834 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-12-19T16:11:42.835 INFO:teuthology.orchestra.run.smithi143.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-19T16:11:42.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-19T16:11:42.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-19T16:11:42.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-19T16:11:42.837 INFO:teuthology.orchestra.run.smithi143.stdout: socat xmlstarlet 2023-12-19T16:11:42.971 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-12-19T16:11:42.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-132-g568df92b-1jammy cephadm=18.2.1-132-g568df92b-1jammy ceph-mds=18.2.1-132-g568df92b-1jammy ceph-mgr=18.2.1-132-g568df92b-1jammy ceph-common=18.2.1-132-g568df92b-1jammy ceph-fuse=18.2.1-132-g568df92b-1jammy ceph-test=18.2.1-132-g568df92b-1jammy ceph-volume=18.2.1-132-g568df92b-1jammy radosgw=18.2.1-132-g568df92b-1jammy python3-rados=18.2.1-132-g568df92b-1jammy python3-rgw=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy python3-rbd=18.2.1-132-g568df92b-1jammy libcephfs2=18.2.1-132-g568df92b-1jammy libcephfs-dev=18.2.1-132-g568df92b-1jammy librados2=18.2.1-132-g568df92b-1jammy librbd1=18.2.1-132-g568df92b-1jammy rbd-fuse=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy cephfs-shell=18.2.1-132-g568df92b-1jammy cephfs-top=18.2.1-132-g568df92b-1jammy cephfs-mirror=18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:42.986 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 115 newly installed, 0 to remove and 268 not upgraded. 2023-12-19T16:11:42.986 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 181 MB of archives. 2023-12-19T16:11:42.986 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 812 MB of additional disk space will be used. 2023-12-19T16:11:42.986 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-132-g568df92b-1jammy [3,418 kB] 2023-12-19T16:11:43.032 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-19T16:11:43.060 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-12-19T16:11:43.114 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-19T16:11:43.160 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-19T16:11:43.203 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-132-g568df92b-1jammy [3,104 kB] 2023-12-19T16:11:43.234 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2023-12-19T16:11:43.235 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2023-12-19T16:11:43.297 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-132-g568df92b-1jammy [670 kB] 2023-12-19T16:11:43.318 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-132-g568df92b-1jammy [356 kB] 2023-12-19T16:11:43.329 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-132-g568df92b-1jammy [32.8 kB] 2023-12-19T16:11:43.331 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-132-g568df92b-1jammy [180 kB] 2023-12-19T16:11:43.337 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-132-g568df92b-1jammy [61.5 kB] 2023-12-19T16:11:43.338 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-132-g568df92b-1jammy [330 kB] 2023-12-19T16:11:43.350 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-132-g568df92b-1jammy [5,884 kB] 2023-12-19T16:11:43.366 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-12-19T16:11:43.395 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:11:43.395 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:11:43.395 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:11:43.396 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:11:43.396 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:11:43.396 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:11:43.396 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:11:43.397 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2023-12-19T16:11:43.397 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T16:11:43.397 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-19T16:11:43.397 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:43.397 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-19T16:11:43.398 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-19T16:11:43.399 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: python3-watchdog 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2023-12-19T16:11:43.400 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2023-12-19T16:11:43.410 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-19T16:11:43.486 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-19T16:11:43.497 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-19T16:11:43.545 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-19T16:11:43.545 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-132-g568df92b-1jammy [112 kB] 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-12-19T16:11:43.547 INFO:teuthology.orchestra.run.smithi119.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-19T16:11:43.548 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-19T16:11:43.549 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-19T16:11:43.549 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-19T16:11:43.549 INFO:teuthology.orchestra.run.smithi119.stdout: socat xmlstarlet 2023-12-19T16:11:43.549 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-132-g568df92b-1jammy [442 kB] 2023-12-19T16:11:43.560 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-132-g568df92b-1jammy [22.0 MB] 2023-12-19T16:11:43.615 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 115 newly installed, 0 to remove and 268 not upgraded. 2023-12-19T16:11:43.615 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 181 MB of archives. 2023-12-19T16:11:43.615 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 812 MB of additional disk space will be used. 2023-12-19T16:11:43.615 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-19T16:11:43.635 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-19T16:11:43.645 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-19T16:11:43.696 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-12-19T16:11:43.707 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-19T16:11:43.710 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-19T16:11:43.719 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-19T16:11:43.726 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-19T16:11:43.728 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-19T16:11:43.740 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-19T16:11:43.746 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-19T16:11:43.805 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-19T16:11:43.809 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-19T16:11:43.828 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-132-g568df92b-1jammy [3,418 kB] 2023-12-19T16:11:43.831 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-19T16:11:43.836 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-19T16:11:43.836 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-19T16:11:43.848 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-19T16:11:43.849 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-19T16:11:43.849 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-19T16:11:43.850 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-19T16:11:43.851 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-19T16:11:43.868 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-19T16:11:43.868 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-19T16:11:43.869 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-19T16:11:43.869 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-19T16:11:43.888 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-19T16:11:43.890 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-19T16:11:43.891 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-19T16:11:43.891 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-19T16:11:43.892 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-19T16:11:43.893 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T16:11:43.908 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-19T16:11:43.908 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-19T16:11:43.909 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-19T16:11:43.910 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-19T16:11:43.919 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-19T16:11:43.927 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-19T16:11:43.934 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-19T16:11:43.934 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-19T16:11:43.934 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-19T16:11:43.934 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-19T16:11:43.935 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-19T16:11:43.947 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-19T16:11:43.948 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-19T16:11:43.949 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-19T16:11:43.949 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-19T16:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-19T16:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-19T16:11:43.969 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-19T16:11:44.026 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-19T16:11:44.026 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-19T16:11:44.028 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-19T16:11:44.028 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-19T16:11:44.029 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-19T16:11:44.030 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-19T16:11:44.030 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-19T16:11:44.031 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-19T16:11:44.033 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T16:11:44.047 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-19T16:11:44.053 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-19T16:11:44.073 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-19T16:11:44.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-19T16:11:44.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-19T16:11:44.100 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-19T16:11:44.101 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-19T16:11:44.102 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-19T16:11:44.102 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-19T16:11:44.103 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-19T16:11:44.110 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-19T16:11:44.110 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-19T16:11:44.111 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-19T16:11:44.111 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-19T16:11:44.114 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-19T16:11:44.130 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-19T16:11:44.131 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-19T16:11:44.132 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-19T16:11:44.136 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-19T16:11:44.139 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-19T16:11:44.139 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-19T16:11:44.149 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-19T16:11:44.152 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T16:11:44.153 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-19T16:11:44.155 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-19T16:11:44.169 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-19T16:11:44.169 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-19T16:11:44.170 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-19T16:11:44.306 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-132-g568df92b-1jammy [6,835 kB] 2023-12-19T16:11:44.536 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-19T16:11:44.538 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-132-g568df92b-1jammy [237 kB] 2023-12-19T16:11:44.542 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-19T16:11:44.543 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-132-g568df92b-1jammy [130 kB] 2023-12-19T16:11:44.544 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-19T16:11:44.548 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-132-g568df92b-1jammy [1,484 kB] 2023-12-19T16:11:44.556 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-19T16:11:44.556 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-19T16:11:44.557 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-19T16:11:44.560 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-19T16:11:44.561 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-19T16:11:44.563 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-19T16:11:44.605 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-132-g568df92b-1jammy [9,877 kB] 2023-12-19T16:11:44.784 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-19T16:11:44.959 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-132-g568df92b-1jammy [31.5 MB] 2023-12-19T16:11:45.233 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-19T16:11:45.243 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-19T16:11:45.249 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-19T16:11:45.253 INFO:teuthology.orchestra.run.smithi143.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-19T16:11:45.272 INFO:teuthology.orchestra.run.smithi143.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T16:11:45.276 INFO:teuthology.orchestra.run.smithi143.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-19T16:11:45.278 INFO:teuthology.orchestra.run.smithi143.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-19T16:11:45.318 INFO:teuthology.orchestra.run.smithi143.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-19T16:11:45.336 INFO:teuthology.orchestra.run.smithi143.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-19T16:11:45.339 INFO:teuthology.orchestra.run.smithi143.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-19T16:11:45.436 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-132-g568df92b-1jammy [3,104 kB] 2023-12-19T16:11:45.592 INFO:teuthology.orchestra.run.smithi143.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-19T16:11:45.674 INFO:teuthology.orchestra.run.smithi143.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-19T16:11:45.772 INFO:teuthology.orchestra.run.smithi143.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-19T16:11:45.847 INFO:teuthology.orchestra.run.smithi143.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-19T16:11:45.956 INFO:teuthology.orchestra.run.smithi143.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-19T16:11:46.042 INFO:teuthology.orchestra.run.smithi143.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-19T16:11:46.060 INFO:teuthology.orchestra.run.smithi143.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-19T16:11:46.080 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-132-g568df92b-1jammy [670 kB] 2023-12-19T16:11:46.093 INFO:teuthology.orchestra.run.smithi143.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-19T16:11:46.104 INFO:teuthology.orchestra.run.smithi143.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-19T16:11:46.141 INFO:teuthology.orchestra.run.smithi143.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-19T16:11:46.149 INFO:teuthology.orchestra.run.smithi143.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-19T16:11:46.171 INFO:teuthology.orchestra.run.smithi143.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-132-g568df92b-1jammy [14.1 kB] 2023-12-19T16:11:46.171 INFO:teuthology.orchestra.run.smithi143.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-132-g568df92b-1jammy [824 kB] 2023-12-19T16:11:46.187 INFO:teuthology.orchestra.run.smithi143.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-132-g568df92b-1jammy [2,173 kB] 2023-12-19T16:11:46.215 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-132-g568df92b-1jammy [356 kB] 2023-12-19T16:11:46.273 INFO:teuthology.orchestra.run.smithi143.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-132-g568df92b-1jammy [235 kB] 2023-12-19T16:11:46.280 INFO:teuthology.orchestra.run.smithi143.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-132-g568df92b-1jammy [138 kB] 2023-12-19T16:11:46.284 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-132-g568df92b-1jammy [32.8 kB] 2023-12-19T16:11:46.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-132-g568df92b-1jammy [180 kB] 2023-12-19T16:11:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-132-g568df92b-1jammy [61.5 kB] 2023-12-19T16:11:46.293 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-132-g568df92b-1jammy [330 kB] 2023-12-19T16:11:46.299 INFO:teuthology.orchestra.run.smithi143.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-132-g568df92b-1jammy [1,898 kB] 2023-12-19T16:11:46.347 INFO:teuthology.orchestra.run.smithi143.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-19T16:11:46.362 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-132-g568df92b-1jammy [5,884 kB] 2023-12-19T16:11:46.376 INFO:teuthology.orchestra.run.smithi143.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-132-g568df92b-1jammy [8,625 kB] 2023-12-19T16:11:46.731 INFO:teuthology.orchestra.run.smithi143.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-132-g568df92b-1jammy [14.2 kB] 2023-12-19T16:11:46.731 INFO:teuthology.orchestra.run.smithi143.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-132-g568df92b-1jammy [46.4 MB] 2023-12-19T16:11:47.177 INFO:teuthology.orchestra.run.smithi143.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-19T16:11:47.178 INFO:teuthology.orchestra.run.smithi143.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-19T16:11:47.179 INFO:teuthology.orchestra.run.smithi143.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-19T16:11:47.180 INFO:teuthology.orchestra.run.smithi143.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-19T16:11:47.181 INFO:teuthology.orchestra.run.smithi143.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-19T16:11:47.182 INFO:teuthology.orchestra.run.smithi143.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-19T16:11:47.182 INFO:teuthology.orchestra.run.smithi143.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-19T16:11:47.182 INFO:teuthology.orchestra.run.smithi143.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-19T16:11:47.185 INFO:teuthology.orchestra.run.smithi143.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T16:11:47.200 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-132-g568df92b-1jammy [112 kB] 2023-12-19T16:11:47.252 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-132-g568df92b-1jammy [442 kB] 2023-12-19T16:11:47.258 INFO:teuthology.orchestra.run.smithi143.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-19T16:11:47.322 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-132-g568df92b-1jammy [22.0 MB] 2023-12-19T16:11:47.423 INFO:teuthology.orchestra.run.smithi143.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-19T16:11:48.146 INFO:teuthology.orchestra.run.smithi143.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-19T16:11:48.152 INFO:teuthology.orchestra.run.smithi143.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-19T16:11:48.153 INFO:teuthology.orchestra.run.smithi143.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-19T16:11:48.204 INFO:teuthology.orchestra.run.smithi143.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-19T16:11:48.228 INFO:teuthology.orchestra.run.smithi143.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-19T16:11:48.229 INFO:teuthology.orchestra.run.smithi143.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-19T16:11:48.230 INFO:teuthology.orchestra.run.smithi143.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-19T16:11:48.230 INFO:teuthology.orchestra.run.smithi143.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-19T16:11:48.231 INFO:teuthology.orchestra.run.smithi143.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-19T16:11:48.232 INFO:teuthology.orchestra.run.smithi143.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-19T16:11:48.398 INFO:teuthology.orchestra.run.smithi143.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-19T16:11:48.912 INFO:teuthology.orchestra.run.smithi143.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-19T16:11:48.940 INFO:teuthology.orchestra.run.smithi143.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-19T16:11:48.964 INFO:teuthology.orchestra.run.smithi143.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-19T16:11:48.972 INFO:teuthology.orchestra.run.smithi143.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-19T16:11:49.050 INFO:teuthology.orchestra.run.smithi143.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-19T16:11:49.055 INFO:teuthology.orchestra.run.smithi143.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-132-g568df92b-1jammy [121 kB] 2023-12-19T16:11:49.056 INFO:teuthology.orchestra.run.smithi143.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-132-g568df92b-1jammy [228 kB] 2023-12-19T16:11:49.058 INFO:teuthology.orchestra.run.smithi143.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-132-g568df92b-1jammy [34.0 kB] 2023-12-19T16:11:49.058 INFO:teuthology.orchestra.run.smithi143.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-132-g568df92b-1jammy [23.3 kB] 2023-12-19T16:11:49.059 INFO:teuthology.orchestra.run.smithi143.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-132-g568df92b-1jammy [38.3 kB] 2023-12-19T16:11:49.060 INFO:teuthology.orchestra.run.smithi143.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-132-g568df92b-1jammy [11.6 MB] 2023-12-19T16:11:49.081 INFO:teuthology.orchestra.run.smithi143.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-19T16:11:49.083 INFO:teuthology.orchestra.run.smithi143.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-19T16:11:49.120 INFO:teuthology.orchestra.run.smithi143.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-19T16:11:49.144 INFO:teuthology.orchestra.run.smithi143.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T16:11:49.147 INFO:teuthology.orchestra.run.smithi143.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-19T16:11:49.322 INFO:teuthology.orchestra.run.smithi143.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-19T16:11:49.657 INFO:teuthology.orchestra.run.smithi143.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-132-g568df92b-1jammy [92.9 kB] 2023-12-19T16:11:49.883 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-132-g568df92b-1jammy [6,835 kB] 2023-12-19T16:11:49.923 INFO:teuthology.orchestra.run.smithi143.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-19T16:11:49.925 INFO:teuthology.orchestra.run.smithi143.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-19T16:11:49.929 INFO:teuthology.orchestra.run.smithi143.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-19T16:11:50.144 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-132-g568df92b-1jammy [237 kB] 2023-12-19T16:11:50.150 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-132-g568df92b-1jammy [130 kB] 2023-12-19T16:11:50.155 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-132-g568df92b-1jammy [1,484 kB] 2023-12-19T16:11:50.216 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-132-g568df92b-1jammy [9,877 kB] 2023-12-19T16:11:50.600 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-132-g568df92b-1jammy [31.5 MB] 2023-12-19T16:11:50.658 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 181 MB in 7s (25.0 MB/s) 2023-12-19T16:11:50.803 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T16:11:50.872 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-19T16:11:50.875 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-19T16:11:50.911 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-19T16:11:51.154 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T16:11:51.168 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-19T16:11:51.205 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:11:51.524 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T16:11:51.537 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-19T16:11:51.582 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-19T16:11:51.834 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-132-g568df92b-1jammy [14.1 kB] 2023-12-19T16:11:51.835 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-132-g568df92b-1jammy [824 kB] 2023-12-19T16:11:51.857 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-132-g568df92b-1jammy [2,173 kB] 2023-12-19T16:11:51.926 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfmt8:amd64. 2023-12-19T16:11:51.939 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-132-g568df92b-1jammy [235 kB] 2023-12-19T16:11:51.940 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-12-19T16:11:51.947 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-132-g568df92b-1jammy [138 kB] 2023-12-19T16:11:51.953 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-132-g568df92b-1jammy [1,898 kB] 2023-12-19T16:11:52.026 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-132-g568df92b-1jammy [8,625 kB] 2023-12-19T16:11:52.027 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:11:52.355 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-132-g568df92b-1jammy [14.2 kB] 2023-12-19T16:11:52.355 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-132-g568df92b-1jammy [46.4 MB] 2023-12-19T16:11:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-19T16:11:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-19T16:11:52.421 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:11:52.716 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T16:11:52.729 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-19T16:11:52.766 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:11:53.093 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T16:11:53.108 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-19T16:11:53.152 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:11:53.597 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T16:11:53.612 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:11:53.663 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:11:54.062 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-132-g568df92b-1jammy [121 kB] 2023-12-19T16:11:54.063 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-132-g568df92b-1jammy [228 kB] 2023-12-19T16:11:54.065 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-132-g568df92b-1jammy [34.0 kB] 2023-12-19T16:11:54.066 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-132-g568df92b-1jammy [23.3 kB] 2023-12-19T16:11:54.066 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T16:11:54.067 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-132-g568df92b-1jammy [38.3 kB] 2023-12-19T16:11:54.067 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-132-g568df92b-1jammy [11.6 MB] 2023-12-19T16:11:54.081 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:11:54.124 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:11:54.503 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-132-g568df92b-1jammy [92.9 kB] 2023-12-19T16:11:54.635 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T16:11:54.650 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:11:54.694 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:11:55.022 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-19T16:11:55.036 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-19T16:11:55.075 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 181 MB in 11s (16.5 MB/s) 2023-12-19T16:11:55.080 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:11:55.194 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T16:11:55.261 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-19T16:11:55.264 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-19T16:11:55.310 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-19T16:11:55.374 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librados2. 2023-12-19T16:11:55.389 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../011-librados2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:55.432 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:55.844 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librbd1. 2023-12-19T16:11:55.858 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../012-librbd1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:55.871 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T16:11:55.886 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-19T16:11:55.902 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:55.930 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:11:56.240 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T16:11:56.254 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-19T16:11:56.299 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-19T16:11:56.304 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T16:11:56.318 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:56.387 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:56.651 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfmt8:amd64. 2023-12-19T16:11:56.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-12-19T16:11:56.673 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rados. 2023-12-19T16:11:56.688 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../014-python3-rados_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:56.723 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:56.760 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:11:56.993 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T16:11:57.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:11:57.050 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:57.113 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-19T16:11:57.128 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-19T16:11:57.171 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:11:57.286 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T16:11:57.301 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:57.344 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:57.491 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T16:11:57.506 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-19T16:11:57.541 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:11:57.672 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T16:11:57.687 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:11:57.732 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:57.861 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T16:11:57.876 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-19T16:11:57.928 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:11:58.050 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T16:11:58.065 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-12-19T16:11:58.108 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-19T16:11:58.360 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T16:11:58.375 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:58.398 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T16:11:58.413 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:11:58.418 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:58.464 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:11:58.801 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T16:11:58.815 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:11:58.876 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:11:59.005 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T16:11:59.020 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-19T16:11:59.063 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:11:59.212 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T16:11:59.227 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:11:59.287 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:11:59.391 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librgw2. 2023-12-19T16:11:59.406 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../021-librgw2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:11:59.449 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:11:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-19T16:11:59.680 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-19T16:11:59.723 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:11:59.926 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T16:11:59.940 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:00.010 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:00.043 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librados2. 2023-12-19T16:12:00.057 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-librados2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:00.093 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:00.329 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-19T16:12:00.343 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-19T16:12:00.379 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:12:00.563 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librbd1. 2023-12-19T16:12:00.577 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-librbd1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:00.621 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:00.657 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T16:12:00.671 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:00.715 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:01.185 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-common. 2023-12-19T16:12:01.200 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../025-ceph-common_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:01.243 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:01.399 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T16:12:01.413 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:01.457 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:01.701 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2023-12-19T16:12:01.716 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-rados_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:01.751 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:02.070 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T16:12:02.085 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:02.128 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:02.340 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-base. 2023-12-19T16:12:02.355 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../026-ceph-base_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:02.398 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T16:12:02.407 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:02.412 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:02.456 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:02.767 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T16:12:02.781 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:02.850 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:03.077 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-19T16:12:03.091 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-19T16:12:03.128 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T16:12:03.135 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:12:03.143 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-12-19T16:12:03.178 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-19T16:12:03.421 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cheroot. 2023-12-19T16:12:03.435 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-19T16:12:03.456 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T16:12:03.471 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:03.479 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:12:03.514 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:03.892 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T16:12:03.907 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-19T16:12:03.950 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:12:03.974 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-19T16:12:03.988 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-19T16:12:04.032 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:12:04.295 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2023-12-19T16:12:04.310 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-librgw2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:04.334 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-19T16:12:04.345 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:04.349 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-19T16:12:04.384 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:12:04.654 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-19T16:12:04.669 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-19T16:12:04.737 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:12:04.798 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T16:12:04.812 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:04.856 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:05.040 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempora. 2023-12-19T16:12:05.055 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-12-19T16:12:05.098 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-19T16:12:05.230 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-19T16:12:05.245 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-19T16:12:05.292 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:12:05.409 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-portend. 2023-12-19T16:12:05.424 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-12-19T16:12:05.467 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-19T16:12:05.580 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T16:12:05.595 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:05.787 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-19T16:12:05.802 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-19T16:12:05.845 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-19T16:12:06.058 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2023-12-19T16:12:06.073 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-ceph-common_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:06.133 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:06.164 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T16:12:06.179 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-19T16:12:06.222 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:12:06.559 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T16:12:06.574 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-12-19T16:12:06.617 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-19T16:12:06.887 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T16:12:06.902 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-12-19T16:12:06.937 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-19T16:12:07.264 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T16:12:07.279 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-19T16:12:07.297 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2023-12-19T16:12:07.312 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-ceph-base_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:07.323 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:12:07.365 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:07.633 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-mako. 2023-12-19T16:12:07.648 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-19T16:12:07.691 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:12:08.028 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T16:12:08.043 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T16:12:08.086 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:12:08.110 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-19T16:12:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-19T16:12:08.168 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:12:08.414 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T16:12:08.429 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-19T16:12:08.463 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cheroot. 2023-12-19T16:12:08.472 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:12:08.476 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-19T16:12:08.521 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:12:08.766 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webob. 2023-12-19T16:12:08.782 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-19T16:12:08.824 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:12:08.849 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-19T16:12:08.863 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-19T16:12:08.907 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:12:09.202 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T16:12:09.210 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-19T16:12:09.217 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-19T16:12:09.225 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-19T16:12:09.263 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:12:09.285 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:12:09.555 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-19T16:12:09.569 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-19T16:12:09.580 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T16:12:09.595 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-19T16:12:09.605 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:12:09.638 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:12:09.907 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempora. 2023-12-19T16:12:09.922 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-12-19T16:12:09.966 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-19T16:12:09.966 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-paste. 2023-12-19T16:12:09.981 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-19T16:12:10.024 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:12:10.294 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-portend. 2023-12-19T16:12:10.308 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-12-19T16:12:10.344 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T16:12:10.352 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-19T16:12:10.358 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-19T16:12:10.402 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:12:10.687 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-19T16:12:10.701 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-19T16:12:10.704 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T16:12:10.719 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-19T16:12:10.746 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-19T16:12:10.762 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:12:10.999 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T16:12:11.014 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-19T16:12:11.058 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:12:11.099 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T16:12:11.114 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-12-19T16:12:11.149 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-19T16:12:11.435 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T16:12:11.450 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-19T16:12:11.493 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:12:11.578 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T16:12:11.592 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-12-19T16:12:11.661 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-19T16:12:11.872 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-certifi. 2023-12-19T16:12:11.887 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-12-19T16:12:11.931 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T16:12:11.946 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-12-19T16:12:11.947 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-19T16:12:11.981 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-19T16:12:12.266 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-idna. 2023-12-19T16:12:12.275 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T16:12:12.281 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-12-19T16:12:12.290 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-19T16:12:12.325 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-19T16:12:12.334 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:12:12.602 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-urllib3. 2023-12-19T16:12:12.617 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-19T16:12:12.645 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2023-12-19T16:12:12.652 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:12:12.659 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-19T16:12:12.703 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:12:12.963 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests. 2023-12-19T16:12:12.978 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-19T16:12:13.013 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:12:13.032 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T16:12:13.046 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T16:12:13.115 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:12:13.316 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T16:12:13.331 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-19T16:12:13.374 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:12:13.401 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T16:12:13.416 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-19T16:12:13.451 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:12:13.644 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T16:12:13.659 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:13.694 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:13.770 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2023-12-19T16:12:13.785 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-19T16:12:13.829 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:12:14.190 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T16:12:14.205 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-19T16:12:14.223 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T16:12:14.239 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:12:14.281 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:14.576 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T16:12:14.584 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T16:12:14.591 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-19T16:12:14.599 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-19T16:12:14.642 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-19T16:12:14.643 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:12:14.929 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2023-12-19T16:12:14.944 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-19T16:12:14.945 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T16:12:14.961 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:14.979 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:12:15.003 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:15.282 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T16:12:15.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-19T16:12:15.357 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:12:15.406 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T16:12:15.421 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:15.473 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:15.652 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T16:12:15.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-19T16:12:15.710 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:12:16.680 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T16:12:16.695 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-12-19T16:12:16.739 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-19T16:12:16.984 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T16:12:17.000 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:17.025 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T16:12:17.039 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-19T16:12:17.042 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:17.074 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:12:17.438 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-certifi. 2023-12-19T16:12:17.452 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-12-19T16:12:17.487 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-19T16:12:17.807 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-idna. 2023-12-19T16:12:17.825 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-12-19T16:12:17.865 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-19T16:12:18.202 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-urllib3. 2023-12-19T16:12:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-19T16:12:18.237 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph. 2023-12-19T16:12:18.252 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../061-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:18.260 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:12:18.295 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:18.598 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T16:12:18.613 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests. 2023-12-19T16:12:18.613 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:18.628 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-19T16:12:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:18.680 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:12:18.991 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T16:12:18.993 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T16:12:19.006 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-19T16:12:19.008 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:19.051 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:19.093 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:12:19.377 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T16:12:19.392 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:19.412 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephadm. 2023-12-19T16:12:19.426 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../064-cephadm_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:19.435 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:19.470 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:19.815 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T16:12:19.830 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-19T16:12:19.840 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T16:12:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:19.873 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-19T16:12:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:20.184 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-19T16:12:20.199 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T16:12:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-19T16:12:20.258 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:20.293 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-19T16:12:20.629 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T16:12:20.644 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:20.679 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:21.066 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T16:12:21.081 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:21.124 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:21.213 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-babel. 2023-12-19T16:12:21.227 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:21.272 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:21.624 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T16:12:21.638 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-19T16:12:21.682 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-19T16:12:22.035 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T16:12:22.049 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:22.061 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T16:12:22.076 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:22.094 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:22.111 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:22.430 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T16:12:22.444 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-19T16:12:22.488 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:12:22.799 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T16:12:22.814 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-19T16:12:22.849 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:12:23.127 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-py. 2023-12-19T16:12:23.143 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-12-19T16:12:23.185 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-19T16:12:23.331 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2023-12-19T16:12:23.346 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:23.389 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.464 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-19T16:12:23.479 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-19T16:12:23.522 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-19T16:12:23.692 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T16:12:23.707 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:23.776 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.866 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-toml. 2023-12-19T16:12:23.881 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-12-19T16:12:23.924 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-19T16:12:24.120 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T16:12:24.135 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:24.170 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:24.227 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T16:12:24.242 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-19T16:12:24.285 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:12:24.557 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2023-12-19T16:12:24.572 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-cephadm_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:24.615 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:24.639 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T16:12:24.654 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T16:12:24.697 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T16:12:24.960 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T16:12:24.975 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-19T16:12:25.000 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-routes. 2023-12-19T16:12:25.015 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-19T16:12:25.017 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-19T16:12:25.049 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:12:25.354 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-19T16:12:25.369 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:25.411 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T16:12:25.412 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:25.426 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:25.469 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:25.863 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-19T16:12:25.878 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-19T16:12:25.913 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:12:26.453 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T16:12:26.459 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-babel. 2023-12-19T16:12:26.466 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-19T16:12:26.473 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:26.511 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:12:26.517 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:26.870 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T16:12:26.881 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-19T16:12:26.884 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-19T16:12:26.895 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-19T16:12:26.929 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-19T16:12:26.939 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:12:27.217 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T16:12:27.232 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-19T16:12:27.275 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:12:27.324 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T16:12:27.338 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:27.382 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:27.744 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T16:12:27.759 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-19T16:12:27.802 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:12:28.003 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T16:12:28.017 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:28.062 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:28.121 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T16:12:28.136 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-19T16:12:28.180 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:12:28.483 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2023-12-19T16:12:28.499 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-12-19T16:12:28.541 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-19T16:12:28.886 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-19T16:12:28.902 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-19T16:12:28.945 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-19T16:12:29.049 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T16:12:29.064 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-12-19T16:12:29.107 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-19T16:12:29.281 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-toml. 2023-12-19T16:12:29.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-12-19T16:12:29.339 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-19T16:12:29.618 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T16:12:29.634 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-19T16:12:29.650 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T16:12:29.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-19T16:12:29.676 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:12:29.700 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:12:30.022 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T16:12:30.038 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-19T16:12:30.071 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T16:12:30.080 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:12:30.086 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T16:12:30.129 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T16:12:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T16:12:30.390 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-12-19T16:12:30.407 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2023-12-19T16:12:30.422 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-19T16:12:30.433 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-19T16:12:30.457 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:12:30.754 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T16:12:30.770 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-12-19T16:12:30.810 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T16:12:30.812 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-19T16:12:30.825 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:30.860 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:31.132 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T16:12:31.148 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-19T16:12:31.182 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:12:31.280 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-19T16:12:31.295 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-19T16:12:31.338 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:12:31.485 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T16:12:31.501 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-12-19T16:12:31.544 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-19T16:12:31.847 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T16:12:31.850 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T16:12:31.863 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-19T16:12:31.864 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-19T16:12:31.905 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:12:31.908 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:12:32.471 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-19T16:12:32.485 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-19T16:12:32.529 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:12:32.562 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T16:12:32.576 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:32.620 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:32.857 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T16:12:32.872 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-19T16:12:32.915 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:12:32.940 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T16:12:32.954 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-19T16:12:32.998 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:12:33.318 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T16:12:33.332 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:12:33.385 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:12:33.629 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package jq. 2023-12-19T16:12:33.644 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:12:33.687 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-19T16:12:33.726 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T16:12:33.740 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:33.784 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:33.940 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package socat. 2023-12-19T16:12:33.955 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-19T16:12:33.998 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:12:34.285 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T16:12:34.301 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-19T16:12:34.343 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:12:34.721 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T16:12:34.736 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-12-19T16:12:34.770 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-19T16:12:34.798 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-test. 2023-12-19T16:12:34.813 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../098-ceph-test_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:34.856 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:35.082 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T16:12:35.097 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-19T16:12:35.140 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:12:35.469 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T16:12:35.484 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-19T16:12:35.560 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:12:35.863 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T16:12:35.878 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-12-19T16:12:35.921 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-19T16:12:36.242 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T16:12:36.258 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-12-19T16:12:36.291 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-19T16:12:36.695 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T16:12:36.710 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-19T16:12:36.753 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:12:36.853 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T16:12:36.869 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:36.911 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:37.106 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T16:12:37.121 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-12-19T16:12:37.164 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-19T16:12:37.324 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T16:12:37.340 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:37.382 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:37.518 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T16:12:37.534 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-19T16:12:37.576 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:12:37.694 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T16:12:37.710 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-12-19T16:12:37.752 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-19T16:12:38.013 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T16:12:38.029 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:38.071 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:38.248 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T16:12:38.262 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:38.306 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:38.358 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T16:12:38.373 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:38.416 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:38.634 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T16:12:38.648 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-19T16:12:38.652 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T16:12:38.668 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:38.692 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:12:38.702 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:39.053 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T16:12:39.068 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:12:39.080 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T16:12:39.096 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-19T16:12:39.112 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:12:39.139 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:12:39.406 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2023-12-19T16:12:39.421 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:12:39.456 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-19T16:12:39.502 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T16:12:39.518 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-19T16:12:39.560 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:12:39.684 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2023-12-19T16:12:39.699 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-19T16:12:39.734 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:12:39.972 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T16:12:39.987 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T16:12:40.029 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T16:12:40.030 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T16:12:40.044 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-19T16:12:40.087 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:12:40.350 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T16:12:40.365 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-19T16:12:40.408 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-19T16:12:40.449 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2023-12-19T16:12:40.464 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-ceph-test_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:40.507 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:40.761 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pygments. 2023-12-19T16:12:40.777 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-19T16:12:40.820 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:12:41.307 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T16:12:41.322 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-19T16:12:41.366 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:12:41.694 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T16:12:41.708 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-19T16:12:41.752 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:12:42.005 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T16:12:42.019 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-19T16:12:42.055 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:12:42.529 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T16:12:42.544 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:42.587 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:42.800 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package radosgw. 2023-12-19T16:12:42.815 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../113-radosgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:42.875 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:42.941 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T16:12:42.956 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:43.024 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:43.319 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T16:12:43.334 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-12-19T16:12:43.377 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-19T16:12:43.453 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T16:12:43.468 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:43.512 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:43.655 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T16:12:43.670 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:43.705 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:43.779 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-19T16:12:43.993 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T16:12:44.008 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:44.051 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:44.067 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:12:44.185 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:12:44.304 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T16:12:44.319 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:44.362 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:44.446 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-19T16:12:44.765 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T16:12:44.780 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-19T16:12:44.823 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:12:44.843 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-19T16:12:45.187 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T16:12:45.202 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-19T16:12:45.245 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:12:45.420 INFO:teuthology.orchestra.run.smithi143.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-19T16:12:45.459 INFO:teuthology.orchestra.run.smithi143.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-19T16:12:45.537 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:45.673 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T16:12:45.688 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T16:12:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T16:12:46.085 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T16:12:46.100 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-19T16:12:46.124 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user cephadm....done 2023-12-19T16:12:46.143 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-19T16:12:46.293 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:12:46.496 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pygments. 2023-12-19T16:12:46.513 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-19T16:12:46.553 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:12:46.554 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:12:46.804 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:12:46.930 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:12:47.000 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T16:12:47.014 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-19T16:12:47.067 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:12:47.198 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T16:12:47.411 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T16:12:47.426 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-19T16:12:47.469 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:12:47.474 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:12:47.617 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-19T16:12:47.721 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T16:12:47.736 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-19T16:12:47.780 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:12:47.919 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:12:48.271 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-19T16:12:48.484 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2023-12-19T16:12:48.498 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-radosgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:48.534 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:48.547 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-19T16:12:48.816 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-19T16:12:49.100 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:12:49.128 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T16:12:49.143 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:49.186 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:49.369 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:12:49.513 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-19T16:12:49.636 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:12:49.783 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:12:49.884 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:12:50.113 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:50.149 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-19T16:12:50.381 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:12:50.506 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-19T16:12:50.560 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-19T16:12:50.766 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:12:51.050 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:12:51.160 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-19T16:12:51.225 INFO:teuthology.orchestra.run.smithi119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-19T16:12:51.238 INFO:teuthology.orchestra.run.smithi119.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-19T16:12:51.286 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:51.511 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:51.637 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-19T16:12:51.890 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2023-12-19T16:12:51.913 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:12:52.050 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:12:52.223 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:12:52.352 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:12:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:12:52.645 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:12:53.012 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:12:53.226 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:12:53.305 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T16:12:53.486 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:12:53.607 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:12:53.612 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:12:53.738 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:12:53.741 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-19T16:12:54.048 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-19T16:12:54.076 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:12:54.449 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-19T16:12:54.453 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-19T16:12:54.725 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:12:54.746 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-19T16:12:55.047 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-19T16:12:55.110 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:12:55.390 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:12:55.395 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-19T16:12:55.683 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:12:55.713 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:12:55.934 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:12:56.072 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:12:56.210 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:56.341 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:12:56.450 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:56.486 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:12:56.612 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-19T16:12:56.735 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-idna (3.3-1) ... 2023-12-19T16:12:56.871 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:12:57.102 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:12:57.164 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:12:57.273 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-19T16:12:57.625 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:57.742 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-19T16:12:58.010 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:12:58.278 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:12:58.326 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:58.460 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-19T16:12:58.621 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:12:58.744 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:12:58.870 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:12:58.996 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:12:59.298 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:12:59.339 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:12:59.566 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-19T16:12:59.607 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:12:59.725 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:12:59.825 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:59.859 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:12:59.926 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:13:00.069 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:13:00.186 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-19T16:13:00.387 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:13:00.570 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-19T16:13:00.655 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-19T16:13:00.830 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:13:00.907 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-19T16:13:01.166 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:13:01.256 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:13:01.409 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-19T16:13:01.566 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-19T16:13:01.727 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:13:01.853 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-19T16:13:01.883 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:13:02.137 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:13:02.252 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:13:02.263 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:13:02.511 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:13:02.540 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:13:02.637 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:02.866 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:13:02.996 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-idna (3.3-1) ... 2023-12-19T16:13:03.118 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:13:03.349 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:13:03.633 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-19T16:13:03.887 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:13:04.013 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:13:04.406 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:13:04.581 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:04.683 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-19T16:13:04.746 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-19T16:13:04.967 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:05.014 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:13:05.093 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-19T16:13:05.165 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:13:05.291 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:13:05.601 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:13:05.628 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:13:05.852 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-19T16:13:05.938 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:13:06.103 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:06.222 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-19T16:13:06.229 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:13:06.331 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-19T16:13:06.371 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:13:06.608 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-19T16:13:06.690 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:13:06.884 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:13:06.958 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-19T16:13:07.152 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:13:07.250 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-19T16:13:07.518 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:13:07.570 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T16:13:07.761 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-19T16:13:07.863 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:13:08.029 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:13:08.224 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:13:08.305 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-19T16:13:08.333 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:08.484 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:08.598 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:13:08.688 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:08.723 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:13:08.814 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:08.940 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:09.025 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:13:09.049 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-19T16:13:09.318 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:13:09.343 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:09.469 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:09.602 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:13:09.620 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:09.831 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:09.831 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:10.000 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-19T16:13:10.280 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:13:10.431 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:13:10.438 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:10.548 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:10.665 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:10.808 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:13:10.862 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:13:11.159 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-19T16:13:11.401 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:11.511 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-19T16:13:11.846 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:13:12.088 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.155 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:13:12.214 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.332 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.439 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-19T16:13:12.441 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.565 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-19T16:13:12.576 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.702 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.858 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-19T16:13:13.134 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:13:13.273 INFO:teuthology.orchestra.run.smithi143.stdout:Adding group ceph....done 2023-12-19T16:13:13.393 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:13:13.667 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user ceph....done 2023-12-19T16:13:13.854 INFO:teuthology.orchestra.run.smithi143.stdout:Setting system user ceph properties....done 2023-12-19T16:13:13.871 INFO:teuthology.orchestra.run.smithi143.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T16:13:13.962 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T16:13:14.013 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T16:13:14.263 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:13:14.423 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T16:13:14.617 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:13:14.766 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:14.876 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:15.070 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:15.229 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:15.266 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:15.356 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:15.482 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-19T16:13:15.553 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:15.553 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:15.784 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:15.910 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:16.011 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:16.220 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:16.220 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:16.310 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:16.841 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:16.841 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:16.904 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:17.063 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:17.231 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:17.358 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:13:17.421 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:17.787 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T16:13:18.423 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:18.646 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:18.772 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:18.898 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:19.050 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:19.160 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:19.260 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:19.266 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:19.479 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:19.479 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2023-12-19T16:13:20.101 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2023-12-19T16:13:20.418 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2023-12-19T16:13:20.422 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:20.422 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:20.438 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T16:13:20.582 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T16:13:20.959 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T16:13:21.031 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:21.182 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:21.325 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:21.529 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:21.529 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:21.678 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:21.887 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:21.887 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:22.142 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:22.319 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:22.445 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:22.529 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:22.588 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:22.655 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:22.941 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:13:23.205 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:23.206 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:23.708 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:13:23.841 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:24.178 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T16:13:24.184 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:13:24.189 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T16:13:24.263 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-12-19T16:13:24.432 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2023-12-19T16:13:24.432 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2023-12-19T16:13:24.584 INFO:teuthology.orchestra.run.smithi143.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-19T16:13:24.584 INFO:teuthology.orchestra.run.smithi143.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-19T16:13:24.584 INFO:teuthology.orchestra.run.smithi143.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:24.584 INFO:teuthology.orchestra.run.smithi143.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:24.584 INFO:teuthology.orchestra.run.smithi143.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:13:24.585 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:13:24.586 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2023-12-19T16:13:24.586 INFO:teuthology.orchestra.run.smithi143.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-19T16:13:24.586 INFO:teuthology.orchestra.run.smithi143.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-19T16:13:24.587 INFO:teuthology.orchestra.run.smithi143.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-19T16:13:24.587 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-19T16:13:24.587 INFO:teuthology.orchestra.run.smithi143.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:24.588 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2023-12-19T16:13:24.588 INFO:teuthology.orchestra.run.smithi143.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-19T16:13:24.588 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-19T16:13:24.588 INFO:teuthology.orchestra.run.smithi143.stdout: libengine-pkcs11-openssl 2023-12-19T16:13:24.638 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2023-12-19T16:13:24.639 INFO:teuthology.orchestra.run.smithi143.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-19T16:13:24.639 INFO:teuthology.orchestra.run.smithi143.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-19T16:13:24.639 INFO:teuthology.orchestra.run.smithi143.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-19T16:13:24.639 INFO:teuthology.orchestra.run.smithi143.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-19T16:13:24.640 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-19T16:13:24.640 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-19T16:13:24.640 INFO:teuthology.orchestra.run.smithi143.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:24.640 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2023-12-19T16:13:24.641 INFO:teuthology.orchestra.run.smithi143.stdout: libssl3 2023-12-19T16:13:24.702 INFO:teuthology.orchestra.run.smithi143.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-19T16:13:24.702 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 54.6 MB of archives. 2023-12-19T16:13:24.702 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-19T16:13:24.703 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-19T16:13:24.823 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-19T16:13:24.859 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:24.890 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-19T16:13:24.902 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-19T16:13:24.902 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-19T16:13:24.905 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-19T16:13:24.906 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-19T16:13:24.907 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-19T16:13:24.908 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-19T16:13:24.909 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-19T16:13:24.909 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-19T16:13:24.915 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-19T16:13:24.930 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-19T16:13:25.082 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:25.082 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:25.262 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-19T16:13:25.264 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-19T16:13:25.264 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-19T16:13:25.266 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-19T16:13:25.267 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-19T16:13:25.271 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-19T16:13:25.273 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-19T16:13:25.280 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-19T16:13:25.281 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-19T16:13:25.309 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-19T16:13:25.316 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-19T16:13:25.330 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-19T16:13:25.356 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-19T16:13:25.359 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-19T16:13:25.360 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-19T16:13:25.360 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-19T16:13:25.363 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-19T16:13:25.380 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-19T16:13:25.387 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-19T16:13:25.629 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-19T16:13:25.629 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-19T16:13:25.629 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-19T16:13:25.629 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-19T16:13:25.629 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-19T16:13:25.630 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-19T16:13:25.645 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-19T16:13:25.645 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-19T16:13:25.702 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:25.942 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:25.942 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:26.030 INFO:teuthology.orchestra.run.smithi143.stdout:Preconfiguring packages ... 2023-12-19T16:13:26.227 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 54.6 MB in 1s (54.8 MB/s) 2023-12-19T16:13:26.343 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package flex. 2023-12-19T16:13:26.415 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-12-19T16:13:26.419 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:26.458 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-19T16:13:26.587 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:26.927 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:26.927 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:27.020 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:13:27.198 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-19T16:13:27.572 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:27.578 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:27.731 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:27.883 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:28.093 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:28.093 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:28.133 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package bison. 2023-12-19T16:13:28.205 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-12-19T16:13:28.209 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-19T16:13:28.269 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:13:28.686 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T16:13:28.700 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-19T16:13:28.726 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:28.744 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:13:29.081 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package dump. 2023-12-19T16:13:29.095 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-19T16:13:29.140 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking dump (0.4b47-3) ... 2023-12-19T16:13:29.356 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:29.451 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package indent. 2023-12-19T16:13:29.466 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:29.490 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:29.535 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:13:29.641 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:29.796 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T16:13:29.811 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-19T16:13:29.854 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:13:30.044 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:13:30.183 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T16:13:30.199 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-19T16:13:30.241 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:13:30.511 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T16:13:30.526 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-19T16:13:30.569 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:13:30.898 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-19T16:13:30.913 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:30.956 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:31.192 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-19T16:13:31.207 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:31.228 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:13:31.250 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:31.503 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjson-perl. 2023-12-19T16:13:31.519 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-19T16:13:31.586 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-19T16:13:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:13:31.717 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T16:13:31.793 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-12-19T16:13:31.898 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-19T16:13:31.914 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-19T16:13:31.956 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:13:31.970 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2023-12-19T16:13:31.971 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:13:32.129 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:13:32.130 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:13:32.130 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-19T16:13:32.131 INFO:teuthology.orchestra.run.smithi119.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:32.132 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2023-12-19T16:13:32.132 INFO:teuthology.orchestra.run.smithi119.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-19T16:13:32.132 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-19T16:13:32.132 INFO:teuthology.orchestra.run.smithi119.stdout: libengine-pkcs11-openssl 2023-12-19T16:13:32.182 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-19T16:13:32.183 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:32.184 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2023-12-19T16:13:32.185 INFO:teuthology.orchestra.run.smithi119.stdout: libssl3 2023-12-19T16:13:32.259 INFO:teuthology.orchestra.run.smithi119.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-19T16:13:32.259 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 54.6 MB of archives. 2023-12-19T16:13:32.260 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-19T16:13:32.260 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-19T16:13:32.381 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-19T16:13:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-19T16:13:32.520 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-19T16:13:32.520 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-19T16:13:32.526 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-19T16:13:32.533 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-19T16:13:32.533 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-19T16:13:32.540 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-19T16:13:32.541 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-19T16:13:32.541 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-19T16:13:32.545 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-19T16:13:32.579 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-19T16:13:33.376 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-19T16:13:33.378 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-19T16:13:33.378 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-19T16:13:33.381 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-19T16:13:33.381 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-19T16:13:33.385 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-19T16:13:33.389 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-19T16:13:33.392 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T16:13:33.408 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-19T16:13:33.408 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:13:33.409 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-19T16:13:33.451 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-19T16:13:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-19T16:13:33.499 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-19T16:13:33.553 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-19T16:13:33.563 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-19T16:13:33.565 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-19T16:13:33.565 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-19T16:13:33.566 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-19T16:13:33.595 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-19T16:13:33.599 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-19T16:13:33.687 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T16:13:33.702 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:13:33.737 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:33.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-19T16:13:33.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-19T16:13:33.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-19T16:13:33.990 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-19T16:13:33.990 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-19T16:13:33.990 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-19T16:13:34.016 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-19T16:13:34.016 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-19T16:13:34.048 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T16:13:34.064 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:13:34.106 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:34.396 INFO:teuthology.orchestra.run.smithi119.stdout:Preconfiguring packages ... 2023-12-19T16:13:34.459 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T16:13:34.475 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-19T16:13:34.517 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:13:34.553 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 54.6 MB in 2s (29.9 MB/s) 2023-12-19T16:13:34.703 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package flex. 2023-12-19T16:13:34.775 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-12-19T16:13:34.779 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:34.819 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-19T16:13:34.845 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T16:13:34.861 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:13:34.904 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:13:35.206 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T16:13:35.222 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:35.265 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:35.422 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:13:35.618 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T16:13:35.633 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-19T16:13:35.634 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:35.676 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:13:35.979 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T16:13:35.994 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:35.997 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:36.037 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:13:36.248 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T16:13:36.263 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:13:36.306 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:36.592 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package bison. 2023-12-19T16:13:36.665 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-12-19T16:13:36.668 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-19T16:13:36.712 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:13:36.843 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T16:13:36.857 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-19T16:13:36.901 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:13:37.162 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T16:13:37.176 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-19T16:13:37.220 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:13:37.255 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package modemmanager. 2023-12-19T16:13:37.269 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:13:37.305 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:37.557 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2023-12-19T16:13:37.571 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-19T16:13:37.615 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b47-3) ... 2023-12-19T16:13:37.910 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2023-12-19T16:13:37.925 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:37.944 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager. 2023-12-19T16:13:37.958 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:13:37.994 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:13:38.011 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:13:38.237 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T16:13:38.252 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-19T16:13:38.287 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:13:38.635 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ppp. 2023-12-19T16:13:38.649 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-19T16:13:38.659 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T16:13:38.674 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-19T16:13:38.717 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:13:38.977 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T16:13:38.985 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:13:38.993 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-19T16:13:39.035 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:13:39.299 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T16:13:39.313 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-19T16:13:39.355 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-19T16:13:39.357 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-19T16:13:39.371 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:39.430 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:39.610 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T16:13:39.624 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-19T16:13:39.669 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-19T16:13:39.669 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-19T16:13:39.684 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:39.727 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:39.980 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T16:13:39.994 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-19T16:13:40.029 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjson-perl. 2023-12-19T16:13:40.038 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-common (238) ... 2023-12-19T16:13:40.045 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-19T16:13:40.087 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-19T16:13:40.342 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-19T16:13:40.356 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:40.400 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:40.415 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-19T16:13:40.431 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-19T16:13:40.465 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:13:40.964 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T16:13:40.978 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-19T16:13:41.039 INFO:teuthology.orchestra.run.smithi143.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T16:13:41.070 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-common (238) ... 2023-12-19T16:13:41.513 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-14. 2023-12-19T16:13:41.528 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:41.574 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:41.876 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T16:13:41.892 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:13:41.960 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:42.187 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T16:13:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:13:42.237 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:42.573 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T16:13:42.589 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:13:42.631 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:42.742 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql. 2023-12-19T16:13:42.757 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-19T16:13:42.801 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql (14+238) ... 2023-12-19T16:13:42.984 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T16:13:43.001 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-19T16:13:43.044 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T16:13:43.051 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:13:43.059 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-19T16:13:43.103 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client (14+238) ... 2023-12-19T16:13:43.347 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T16:13:43.361 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-19T16:13:43.397 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-19T16:13:43.411 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T16:13:43.427 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:13:43.470 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:13:43.716 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl8.6. 2023-12-19T16:13:43.730 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-19T16:13:43.774 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:13:43.848 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T16:13:43.864 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:43.906 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:44.060 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl. 2023-12-19T16:13:44.075 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-19T16:13:44.123 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-19T16:13:44.225 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T16:13:44.241 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:44.283 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:13:44.472 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T16:13:44.486 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-19T16:13:44.530 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:13:44.885 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T16:13:44.899 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-19T16:13:44.943 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-19T16:13:44.953 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T16:13:44.968 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:45.011 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:13:45.288 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T16:13:45.304 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:13:45.321 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T16:13:45.336 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-19T16:13:45.347 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:45.388 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:13:45.671 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-common (238) ... 2023-12-19T16:13:45.858 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T16:13:45.874 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-19T16:13:45.903 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-19T16:13:45.916 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:13:46.029 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:13:46.155 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:46.282 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:13:46.294 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package modemmanager. 2023-12-19T16:13:46.310 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:13:46.353 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:46.408 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:13:46.509 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:46.967 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager. 2023-12-19T16:13:46.983 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:13:47.035 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:13:47.516 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T16:13:47.640 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:13:47.700 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ppp. 2023-12-19T16:13:47.715 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-19T16:13:47.993 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:13:47.993 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:13:48.064 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:13:48.412 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T16:13:48.427 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-19T16:13:48.471 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-19T16:13:48.651 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:13:48.748 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T16:13:48.763 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-19T16:13:48.777 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:48.806 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-19T16:13:48.904 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-19T16:13:49.038 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:13:49.085 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T16:13:49.100 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-19T16:13:49.151 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-common (238) ... 2023-12-19T16:13:49.164 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:49.315 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:13:49.438 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-19T16:13:49.441 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:13:49.454 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:49.497 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:50.138 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T16:13:50.152 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-19T16:13:50.197 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:13:50.218 INFO:teuthology.orchestra.run.smithi119.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T16:13:50.250 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-common (238) ... 2023-12-19T16:13:50.323 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up dump (0.4b47-3) ... 2023-12-19T16:13:50.444 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T16:13:50.508 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:50.609 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:13:50.708 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-14. 2023-12-19T16:13:50.723 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:50.735 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-19T16:13:50.769 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:50.862 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-19T16:13:50.988 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:13:51.078 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-19T16:13:51.149 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:13:51.274 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:13:51.450 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:13:51.585 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:51.711 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-19T16:13:51.845 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql. 2023-12-19T16:13:51.860 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-19T16:13:51.879 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client (14+238) ... 2023-12-19T16:13:51.903 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql (14+238) ... 2023-12-19T16:13:52.014 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:13:52.155 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T16:13:52.170 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-19T16:13:52.214 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client (14+238) ... 2023-12-19T16:13:52.449 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T16:13:52.463 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-19T16:13:52.541 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-19T16:13:52.598 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:13:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T16:13:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:which means they are currently configured by ifupdown: 2023-12-19T16:13:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:- enp3s0f1 2023-12-19T16:13:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T16:13:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T16:13:52.599 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:13:52.733 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T16:13:52.868 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl8.6. 2023-12-19T16:13:52.883 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-19T16:13:52.927 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:13:53.130 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T16:13:53.238 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl. 2023-12-19T16:13:53.253 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-19T16:13:53.301 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-19T16:13:53.528 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T16:13:53.632 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T16:13:53.648 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-19T16:13:53.690 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:13:54.078 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T16:13:54.094 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-19T16:13:54.136 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-19T16:13:54.212 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:54.334 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:54.461 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-19T16:13:54.539 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T16:13:54.555 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-19T16:13:54.586 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-common (238) ... 2023-12-19T16:13:54.606 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:13:54.873 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-common (238) ... 2023-12-19T16:13:55.112 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-19T16:13:55.238 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:13:55.364 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:55.498 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:13:55.566 INFO:teuthology.orchestra.run.smithi143.stdout:Adding user postgres to group ssl-cert 2023-12-19T16:13:55.608 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:13:55.734 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:55.846 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:13:55.846 INFO:teuthology.orchestra.run.smithi143.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T16:13:56.121 INFO:teuthology.orchestra.run.smithi143.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T16:13:56.121 INFO:teuthology.orchestra.run.smithi143.stdout:Removing obsolete dictionary files: 2023-12-19T16:13:56.741 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T16:13:56.822 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T16:13:56.865 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:13:57.217 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:13:57.218 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:13:57.281 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:13:57.774 INFO:teuthology.orchestra.run.smithi143.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-19T16:13:57.802 INFO:teuthology.orchestra.run.smithi143.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-19T16:13:57.861 INFO:teuthology.orchestra.run.smithi143.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T16:13:57.861 INFO:teuthology.orchestra.run.smithi143.stdout:This user must also own the server process. 2023-12-19T16:13:57.861 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:The default text search configuration will be set to "english". 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:Data page checksums are disabled. 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:creating subdirectories ... ok 2023-12-19T16:13:57.862 INFO:teuthology.orchestra.run.smithi143.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T16:13:57.887 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default max_connections ... 100 2023-12-19T16:13:57.922 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default shared_buffers ... 128MB 2023-12-19T16:13:57.934 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:13:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default time zone ... Etc/UTC 2023-12-19T16:13:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:creating configuration files ... ok 2023-12-19T16:13:58.060 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:58.107 INFO:teuthology.orchestra.run.smithi143.stdout:running bootstrap script ... ok 2023-12-19T16:13:58.162 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-19T16:13:58.296 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:13:58.405 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:58.531 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:13:58.657 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:13:58.752 INFO:teuthology.orchestra.run.smithi143.stdout:performing post-bootstrap initialization ... ok 2023-12-19T16:13:59.255 INFO:teuthology.orchestra.run.smithi143.stdout:syncing data to disk ... ok 2023-12-19T16:13:59.337 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:13:59.439 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b47-3) ... 2023-12-19T16:13:59.533 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T16:13:59.590 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:59.749 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:13:59.764 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T16:13:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-19T16:14:00.001 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-19T16:14:00.128 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:14:00.242 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-19T16:14:00.329 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:14:00.455 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:14:00.623 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:14:00.749 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:00.875 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-19T16:14:01.043 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client (14+238) ... 2023-12-19T16:14:01.211 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:14:01.806 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:01.806 INFO:teuthology.orchestra.run.smithi119.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T16:14:01.806 INFO:teuthology.orchestra.run.smithi119.stdout:which means they are currently configured by ifupdown: 2023-12-19T16:14:01.806 INFO:teuthology.orchestra.run.smithi119.stdout:- enp3s0f1 2023-12-19T16:14:01.806 INFO:teuthology.orchestra.run.smithi119.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T16:14:01.806 INFO:teuthology.orchestra.run.smithi119.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T16:14:01.807 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:01.940 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T16:14:02.317 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T16:14:02.725 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T16:14:03.173 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:03.324 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-19T16:14:03.441 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:03.450 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql (14+238) ... 2023-12-19T16:14:03.576 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:03.614 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:14:03.702 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:03.741 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-19T16:14:03.866 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-common (238) ... 2023-12-19T16:14:03.947 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:03.947 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:04.656 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T16:14:04.828 INFO:teuthology.orchestra.run.smithi119.stdout:Adding user postgres to group ssl-cert 2023-12-19T16:14:04.983 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:14:05.097 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:05.097 INFO:teuthology.orchestra.run.smithi119.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T16:14:05.135 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:14:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T16:14:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:Removing obsolete dictionary files: 2023-12-19T16:14:06.068 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T16:14:06.528 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-19T16:14:06.577 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:06.612 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T16:14:06.920 INFO:teuthology.orchestra.run.smithi119.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-19T16:14:06.946 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-19T16:14:07.002 INFO:teuthology.orchestra.run.smithi119.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout:This user must also own the server process. 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout:The default text search configuration will be set to "english". 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout:Data page checksums are disabled. 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:07.003 INFO:teuthology.orchestra.run.smithi119.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-19T16:14:07.004 INFO:teuthology.orchestra.run.smithi119.stdout:creating subdirectories ... ok 2023-12-19T16:14:07.004 INFO:teuthology.orchestra.run.smithi119.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T16:14:07.028 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default max_connections ... 100 2023-12-19T16:14:07.062 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default shared_buffers ... 128MB 2023-12-19T16:14:07.076 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default time zone ... Etc/UTC 2023-12-19T16:14:07.077 INFO:teuthology.orchestra.run.smithi119.stdout:creating configuration files ... ok 2023-12-19T16:14:07.246 INFO:teuthology.orchestra.run.smithi119.stdout:running bootstrap script ... ok 2023-12-19T16:14:07.309 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:14:07.318 DEBUG:teuthology.parallel:result is None 2023-12-19T16:14:07.877 INFO:teuthology.orchestra.run.smithi119.stdout:performing post-bootstrap initialization ... ok 2023-12-19T16:14:08.499 INFO:teuthology.orchestra.run.smithi119.stdout:syncing data to disk ... ok 2023-12-19T16:14:09.059 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T16:14:12.317 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:12.443 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-19T16:14:12.569 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql (14+238) ... 2023-12-19T16:14:12.720 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:12.821 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:13.057 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:13.057 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:13.790 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T16:14:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:14:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:14:15.855 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-19T16:14:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T16:14:16.659 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:14:16.665 DEBUG:teuthology.parallel:result is None 2023-12-19T16:14:16.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:14:16.885 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2023-12-19T16:14:16.907 INFO:teuthology.orchestra.run.smithi119.stdout:18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:16.907 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:16.907 INFO:teuthology.task.install:The correct ceph version 18.2.1-132-g568df92b-1jammy is installed. 2023-12-19T16:14:16.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:14:17.047 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-query -W -f '${Version}' ceph 2023-12-19T16:14:17.072 INFO:teuthology.orchestra.run.smithi143.stdout:18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:17.072 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:17.072 INFO:teuthology.task.install:The correct ceph version 18.2.1-132-g568df92b-1jammy is installed. 2023-12-19T16:14:17.074 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T16:14:17.074 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:17.074 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:14:17.095 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:17.095 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:14:17.137 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T16:14:17.138 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:17.138 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:14:17.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:14:17.219 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:17.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:14:17.240 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:14:17.305 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T16:14:17.305 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:17.306 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:14:17.325 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:14:17.390 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:17.391 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:14:17.411 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:14:17.476 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T16:14:17.476 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:17.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:14:17.495 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:14:17.563 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:17.563 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:14:17.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:14:17.648 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T16:14:17.715 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T16:14:17.715 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2023-12-19T16:14:17.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2023-12-19T16:14:17.739 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T16:14:17.739 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:14:17.779 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:14:17.799 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T16:14:17.799 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:14:17.838 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:14:17.868 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T16:14:17.869 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T16:14:17.869 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T16:14:17.869 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:17.869 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:14:17.904 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:17.994 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:17.994 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:14:18.003 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:18.098 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T16:14:18.098 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T16:14:18.098 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7497087', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 430, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'sleep_before_teardown': 0, 'subset': '301/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7ubHdMglsVfADcIX6+TdDQP7AHO9OIje4N+g6wC7pIhNSkUzrRjeTf9EbRvWOJHucTfdljWCbDgOYMGe3c7n4=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4JsTmELUGAxtWiLy97OLPdKNJuCwF4+uobIfinfHx9ozX0ZziFF0TJYfE2SG8DTLC9C9KAPUJCdxK/nFn0eW8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_13:22:41', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T16:14:18.099 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:14:18.102 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:14:18.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:14:18.155 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:14:18.176 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:18.176 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T16:14:18.220 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T16:14:18.220 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-19 16:07:54.902905134 +0000 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-19 16:07:54.490908814 +0000 2023-12-19T16:14:18.272 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-19 16:07:54.490908814 +0000 2023-12-19T16:14:18.273 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-19 16:07:54.490908814 +0000 2023-12-19T16:14:18.273 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T16:14:18.333 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-19T16:14:18.334 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-19T16:14:18.334 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000344767 s, 1.5 MB/s 2023-12-19T16:14:18.335 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T16:14:18.386 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-12-19T16:14:18.436 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 914 Links: 1 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-19 16:07:55.546899382 +0000 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-19 16:07:55.146902955 +0000 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-19 16:07:55.146902955 +0000 2023-12-19T16:14:18.437 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-19 16:07:55.146902955 +0000 2023-12-19T16:14:18.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T16:14:18.498 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-19T16:14:18.498 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-19T16:14:18.498 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000348819 s, 1.5 MB/s 2023-12-19T16:14:18.500 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T16:14:18.558 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-12-19T16:14:18.608 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T16:14:18.608 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:18.608 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 931 Links: 1 2023-12-19T16:14:18.608 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:18.608 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-19 16:07:56.194893594 +0000 2023-12-19T16:14:18.609 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-19 16:07:55.790897201 +0000 2023-12-19T16:14:18.609 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-19 16:07:55.790897201 +0000 2023-12-19T16:14:18.609 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-19 16:07:55.790897201 +0000 2023-12-19T16:14:18.609 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T16:14:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-19T16:14:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-19T16:14:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000353079 s, 1.5 MB/s 2023-12-19T16:14:18.675 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T16:14:18.726 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-12-19T16:14:18.776 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T16:14:18.776 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:18.777 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 949 Links: 1 2023-12-19T16:14:18.777 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:18.777 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-19 16:07:56.878887483 +0000 2023-12-19T16:14:18.777 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-19 16:07:56.450891306 +0000 2023-12-19T16:14:18.777 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-19 16:07:56.450891306 +0000 2023-12-19T16:14:18.777 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-19 16:07:56.450891306 +0000 2023-12-19T16:14:18.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T16:14:18.837 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-19T16:14:18.837 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-19T16:14:18.838 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000368105 s, 1.4 MB/s 2023-12-19T16:14:18.839 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T16:14:18.890 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:18.890 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:18.890 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T16:14:18.899 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T16:14:18.899 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2023-12-19T16:14:18.949 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T16:14:18.949 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:18.950 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 891 Links: 1 2023-12-19T16:14:18.950 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:18.950 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-19 16:08:00.824869698 +0000 2023-12-19T16:14:18.950 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-19 16:08:00.424873270 +0000 2023-12-19T16:14:18.950 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-19 16:08:00.424873270 +0000 2023-12-19T16:14:18.950 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-19 16:08:00.424873270 +0000 2023-12-19T16:14:18.951 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T16:14:19.012 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-19T16:14:19.012 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-19T16:14:19.012 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000415682 s, 1.2 MB/s 2023-12-19T16:14:19.014 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T16:14:19.071 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2023-12-19T16:14:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T16:14:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:19.121 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-12-19T16:14:19.121 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:19.121 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-19 16:08:01.524863445 +0000 2023-12-19T16:14:19.121 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-19 16:08:01.096867268 +0000 2023-12-19T16:14:19.121 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-19 16:08:01.096867268 +0000 2023-12-19T16:14:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-19 16:08:01.096867268 +0000 2023-12-19T16:14:19.121 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T16:14:19.187 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-19T16:14:19.187 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-19T16:14:19.187 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000380727 s, 1.3 MB/s 2023-12-19T16:14:19.189 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T16:14:19.242 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2023-12-19T16:14:19.292 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T16:14:19.292 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:19.293 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 925 Links: 1 2023-12-19T16:14:19.293 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:19.293 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-19 16:08:01.800860980 +0000 2023-12-19T16:14:19.293 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-19 16:08:01.796861016 +0000 2023-12-19T16:14:19.293 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-19 16:08:01.796861016 +0000 2023-12-19T16:14:19.293 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-19 16:08:01.796861016 +0000 2023-12-19T16:14:19.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T16:14:19.358 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-19T16:14:19.359 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-19T16:14:19.359 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00037664 s, 1.4 MB/s 2023-12-19T16:14:19.360 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T16:14:19.414 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2023-12-19T16:14:19.470 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 940 Links: 1 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-19 16:08:02.868851441 +0000 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-19 16:08:02.456855121 +0000 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-19 16:08:02.456855121 +0000 2023-12-19T16:14:19.471 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-19 16:08:02.456855121 +0000 2023-12-19T16:14:19.472 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T16:14:19.531 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-19T16:14:19.531 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-19T16:14:19.531 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000392257 s, 1.3 MB/s 2023-12-19T16:14:19.533 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T16:14:19.586 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:19.586 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T16:14:19.587 INFO:tasks.ceph:Generating config... 2023-12-19T16:14:19.588 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T16:14:19.588 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T16:14:19.588 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T16:14:19.588 INFO:tasks.ceph:[client] pid file = 2023-12-19T16:14:19.588 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T16:14:19.588 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T16:14:19.588 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T16:14:19.588 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T16:14:19.589 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T16:14:19.589 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T16:14:19.589 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T16:14:19.589 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T16:14:19.589 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T16:14:19.589 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T16:14:19.590 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T16:14:19.590 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-19T16:14:19.591 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T16:14:19.591 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T16:14:19.591 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T16:14:19.591 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T16:14:19.591 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T16:14:19.591 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T16:14:19.591 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T16:14:19.591 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T16:14:19.634 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T16:14:19.650 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T16:14:19.737 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:14:19.757 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.119'), ('mon.b', '172.21.15.143'), ('mon.c', '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]')] 2023-12-19T16:14:19.758 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.119,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T16:14:19.758 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:19.758 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T16:14:19.808 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.119 --add b 172.21.15.143 --addv c '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: generated fsid 95401411-8d68-4720-80be-89deeb6bcc32 2023-12-19T16:14:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:setting min_mon_release = pacific 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 0 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:fsid 95401411-8d68-4720-80be-89deeb6bcc32 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:last_changed 2023-12-19T16:14:19.897269+0000 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:created 2023-12-19T16:14:19.897269+0000 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:min_mon_release 16 (pacific) 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:election_strategy: 1 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.b 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2023-12-19T16:14:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T16:14:19.899 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T16:14:19.907 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 95401411-8d68-4720-80be-89deeb6bcc32... 2023-12-19T16:14:19.908 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:14:19.955 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:14:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-12-19T16:14:19.995 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-12-19T16:14:19.995 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:14:19.995 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-12-19T16:14:19.995 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.995 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:14:19.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-12-19T16:14:19.997 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.119,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 95401411-8d68-4720-80be-89deeb6bcc32 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-12-19T16:14:20.000 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-12-19T16:14:20.001 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:20.002 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.003 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-12-19T16:14:20.004 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-12-19T16:14:20.005 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:14:20.006 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2023-12-19T16:14:20.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:14:20.008 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.119,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 95401411-8d68-4720-80be-89deeb6bcc32 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.009 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2023-12-19T16:14:20.010 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2023-12-19T16:14:20.011 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2023-12-19T16:14:20.012 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2023-12-19T16:14:20.013 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:14:20.014 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2023-12-19T16:14:20.015 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2023-12-19T16:14:20.016 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2023-12-19T16:14:20.017 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = True 2023-12-19T16:14:20.017 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2023-12-19T16:14:20.017 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2023-12-19T16:14:20.017 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2023-12-19T16:14:20.019 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T16:14:20.020 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T16:14:20.116 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T16:14:20.116 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:20.116 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T16:14:20.125 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:20.125 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T16:14:20.175 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:14:20.176 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:20.176 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:14:20.176 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:14:20.252 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:20.252 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:20.304 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:14:20.304 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:20.304 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:14:20.304 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:14:20.339 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:20.340 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:20.388 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T16:14:20.388 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T16:14:20.388 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T16:14:20.444 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T16:14:20.449 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T16:14:20.508 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T16:14:20.518 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T16:14:20.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T16:14:20.573 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T16:14:20.578 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T16:14:20.598 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T16:14:20.694 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T16:14:20.698 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T16:14:20.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T16:14:20.777 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T16:14:20.782 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T16:14:20.803 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T16:14:20.903 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T16:14:20.908 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-19T16:14:20.929 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T16:14:20.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T16:14:20.971 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T16:14:20.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-19T16:14:21.073 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-19T16:14:21.090 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T16:14:21.133 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T16:14:21.150 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-19T16:14:21.234 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-19T16:14:21.251 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T16:14:21.251 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T16:14:21.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:21.271 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:21.272 INFO:tasks.ceph:role: osd.0 2023-12-19T16:14:21.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:14:21.272 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T16:14:21.342 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:21.343 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:21.807 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-12-19T16:14:21.810 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-12-19T16:14:21.810 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:21.912 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:21.928 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:21.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:21.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:21.995 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:21.995 INFO:tasks.ceph:role: osd.1 2023-12-19T16:14:21.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:14:21.995 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T16:14:22.063 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:22.063 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:22.064 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:22.546 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-12-19T16:14:22.547 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-12-19T16:14:22.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:22.714 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:22.732 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:22.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:22.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:22.801 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:22.801 INFO:tasks.ceph:role: osd.2 2023-12-19T16:14:22.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:14:22.801 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T16:14:22.872 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:22.872 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:22.872 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:22.873 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:23.346 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-12-19T16:14:23.349 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-12-19T16:14:23.349 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:23.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:23.487 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:23.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:23.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:23.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:23.552 INFO:tasks.ceph:role: osd.3 2023-12-19T16:14:23.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:14:23.553 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:23.628 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:23.629 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:23.629 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:24.093 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-12-19T16:14:24.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-12-19T16:14:24.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:24.214 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:24.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:24.233 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:24.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:24.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:24.370+0000 7f91c3155640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T16:14:24.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:24.370+0000 7f91c3155640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T16:14:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:24.370+0000 7f91c3155640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:14:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:24.370+0000 7f91c3155640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:14:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:24.370+0000 7f91c3155640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:14:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:24.374+0000 7f91c3155640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T16:14:27.363 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:27.383 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:27.482+0000 7fa6ac915640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T16:14:27.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:27.482+0000 7fa6ac915640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T16:14:27.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:27.482+0000 7fa6ac915640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:14:27.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:27.482+0000 7fa6ac915640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:14:27.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:27.482+0000 7fa6ac915640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:14:27.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:27.482+0000 7fa6ac915640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T16:14:30.467 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:30.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:30.578+0000 7f2fd6cb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T16:14:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:30.578+0000 7f2fd6cb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T16:14:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:30.578+0000 7f2fd6cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:14:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:30.578+0000 7f2fd6cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:14:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:30.578+0000 7f2fd6cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:14:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:30.578+0000 7f2fd6cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T16:14:33.610 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:33.630 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:33.725+0000 7f3ab613c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T16:14:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:33.725+0000 7f3ab613c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T16:14:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:33.725+0000 7f3ab613c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:14:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:33.725+0000 7f3ab613c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:14:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:33.725+0000 7f3ab613c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:14:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:33.729+0000 7f3ab613c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T16:14:36.734 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:36.755 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:36.778 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:36.778 INFO:tasks.ceph:role: osd.4 2023-12-19T16:14:36.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:14:36.778 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T16:14:36.848 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:36.849 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:37.328 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-19T16:14:37.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-19T16:14:37.331 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:37.492 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:37.510 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:37.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:37.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:37.581 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:37.581 INFO:tasks.ceph:role: osd.5 2023-12-19T16:14:37.581 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:14:37.581 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T16:14:37.652 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:37.652 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:37.652 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:37.652 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:37.652 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:37.653 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:37.653 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:37.653 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:37.653 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:37.653 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:38.090 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-19T16:14:38.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-19T16:14:38.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:38.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:38.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:38.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:38.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:38.284 INFO:tasks.ceph:role: osd.6 2023-12-19T16:14:38.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:14:38.285 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T16:14:38.356 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:38.356 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:38.356 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:38.357 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:38.830 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-19T16:14:38.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-19T16:14:38.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:38.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:39.006 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:39.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:39.007 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:39.072 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:39.072 INFO:tasks.ceph:role: osd.7 2023-12-19T16:14:39.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:14:39.073 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T16:14:39.144 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:39.635 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-19T16:14:39.638 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-19T16:14:39.638 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:39.799 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:39.817 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:39.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:39.818 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:39.959 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:39.955+0000 7ff9c2b88640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T16:14:40.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:39.959+0000 7ff9c2b88640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T16:14:40.026 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:39.959+0000 7ff9c2b88640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:14:40.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:39.959+0000 7ff9c2b88640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:14:40.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:39.959+0000 7ff9c2b88640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:14:40.027 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:39.959+0000 7ff9c2b88640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T16:14:42.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:42.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:43.088 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:43.087+0000 7f8cc2551640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T16:14:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:43.087+0000 7f8cc2551640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T16:14:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:43.087+0000 7f8cc2551640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:14:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:43.087+0000 7f8cc2551640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:14:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:43.087+0000 7f8cc2551640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:14:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:43.087+0000 7f8cc2551640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T16:14:46.086 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:46.107 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:46.201 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:46.199+0000 7f1570a93640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T16:14:46.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:46.199+0000 7f1570a93640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T16:14:46.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:46.199+0000 7f1570a93640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:14:46.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:46.199+0000 7f1570a93640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:14:46.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:46.199+0000 7f1570a93640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:14:46.203 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:46.199+0000 7f1570a93640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T16:14:48.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:48.104 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:49.198 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:49.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:49.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:49.315+0000 7f67bb50b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T16:14:49.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:49.315+0000 7f67bb50b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T16:14:49.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:49.315+0000 7f67bb50b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:14:49.318 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:49.315+0000 7f67bb50b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:14:49.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:49.315+0000 7f67bb50b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:14:49.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:49.319+0000 7f67bb50b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T16:14:52.305 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:52.327 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T16:14:52.327 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.327 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T16:14:52.350 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.350 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T16:14:52.416 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.416 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T16:14:52.481 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T16:14:52.547 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.548 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T16:14:52.616 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.616 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T16:14:52.679 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:52.679 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T16:14:52.747 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:52.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T16:14:52.769 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:52.769 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T16:14:52.837 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:52.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-19T16:14:52.900 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:52.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T16:14:52.963 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:52.963 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T16:14:53.028 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:53.028 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T16:14:53.091 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:53.092 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T16:14:53.156 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:53.156 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T16:14:53.165 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:53.165 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-19T16:14:53.220 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:53.220 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T16:14:53.230 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:53.230 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-19T16:14:53.279 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T16:14:53.280 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T16:14:53.283 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFl2BuDGhAA+Q9BVQ1he47GGTx/7eIoHw== 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFlLDhBIhAA3Y+9H7uLr/4NWc6wXrLwjw== 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFlLLZzKRAA1mYEkFxnIMSc0nOQ5J3fZw== 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBgwYFlM246FhAATtFR0UPTG9iux5t4/pDT4A== 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBjwYFlq7HwHBAAk5181pBrEv1Fr0NWsopEMg== 2023-12-19T16:14:53.327 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBmwYFlny61IhAAwxFTN7IkHgUfv3YpUv9b2A== 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBpwYFlaACTKxAAxbB8vMqBTc8nqHXpm2ZCOw== 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFlCU5jHhAAq425Kk2xzqJYbEG+KbnDZA== 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFleo5rLhAAJHoKLrFQzbYJ01cW5H58bg== 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFlJUDtNRAAMkucPMR4CF+uFnPefHxzaw== 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBvwYFlJwJNORAAiwNlC6En0K9K7KKMrKUJoA== 2023-12-19T16:14:53.328 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBzwYFltvhjBRAARAVX5jbCgshgh46xt/X71Q== 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB2wYFlwB8iDBAAripdVFJZJMdj7HCelaVNLQ== 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB5wYFlcokUExAAQ/3tAfnmMJmp7ZTNpGoigA== 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcwYFlxmL3ORAAUnxwWR6p21EpYQy5hfFh3w== 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout:[client.2] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBdwYFly+dsBBAAV1uD8UkERj4vOKY6L1EshA== 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBdwYFlnA8JCBAA7wql2Q+kIvfCR4WQlK58rA== 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout:[client.3] 2023-12-19T16:14:53.329 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBdwYFlF1wNDhAAlW/gPN5CFwwTxAfF964QeQ== 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFl2BuDGhAA+Q9BVQ1he47GGTx/7eIoHw== 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFlLDhBIhAA3Y+9H7uLr/4NWc6wXrLwjw== 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFlLLZzKRAA1mYEkFxnIMSc0nOQ5J3fZw== 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBgwYFlM246FhAATtFR0UPTG9iux5t4/pDT4A== 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBjwYFlq7HwHBAAk5181pBrEv1Fr0NWsopEMg== 2023-12-19T16:14:53.341 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBmwYFlny61IhAAwxFTN7IkHgUfv3YpUv9b2A== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBpwYFlaACTKxAAxbB8vMqBTc8nqHXpm2ZCOw== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFlCU5jHhAAq425Kk2xzqJYbEG+KbnDZA== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFleo5rLhAAJHoKLrFQzbYJ01cW5H58bg== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFlJUDtNRAAMkucPMR4CF+uFnPefHxzaw== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBvwYFlJwJNORAAiwNlC6En0K9K7KKMrKUJoA== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBzwYFltvhjBRAARAVX5jbCgshgh46xt/X71Q== 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2023-12-19T16:14:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQB2wYFlwB8iDBAAripdVFJZJMdj7HCelaVNLQ== 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQB5wYFlcokUExAAQ/3tAfnmMJmp7ZTNpGoigA== 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBcwYFlxmL3ORAAUnxwWR6p21EpYQy5hfFh3w== 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout:[client.2] 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBdwYFly+dsBBAAV1uD8UkERj4vOKY6L1EshA== 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBdwYFlnA8JCBAA7wql2Q+kIvfCR4WQlK58rA== 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout:[client.3] 2023-12-19T16:14:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBdwYFlF1wNDhAAlW/gPN5CFwwTxAfF964QeQ== 2023-12-19T16:14:53.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:14:53.374 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:14:53.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.445 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.506 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.564 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.568 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.626 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.680 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.683 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.737 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.741 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.795 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:14:53.798 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:14:53.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.855 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.913 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.917 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:14:53.974 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:53.978 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.032 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.035 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.090 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.094 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.149 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.153 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:14:54.207 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.211 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.274 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.331 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.334 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.395 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:14:54.452 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T16:14:54.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T16:14:54.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:14:54.587 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T16:14:54.608 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T16:14:54.628 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:14:54.742 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T16:14:54.762 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T16:14:54.826 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:14:54.941 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T16:14:54.961 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:54.965 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:55.011 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T16:14:55.011 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T16:14:55.011 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T16:14:55.018 INFO:tasks.ceph.mon.a:Started 2023-12-19T16:14:55.018 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T16:14:55.018 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T16:14:55.058 INFO:tasks.ceph.mon.b:Started 2023-12-19T16:14:55.058 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T16:14:55.059 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T16:14:55.062 INFO:tasks.ceph.mon.c:Started 2023-12-19T16:14:55.062 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T16:14:55.062 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T16:14:55.062 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T16:14:55.066 INFO:tasks.ceph.mgr.y:Started 2023-12-19T16:14:55.066 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T16:14:55.066 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T16:14:55.069 INFO:tasks.ceph.mgr.x:Started 2023-12-19T16:14:55.069 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T16:14:55.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T16:14:55.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.205+0000 7fc730b25640 1 Processor -- start 2023-12-19T16:14:55.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.205+0000 7fc730b25640 1 -- start start 2023-12-19T16:14:55.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.205+0000 7fc730b25640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 0x7fc72c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.205+0000 7fc730b25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 0x7fc72c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc730b25640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0cc930 con 0x7fc72c159fb0 2023-12-19T16:14:55.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc730b25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c15aab0 con 0x7fc72c0cbff0 2023-12-19T16:14:55.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc730b25640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c070df0 con 0x7fc72c0ca410 2023-12-19T16:14:55.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 0x7fc72c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 0x7fc72c0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44338/0 (socket says 172.21.15.119:44338) 2023-12-19T16:14:55.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 learned_addr learned my addr 172.21.15.119:0/1947672242 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:14:55.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 msgr2=0x7fc72c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 msgr2=0x7fc72c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 0x7fc72c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 0x7fc72c0cc3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72a59c640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 0x7fc72c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72a59c640 1 -- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 msgr2=0x7fc72c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72a59c640 1 -- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 msgr2=0x7fc72c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72a59c640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 0x7fc72c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T16:14:55.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.209+0000 7fc72a59c640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 0x7fc72c159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T16:14:55.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.381+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157860954 0 0) 0x7fc72c0cc930 con 0x7fc72c159fb0 2023-12-19T16:14:55.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.381+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc718003530 con 0x7fc72c159fb0 2023-12-19T16:14:55.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276853822 0 0) 0x7fc718003530 con 0x7fc72c159fb0 2023-12-19T16:14:55.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 msgr2=0x7fc72c159a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:14:55.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.143:3300/0 conn(0x7fc72c0ca410 0x7fc72c159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 msgr2=0x7fc72c0cc3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 --2- 172.21.15.119:0/1947672242 >> v2:172.21.15.119:3300/0 conn(0x7fc72c0cbff0 0x7fc72c0cc3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c15a4f0 con 0x7fc72c159fb0 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fc714001680 con 0x7fc72c159fb0 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 >> v1:172.21.15.143:6789/0 conn(0x7fc72c159fb0 legacy=0x7fc72c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc718003980 0x7fc718003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7180047d0 0x7fc718004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc718005190 0x7fc71800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c15aab0 con 0x7fc718005190 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c070df0 con 0x7fc7180047d0 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71800c090 con 0x7fc718003980 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc718005190 0x7fc71800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72a59c640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc718003980 0x7fc718003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc721d9b640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7180047d0 0x7fc718004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc718003980 msgr2=0x7fc718003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:55.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc718003980 0x7fc718003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7180047d0 msgr2=0x7fc718004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:55.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7180047d0 0x7fc718004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.385+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718003530 con 0x7fc718005190 2023-12-19T16:14:55.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc72ad9d640 1 -- 172.21.15.119:0/1947672242 reap_dead start 2023-12-19T16:14:55.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc718005190 0x7fc71800b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc724009cc0 tx=0x7fc72401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97290d7c33c70216 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:55.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240a5aa0 con 0x7fc718005190 2023-12-19T16:14:55.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7240a9070 con 0x7fc718005190 2023-12-19T16:14:55.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc729d9b640 1 -- 172.21.15.119:0/1947672242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240a5e60 con 0x7fc718005190 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 -- 172.21.15.119:0/1947672242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc718005190 msgr2=0x7fc71800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc718005190 0x7fc71800b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc724009cc0 tx=0x7fc72401cb90 comp rx=0 tx=0).stop 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 -- 172.21.15.119:0/1947672242 shutdown_connections 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 --2- 172.21.15.119:0/1947672242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc718005190 0x7fc71800b990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 -- 172.21.15.119:0/1947672242 >> 172.21.15.119:0/1947672242 conn(0x7fc72c06a2a0 msgr2=0x7fc72c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 -- 172.21.15.119:0/1947672242 shutdown_connections 2023-12-19T16:14:55.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.389+0000 7fc730b25640 1 -- 172.21.15.119:0/1947672242 wait complete. 2023-12-19T16:14:55.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 Processor -- start 2023-12-19T16:14:55.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 -- start start 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 0x7fc72c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 0x7fc72c1e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc72c15b960 0x7fc72c15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c15c330 con 0x7fc72c0c1f20 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c148e90 con 0x7fc718005190 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0c3030 con 0x7fc72c15b960 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 0x7fc72c1e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc72a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 0x7fc72c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 0x7fc72c1e48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44382/0 (socket says 172.21.15.119:44382) 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc72a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 0x7fc72c148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:48584/0 (socket says 172.21.15.119:48584) 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 -- 172.21.15.119:0/1460110131 learned_addr learned my addr 172.21.15.119:0/1460110131 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc72ad9d640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc72c15b960 0x7fc72c15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 -- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc72c15b960 msgr2=0x7fc72c15bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc72c15b960 0x7fc72c15bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 -- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 msgr2=0x7fc72c148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 0x7fc72c148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 -- 172.21.15.119:0/1460110131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0c34c0 con 0x7fc72c0c1f20 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc72a59c640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 0x7fc72c148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:55.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc721d9b640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 0x7fc72c1e48c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc71400f970 tx=0x7fc71400fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7140052e0 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc714005440 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400d970 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c0c2420 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c0c29e0 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.393+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc714003600 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.397+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc71401d4f0 con 0x7fc72c0c1f20 2023-12-19T16:14:55.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.397+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c04e000 con 0x7fc72c0c1f20 2023-12-19T16:14:55.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.401+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fc714003a90 con 0x7fc72c0c1f20 2023-12-19T16:14:55.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.461+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc72c0c3170 con 0x7fc72c0c1f20 2023-12-19T16:14:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc7237fe640 1 -- 172.21.15.119:0/1460110131 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc714003c30 con 0x7fc72c0c1f20 2023-12-19T16:14:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:adjusted tunables profile to default 2023-12-19T16:14:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 msgr2=0x7fc72c1e48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 0x7fc72c1e48c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc71400f970 tx=0x7fc71400fd70 comp rx=0 tx=0).stop 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 shutdown_connections 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc72c15b960 0x7fc72c15bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc72c0c1f20 0x7fc72c1e48c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 --2- 172.21.15.119:0/1460110131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc718005190 0x7fc72c148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 >> 172.21.15.119:0/1460110131 conn(0x7fc72c06a2a0 msgr2=0x7fc72c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 shutdown_connections 2023-12-19T16:14:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:55.465+0000 7fc730b25640 1 -- 172.21.15.119:0/1460110131 wait complete. 2023-12-19T16:14:55.488 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T16:14:55.489 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T16:14:55.489 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:55.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T16:14:55.509 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:55.509 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T16:14:55.575 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:55.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T16:14:55.625 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:55.623+0000 7ff59609b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T16:14:55.632 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:55.629+0000 7f331fa2f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T16:14:55.643 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:14:55.643 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T16:14:55.708 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:55.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T16:14:55.730 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:55.730 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T16:14:55.791 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:55.792 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T16:14:55.855 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:14:55.855 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T16:14:55.919 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new d87e8a81-ed71-4e9d-9a48-80b04bc91626 0 2023-12-19T16:14:56.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 Processor -- start 2023-12-19T16:14:56.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 -- start start 2023-12-19T16:14:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f465c15cae0 0x7f465c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f465c0cde90 0x7f465c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c15cec0 con 0x7f465c0cf170 2023-12-19T16:14:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0d0530 con 0x7f465c15cae0 2023-12-19T16:14:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4660d25640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0d0810 con 0x7f465c0cde90 2023-12-19T16:14:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f465c0cde90 0x7f465c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f465c0cde90 0x7f465c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58576/0 (socket says 172.21.15.143:58576) 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 -- 172.21.15.143:0/3858910458 learned_addr learned my addr 172.21.15.143:0/3858910458 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f465a59c640 1 --2- 172.21.15.143:0/3858910458 >> v2:172.21.15.119:3300/0 conn(0x7f465c15cae0 0x7f465c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 -- 172.21.15.143:0/3858910458 >> v2:172.21.15.119:3300/0 conn(0x7f465c15cae0 msgr2=0x7f465c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 --2- 172.21.15.143:0/3858910458 >> v2:172.21.15.119:3300/0 conn(0x7f465c15cae0 0x7f465c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 -- 172.21.15.143:0/3858910458 >> v1:172.21.15.119:6789/0 conn(0x7f465c0cf170 legacy=0x7f465c06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:56.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.099+0000 7f4659d9b640 1 -- 172.21.15.143:0/3858910458 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0d0af0 con 0x7f465c0cde90 2023-12-19T16:14:56.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4659d9b640 1 --2- 172.21.15.143:0/3858910458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cde90 0x7f465c0ce2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f465c0b8890 tx=0x7f465001cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753b9f4465bdd7cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f465959a640 1 -- 172.21.15.143:0/3858910458 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500aa610 con 0x7f465c0cde90 2023-12-19T16:14:56.105 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f465959a640 1 -- 172.21.15.143:0/3858910458 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500a6040 con 0x7f465c0cde90 2023-12-19T16:14:56.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f465959a640 1 -- 172.21.15.143:0/3858910458 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500aa990 con 0x7f465c0cde90 2023-12-19T16:14:56.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 -- 172.21.15.143:0/3858910458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cde90 msgr2=0x7f465c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 --2- 172.21.15.143:0/3858910458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cde90 0x7f465c0ce2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f465c0b8890 tx=0x7f465001cef0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 -- 172.21.15.143:0/3858910458 shutdown_connections 2023-12-19T16:14:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 --2- 172.21.15.143:0/3858910458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cde90 0x7f465c0ce2f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 --2- 172.21.15.143:0/3858910458 >> v2:172.21.15.119:3300/0 conn(0x7f465c15cae0 0x7f465c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 -- 172.21.15.143:0/3858910458 >> 172.21.15.143:0/3858910458 conn(0x7f465c089fb0 msgr2=0x7f465c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 -- 172.21.15.143:0/3858910458 shutdown_connections 2023-12-19T16:14:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.103+0000 7f4660d25640 1 -- 172.21.15.143:0/3858910458 wait complete. 2023-12-19T16:14:56.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 Processor -- start 2023-12-19T16:14:56.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 -- start start 2023-12-19T16:14:56.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f465c0cde90 0x7f465c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 0x7f465c0b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f465c15cae0 0x7f465c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1564d0 con 0x7f465c15cae0 2023-12-19T16:14:56.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0c8ea0 con 0x7f465c0cf170 2023-12-19T16:14:56.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0c9180 con 0x7f465c0cde90 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 0x7f465c0b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f465a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f465c0cde90 0x7f465c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 0x7f465c0b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58584/0 (socket says 172.21.15.143:58584) 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 -- 172.21.15.143:0/3494416953 learned_addr learned my addr 172.21.15.143:0/3494416953 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f465ad9d640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f465c15cae0 0x7f465c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 -- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f465c0cde90 msgr2=0x7f465c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f465c0cde90 0x7f465c0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 -- 172.21.15.143:0/3494416953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f465c15cae0 msgr2=0x7f465c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f465c15cae0 0x7f465c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 -- 172.21.15.143:0/3494416953 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500094d0 con 0x7f465c0cf170 2023-12-19T16:14:56.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4659d9b640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 0x7f465c0b7c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f465001a0c0 tx=0x7f465001acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500bd5f0 con 0x7f465c0cf170 2023-12-19T16:14:56.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500bd750 con 0x7f465c0cf170 2023-12-19T16:14:56.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500bdac0 con 0x7f465c0cf170 2023-12-19T16:14:56.112 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0b7190 con 0x7f465c0cf170 2023-12-19T16:14:56.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c0b7750 con 0x7f465c0cf170 2023-12-19T16:14:56.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.107+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f46500b33f0 con 0x7f465c0cf170 2023-12-19T16:14:56.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.111+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f46500c7440 con 0x7f465c0cf170 2023-12-19T16:14:56.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.111+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c0b7940 con 0x7f465c0cf170 2023-12-19T16:14:56.128 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.127+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f46500c3060 con 0x7f465c0cf170 2023-12-19T16:14:56.178 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:56.175+0000 7ff59609b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T16:14:56.193 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.191+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d87e8a81-ed71-4e9d-9a48-80b04bc91626", "id": 0} v 0) v1 -- 0x7f465c04e000 con 0x7f465c0cf170 2023-12-19T16:14:56.200 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f464affd640 1 -- 172.21.15.143:0/3494416953 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d87e8a81-ed71-4e9d-9a48-80b04bc91626", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46500b37e0 con 0x7f465c0cf170 2023-12-19T16:14:56.200 INFO:teuthology.orchestra.run.smithi143.stdout:0 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 msgr2=0x7f465c0b7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 0x7f465c0b7c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f465001a0c0 tx=0x7f465001acd0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 shutdown_connections 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f465c0cf170 0x7f465c0b7c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f465c15cae0 0x7f465c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 --2- 172.21.15.143:0/3494416953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f465c0cde90 0x7f465c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 >> 172.21.15.143:0/3494416953 conn(0x7f465c089fb0 msgr2=0x7f465c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 shutdown_connections 2023-12-19T16:14:56.202 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.199+0000 7f4660d25640 1 -- 172.21.15.143:0/3494416953 wait complete. 2023-12-19T16:14:56.207 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:56.201+0000 7f331fa2f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T16:14:56.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2 1 2023-12-19T16:14:56.359 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.355+0000 7f473208c640 1 Processor -- start 2023-12-19T16:14:56.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.355+0000 7f473208c640 1 -- start start 2023-12-19T16:14:56.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f473208c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 0x7f472c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f473208c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f472c0cde90 0x7f472c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.361 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f473208c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c15cec0 con 0x7f472c0cf170 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f473208c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c0d0530 con 0x7f472c0cde90 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f473208c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0d0810 con 0x7f472c15cae0 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f4723fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f472c0cde90 0x7f472c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f472b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 0x7f472c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f472b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 0x7f472c0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52154/0 (socket says 172.21.15.143:52154) 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f472b7fe640 1 -- 172.21.15.143:0/3232903002 learned_addr learned my addr 172.21.15.143:0/3232903002 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f4723fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f472c0cde90 0x7f472c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58592/0 (socket says 172.21.15.143:58592) 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f4723fff640 1 -- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 msgr2=0x7f472c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f4723fff640 1 --2- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 0x7f472c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.362 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f4723fff640 1 -- 172.21.15.143:0/3232903002 >> v1:172.21.15.119:6789/0 conn(0x7f472c0cf170 legacy=0x7f472c06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f4723fff640 1 -- 172.21.15.143:0/3232903002 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0d0af0 con 0x7f472c0cde90 2023-12-19T16:14:56.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f472affd640 1 -- 172.21.15.143:0/3232903002 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807191948 0 0) 0x7f472c15cec0 con 0x7f472c0cf170 2023-12-19T16:14:56.363 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.359+0000 7f472b7fe640 1 --2- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 0x7f472c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:56.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f4723fff640 1 --2- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c0cde90 0x7f472c0ce2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f47140097c0 tx=0x7f471401ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4986369aeebe6bd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f472affd640 1 -- 172.21.15.143:0/3232903002 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140ab670 con 0x7f472c0cde90 2023-12-19T16:14:56.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f472affd640 1 -- 172.21.15.143:0/3232903002 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47140ab7d0 con 0x7f472c0cde90 2023-12-19T16:14:56.364 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f472affd640 1 -- 172.21.15.143:0/3232903002 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140abb60 con 0x7f472c0cde90 2023-12-19T16:14:56.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 -- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c0cde90 msgr2=0x7f472c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.365 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 --2- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c0cde90 0x7f472c0ce2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f47140097c0 tx=0x7f471401ceb0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 -- 172.21.15.143:0/3232903002 shutdown_connections 2023-12-19T16:14:56.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 --2- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c0cde90 0x7f472c0ce2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 --2- 172.21.15.143:0/3232903002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c15cae0 0x7f472c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 -- 172.21.15.143:0/3232903002 >> 172.21.15.143:0/3232903002 conn(0x7f472c089fb0 msgr2=0x7f472c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 -- 172.21.15.143:0/3232903002 shutdown_connections 2023-12-19T16:14:56.366 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 -- 172.21.15.143:0/3232903002 wait complete. 2023-12-19T16:14:56.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 Processor -- start 2023-12-19T16:14:56.367 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.363+0000 7f473208c640 1 -- start start 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 0x7f472c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f472c0cf170 0x7f472c0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c15cae0 0x7f472c0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c157270 con 0x7f472c0cf170 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c157c50 con 0x7f472c15cae0 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c1563a0 con 0x7f472c0cde90 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 0x7f472c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 0x7f472c155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52170/0 (socket says 172.21.15.143:52170) 2023-12-19T16:14:56.369 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 -- 172.21.15.143:0/2447791214 learned_addr learned my addr 172.21.15.143:0/2447791214 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472bfff640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c15cae0 0x7f472c0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f4723fff640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f472c0cf170 0x7f472c0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 -- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c15cae0 msgr2=0x7f472c0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c15cae0 0x7f472c0af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 -- 172.21.15.143:0/2447791214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f472c0cf170 msgr2=0x7f472c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f472c0cf170 0x7f472c0b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 -- 172.21.15.143:0/2447791214 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009480 con 0x7f472c0cde90 2023-12-19T16:14:56.370 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f472b7fe640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 0x7f472c155b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f471c00e980 tx=0x7f471c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0059a0 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c005b00 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4714009420 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c005e90 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c1568d0 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f471c00cca0 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f471c0138b0 con 0x7f472c0cde90 2023-12-19T16:14:56.371 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.367+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c1573b0 con 0x7f472c0cde90 2023-12-19T16:14:56.373 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.371+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f471c03ab40 con 0x7f472c0cde90 2023-12-19T16:14:56.397 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:56.395+0000 7ff59609b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T16:14:56.410 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:56.405+0000 7f331fa2f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T16:14:56.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.439+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2", "id": 1} v 0) v1 -- 0x7f472c04e000 con 0x7f472c0cde90 2023-12-19T16:14:56.448 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f4728ff9640 1 -- 172.21.15.143:0/2447791214 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f471c029030 con 0x7f472c0cde90 2023-12-19T16:14:56.448 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-19T16:14:56.449 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 msgr2=0x7f472c155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 0x7f472c155b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f471c00e980 tx=0x7f471c00ee40 comp rx=0 tx=0).stop 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 shutdown_connections 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f472c15cae0 0x7f472c0af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f472c0cf170 0x7f472c0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 --2- 172.21.15.143:0/2447791214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f472c0cde90 0x7f472c155b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 >> 172.21.15.143:0/2447791214 conn(0x7f472c089fb0 msgr2=0x7f472c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 shutdown_connections 2023-12-19T16:14:56.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.447+0000 7f473208c640 1 -- 172.21.15.143:0/2447791214 wait complete. 2023-12-19T16:14:56.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new d56244f0-e0cb-4f13-bad9-e390d0b1c1a9 2 2023-12-19T16:14:56.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 Processor -- start 2023-12-19T16:14:56.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 -- start start 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 0x7fec540ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fec540cf170 0x7fec540cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5415cec0 con 0x7fec5415cae0 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec540cfb40 con 0x7fec540cf170 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec58d7b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec540d0530 con 0x7fec540cde90 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec51d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 0x7fec540ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec52d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fec540cf170 0x7fec540cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec51d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 0x7fec540ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52182/0 (socket says 172.21.15.143:52182) 2023-12-19T16:14:56.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec51d9b640 1 -- 172.21.15.143:0/1713394046 learned_addr learned my addr 172.21.15.143:0/1713394046 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec52d9d640 1 -- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 msgr2=0x7fec540ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:56.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec52d9d640 1 --2- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 0x7fec540ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec52d9d640 1 -- 172.21.15.143:0/1713394046 >> v1:172.21.15.119:6789/0 conn(0x7fec5415cae0 legacy=0x7fec540d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec52d9d640 1 -- 172.21.15.143:0/1713394046 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540d0810 con 0x7fec540cf170 2023-12-19T16:14:56.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.603+0000 7fec51d9b640 1 --2- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 0x7fec540ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:56.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec52d9d640 1 --2- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cf170 0x7fec540cf600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009d90 tx=0x7fec4c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=459ad66f5a7e1714 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec5159a640 1 -- 172.21.15.143:0/1713394046 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0a59e0 con 0x7fec540cf170 2023-12-19T16:14:56.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec5159a640 1 -- 172.21.15.143:0/1713394046 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c0a5b40 con 0x7fec540cf170 2023-12-19T16:14:56.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec5159a640 1 -- 172.21.15.143:0/1713394046 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0ad440 con 0x7fec540cf170 2023-12-19T16:14:56.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 -- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cf170 msgr2=0x7fec540cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 --2- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cf170 0x7fec540cf600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009d90 tx=0x7fec4c01c920 comp rx=0 tx=0).stop 2023-12-19T16:14:56.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 -- 172.21.15.143:0/1713394046 shutdown_connections 2023-12-19T16:14:56.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 --2- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec540cde90 0x7fec540ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 --2- 172.21.15.143:0/1713394046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cf170 0x7fec540cf600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 -- 172.21.15.143:0/1713394046 >> 172.21.15.143:0/1713394046 conn(0x7fec54089fb0 msgr2=0x7fec540d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.607+0000 7fec58d7b640 1 -- 172.21.15.143:0/1713394046 shutdown_connections 2023-12-19T16:14:56.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 -- 172.21.15.143:0/1713394046 wait complete. 2023-12-19T16:14:56.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 Processor -- start 2023-12-19T16:14:56.613 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 -- start start 2023-12-19T16:14:56.614 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 0x7fec54155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec540cf170 0x7fec540b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec5415cae0 0x7fec54153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54155cc0 con 0x7fec540cf170 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540afd80 con 0x7fec540cde90 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec58d7b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec540b0d10 con 0x7fec5415cae0 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec52d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec5415cae0 0x7fec54153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec5259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 0x7fec54155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec5259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 0x7fec54155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58606/0 (socket says 172.21.15.143:58606) 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec5259c640 1 -- 172.21.15.143:0/3572706137 learned_addr learned my addr 172.21.15.143:0/3572706137 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.615 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec51d9b640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec540cf170 0x7fec540b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec52d9d640 1 -- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 msgr2=0x7fec54155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec52d9d640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 0x7fec54155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec52d9d640 1 -- 172.21.15.143:0/3572706137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec540cf170 msgr2=0x7fec540b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.616 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec52d9d640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec540cf170 0x7fec540b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec52d9d640 1 -- 172.21.15.143:0/3572706137 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec480094d0 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.611+0000 7fec5259c640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 0x7fec54155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec52d9d640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec5415cae0 0x7fec54153bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0ac000 tx=0x7fec4c0196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c009450 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c0adb00 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0ade90 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c009a70 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec540cc540 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec4c0b9750 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fec4c0c26e0 con 0x7fec5415cae0 2023-12-19T16:14:56.617 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec540cc730 con 0x7fec5415cae0 2023-12-19T16:14:56.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.615+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fec4c0bd030 con 0x7fec5415cae0 2023-12-19T16:14:56.688 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.687+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d56244f0-e0cb-4f13-bad9-e390d0b1c1a9", "id": 2} v 0) v1 -- 0x7fec5404e000 con 0x7fec5415cae0 2023-12-19T16:14:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec42ffd640 1 -- 172.21.15.143:0/3572706137 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d56244f0-e0cb-4f13-bad9-e390d0b1c1a9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec4c0b2070 con 0x7fec5415cae0 2023-12-19T16:14:56.696 INFO:teuthology.orchestra.run.smithi143.stdout:2 2023-12-19T16:14:56.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec5415cae0 msgr2=0x7fec54153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec5415cae0 0x7fec54153bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0ac000 tx=0x7fec4c0196c0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 shutdown_connections 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec5415cae0 0x7fec54153bf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec540cf170 0x7fec540b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 --2- 172.21.15.143:0/3572706137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec540cde90 0x7fec54155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 >> 172.21.15.143:0/3572706137 conn(0x7fec54089fb0 msgr2=0x7fec540b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 shutdown_connections 2023-12-19T16:14:56.699 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.695+0000 7fec58d7b640 1 -- 172.21.15.143:0/3572706137 wait complete. 2023-12-19T16:14:56.716 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 913f0775-152d-4ba8-99f8-b70d1f1a517f 3 2023-12-19T16:14:56.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 Processor -- start 2023-12-19T16:14:56.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 -- start start 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc8a415cae0 0x7fc8a40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8a40cf170 0x7fc8a40cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a40cfb40 con 0x7fc8a415cae0 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a415cec0 con 0x7fc8a40cf170 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8ac0f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40d0530 con 0x7fc8a40cde90 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8a9694640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8aa696640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8a40cf170 0x7fc8a40cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8a9694640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52204/0 (socket says 172.21.15.143:52204) 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8aa696640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8a40cf170 0x7fc8a40cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58616/0 (socket says 172.21.15.143:58616) 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8aa696640 1 -- 172.21.15.143:0/2925570797 learned_addr learned my addr 172.21.15.143:0/2925570797 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.851+0000 7fc8a9e95640 1 --2- 172.21.15.143:0/2925570797 >> v2:172.21.15.119:3300/0 conn(0x7fc8a415cae0 0x7fc8a40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8aa696640 1 -- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 msgr2=0x7fc8a40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:56.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8aa696640 1 --2- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8aa696640 1 -- 172.21.15.143:0/2925570797 >> v2:172.21.15.119:3300/0 conn(0x7fc8a415cae0 msgr2=0x7fc8a40d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:56.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8aa696640 1 --2- 172.21.15.143:0/2925570797 >> v2:172.21.15.119:3300/0 conn(0x7fc8a415cae0 0x7fc8a40d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8aa696640 1 -- 172.21.15.143:0/2925570797 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40d0810 con 0x7fc8a40cf170 2023-12-19T16:14:56.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8a9694640 1 --2- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:56.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8aa696640 1 --2- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40cf600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4160520 tx=0x7fc89c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd622c669b1cac4a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8a8e93640 1 -- 172.21.15.143:0/2925570797 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0a5820 con 0x7fc8a40cf170 2023-12-19T16:14:56.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8a8e93640 1 -- 172.21.15.143:0/2925570797 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c0a5980 con 0x7fc8a40cf170 2023-12-19T16:14:56.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.855+0000 7fc8a8e93640 1 -- 172.21.15.143:0/2925570797 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0a5d10 con 0x7fc8a40cf170 2023-12-19T16:14:56.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 msgr2=0x7fc8a40cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40cf600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4160520 tx=0x7fc89c01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/2925570797 shutdown_connections 2023-12-19T16:14:56.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40cf600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.860 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/2925570797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/2925570797 >> v2:172.21.15.119:3300/0 conn(0x7fc8a415cae0 0x7fc8a40d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/2925570797 >> 172.21.15.143:0/2925570797 conn(0x7fc8a4089fb0 msgr2=0x7fc8a40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/2925570797 shutdown_connections 2023-12-19T16:14:56.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/2925570797 wait complete. 2023-12-19T16:14:56.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 Processor -- start 2023-12-19T16:14:56.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- start start 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415cae0 0x7fc8a4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40c8840 con 0x7fc8a415cae0 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a415d4e0 con 0x7fc8a40cf170 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8ac0f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40c8a70 con 0x7fc8a40cde90 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52212/0 (socket says 172.21.15.143:52212) 2023-12-19T16:14:56.864 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9694640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 -- 172.21.15.143:0/3541509484 learned_addr learned my addr 172.21.15.143:0/3541509484 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8aa696640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415cae0 0x7fc8a4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 -- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 msgr2=0x7fc8a40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 -- 172.21.15.143:0/3541509484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415cae0 msgr2=0x7fc8a4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415cae0 0x7fc8a4157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9e95640 1 -- 172.21.15.143:0/3541509484 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894009420 con 0x7fc8a40cde90 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8aa696640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415cae0 0x7fc8a4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.859+0000 7fc8a9694640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc8a9e95640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40c8e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000e9b0 tx=0x7fc8a000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0009670 con 0x7fc8a40cde90 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000c9a0 con 0x7fc8a40cde90 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000cd10 con 0x7fc8a40cde90 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c009b30 con 0x7fc8a40cde90 2023-12-19T16:14:56.865 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a40c76c0 con 0x7fc8a40cde90 2023-12-19T16:14:56.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc8a0013770 con 0x7fc8a40cde90 2023-12-19T16:14:56.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc8a001c450 con 0x7fc8a40cde90 2023-12-19T16:14:56.866 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.863+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a404e000 con 0x7fc8a40cde90 2023-12-19T16:14:56.867 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.867+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fc8a003bb40 con 0x7fc8a40cde90 2023-12-19T16:14:56.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.931+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "913f0775-152d-4ba8-99f8-b70d1f1a517f", "id": 3} v 0) v1 -- 0x7fc8a40d2bf0 con 0x7fc8a40cde90 2023-12-19T16:14:56.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc89a7fc640 1 -- 172.21.15.143:0/3541509484 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "913f0775-152d-4ba8-99f8-b70d1f1a517f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc8a002a070 con 0x7fc8a40cde90 2023-12-19T16:14:56.941 INFO:teuthology.orchestra.run.smithi143.stdout:3 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 msgr2=0x7fc8a40c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40c8e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000e9b0 tx=0x7fc8a000ee70 comp rx=0 tx=0).stop 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 shutdown_connections 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a40cf170 0x7fc8a40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415cae0 0x7fc8a4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 --2- 172.21.15.143:0/3541509484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a40cde90 0x7fc8a40c8e00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 >> 172.21.15.143:0/3541509484 conn(0x7fc8a4089fb0 msgr2=0x7fc8a40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 shutdown_connections 2023-12-19T16:14:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:56.939+0000 7fc8ac0f9640 1 -- 172.21.15.143:0/3541509484 wait complete. 2023-12-19T16:14:56.962 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 5430a9b1-c7ec-494b-9cb3-0fc27d85db07 4 2023-12-19T16:14:57.049 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.045+0000 7f331fa2f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T16:14:57.058 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.055+0000 7ff59609b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T16:14:57.100 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 Processor -- start 2023-12-19T16:14:57.101 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 -- start start 2023-12-19T16:14:57.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 0x7f67800d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f678015ca70 0x7f67800d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f67800b1320 0x7f67800cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800b1c20 con 0x7f678015ca70 2023-12-19T16:14:57.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800d15c0 con 0x7f67800b1320 2023-12-19T16:14:57.102 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6785a04640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800d17c0 con 0x7f678015c690 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 0x7f67800d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 0x7f67800d2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52224/0 (socket says 172.21.15.143:52224) 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 -- 172.21.15.143:0/605510038 learned_addr learned my addr 172.21.15.143:0/605510038 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677f7fe640 1 --2- 172.21.15.143:0/605510038 >> v2:172.21.15.143:3300/0 conn(0x7f67800b1320 0x7f67800cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f6777fff640 1 --2- 172.21.15.143:0/605510038 >> v2:172.21.15.119:3300/0 conn(0x7f678015ca70 0x7f67800d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 -- 172.21.15.143:0/605510038 >> v2:172.21.15.143:3300/0 conn(0x7f67800b1320 msgr2=0x7f67800cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 --2- 172.21.15.143:0/605510038 >> v2:172.21.15.143:3300/0 conn(0x7f67800b1320 0x7f67800cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 -- 172.21.15.143:0/605510038 >> v2:172.21.15.119:3300/0 conn(0x7f678015ca70 msgr2=0x7f67800d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 --2- 172.21.15.143:0/605510038 >> v2:172.21.15.119:3300/0 conn(0x7f678015ca70 0x7f67800d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.103 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.099+0000 7f677effd640 1 -- 172.21.15.143:0/605510038 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800d1cb0 con 0x7f678015c690 2023-12-19T16:14:57.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f677effd640 1 --2- 172.21.15.143:0/605510038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 0x7f67800d2a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f67800b12b0 tx=0x7f677001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc5997bc0a8e82db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f677e7fc640 1 -- 172.21.15.143:0/605510038 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700a89b0 con 0x7f678015c690 2023-12-19T16:14:57.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f677e7fc640 1 -- 172.21.15.143:0/605510038 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700a8b10 con 0x7f678015c690 2023-12-19T16:14:57.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f677e7fc640 1 -- 172.21.15.143:0/605510038 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700a8ea0 con 0x7f678015c690 2023-12-19T16:14:57.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 -- 172.21.15.143:0/605510038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 msgr2=0x7f67800d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 --2- 172.21.15.143:0/605510038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 0x7f67800d2a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f67800b12b0 tx=0x7f677001ecf0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 -- 172.21.15.143:0/605510038 shutdown_connections 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 --2- 172.21.15.143:0/605510038 >> v2:172.21.15.143:3300/0 conn(0x7f67800b1320 0x7f67800cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 --2- 172.21.15.143:0/605510038 >> v2:172.21.15.119:3300/0 conn(0x7f678015ca70 0x7f67800d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 --2- 172.21.15.143:0/605510038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678015c690 0x7f67800d2a70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 -- 172.21.15.143:0/605510038 >> 172.21.15.143:0/605510038 conn(0x7f67800717d0 msgr2=0x7f6780071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 -- 172.21.15.143:0/605510038 shutdown_connections 2023-12-19T16:14:57.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.103+0000 7f6785a04640 1 -- 172.21.15.143:0/605510038 wait complete. 2023-12-19T16:14:57.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 Processor -- start 2023-12-19T16:14:57.109 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 -- start start 2023-12-19T16:14:57.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67800b1320 0x7f6780158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 0x7f67800c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678015ca70 0x7f67801e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67801f2090 con 0x7f678015ca70 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c73f0 con 0x7f678015c690 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c76d0 con 0x7f67800b1320 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6777fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 0x7f67800c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67800b1320 0x7f6780158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6777fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 0x7f67800c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58628/0 (socket says 172.21.15.143:58628) 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6777fff640 1 -- 172.21.15.143:0/3815739790 learned_addr learned my addr 172.21.15.143:0/3815739790 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677f7fe640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678015ca70 0x7f67801e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 -- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 msgr2=0x7f67800c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 0x7f67800c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 -- 172.21.15.143:0/3815739790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678015ca70 msgr2=0x7f67801e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678015ca70 0x7f67801e64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 -- 172.21.15.143:0/3815739790 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700094d0 con 0x7f67800b1320 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6777fff640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 0x7f67800c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:57.111 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677effd640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67800b1320 0x7f6780158cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67700af000 tx=0x7f677001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.112 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.109+0000 7f331fa2f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700b0da0 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700bb460 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700bb810 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67800c79b0 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6780159200 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.107+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67700bbc70 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.111+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f67700c43f0 con 0x7f67800b1320 2023-12-19T16:14:57.113 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.111+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678004e000 con 0x7f67800b1320 2023-12-19T16:14:57.114 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.111+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f67700c0070 con 0x7f67800b1320 2023-12-19T16:14:57.124 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.123+0000 7ff59609b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T16:14:57.172 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.169+0000 7f331fa2f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T16:14:57.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.179+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5430a9b1-c7ec-494b-9cb3-0fc27d85db07", "id": 4} v 0) v1 -- 0x7f67800d02a0 con 0x7f67800b1320 2023-12-19T16:14:57.186 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.183+0000 7ff59609b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T16:14:57.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f677cff9640 1 -- 172.21.15.143:0/3815739790 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5430a9b1-c7ec-494b-9cb3-0fc27d85db07", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f67700b5070 con 0x7f67800b1320 2023-12-19T16:14:57.188 INFO:teuthology.orchestra.run.smithi143.stdout:4 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67800b1320 msgr2=0x7f6780158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67800b1320 0x7f6780158cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67700af000 tx=0x7f677001ba90 comp rx=0 tx=0).stop 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 shutdown_connections 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678015c690 0x7f67800c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678015ca70 0x7f67801e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 --2- 172.21.15.143:0/3815739790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67800b1320 0x7f6780158cc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 >> 172.21.15.143:0/3815739790 conn(0x7f67800717d0 msgr2=0x7f678015ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 shutdown_connections 2023-12-19T16:14:57.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.187+0000 7f6785a04640 1 -- 172.21.15.143:0/3815739790 wait complete. 2023-12-19T16:14:57.208 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 9556f02e-3b66-4f13-8a57-053dcd7dda7c 5 2023-12-19T16:14:57.262 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.257+0000 7f331fa2f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T16:14:57.279 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.275+0000 7ff59609b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T16:14:57.321 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.317+0000 7f331fa2f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T16:14:57.341 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.339+0000 7ff59609b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T16:14:57.345 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 Processor -- start 2023-12-19T16:14:57.346 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 -- start start 2023-12-19T16:14:57.347 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62e015cae0 0x7f62e00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cde90 0x7f62e00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f62e00cf170 0x7f62e00cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00cfb40 con 0x7f62e00cf170 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e015cec0 con 0x7f62e015cae0 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e6c12640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00d0530 con 0x7f62e00cde90 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e49ae640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62e015cae0 0x7f62e00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62dffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cde90 0x7f62e00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e49ae640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62e015cae0 0x7f62e00d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58638/0 (socket says 172.21.15.143:58638) 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.343+0000 7f62e49ae640 1 -- 172.21.15.143:0/3882689292 learned_addr learned my addr 172.21.15.143:0/3882689292 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62e51af640 1 --2- 172.21.15.143:0/3882689292 >> v2:172.21.15.119:3300/0 conn(0x7f62e00cf170 0x7f62e00cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62dffff640 1 -- 172.21.15.143:0/3882689292 >> v2:172.21.15.143:3300/0 conn(0x7f62e015cae0 msgr2=0x7f62e00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62dffff640 1 --2- 172.21.15.143:0/3882689292 >> v2:172.21.15.143:3300/0 conn(0x7f62e015cae0 0x7f62e00d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.348 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62dffff640 1 -- 172.21.15.143:0/3882689292 >> v2:172.21.15.119:3300/0 conn(0x7f62e00cf170 msgr2=0x7f62e00cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62dffff640 1 --2- 172.21.15.143:0/3882689292 >> v2:172.21.15.119:3300/0 conn(0x7f62e00cf170 0x7f62e00cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.349 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62dffff640 1 -- 172.21.15.143:0/3882689292 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00d0810 con 0x7f62e00cde90 2023-12-19T16:14:57.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62dffff640 1 --2- 172.21.15.143:0/3882689292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cde90 0x7f62e00ce2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62e006a520 tx=0x7f62cc01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679286476b1319a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62df7fe640 1 -- 172.21.15.143:0/3882689292 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc0ab5f0 con 0x7f62e00cde90 2023-12-19T16:14:57.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62df7fe640 1 -- 172.21.15.143:0/3882689292 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc0ab750 con 0x7f62e00cde90 2023-12-19T16:14:57.351 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.347+0000 7f62df7fe640 1 -- 172.21.15.143:0/3882689292 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc0abae0 con 0x7f62e00cde90 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- 172.21.15.143:0/3882689292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cde90 msgr2=0x7f62e00ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- 172.21.15.143:0/3882689292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cde90 0x7f62e00ce2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62e006a520 tx=0x7f62cc01c430 comp rx=0 tx=0).stop 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- 172.21.15.143:0/3882689292 shutdown_connections 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- 172.21.15.143:0/3882689292 >> v2:172.21.15.119:3300/0 conn(0x7f62e00cf170 0x7f62e00cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- 172.21.15.143:0/3882689292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cde90 0x7f62e00ce2f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- 172.21.15.143:0/3882689292 >> v2:172.21.15.143:3300/0 conn(0x7f62e015cae0 0x7f62e00d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- 172.21.15.143:0/3882689292 >> 172.21.15.143:0/3882689292 conn(0x7f62e0089fb0 msgr2=0x7f62e00d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- 172.21.15.143:0/3882689292 shutdown_connections 2023-12-19T16:14:57.352 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- 172.21.15.143:0/3882689292 wait complete. 2023-12-19T16:14:57.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 Processor -- start 2023-12-19T16:14:57.353 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- start start 2023-12-19T16:14:57.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e00cde90 0x7f62e015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 0x7f62e00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62e015cae0 0x7f62e00c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.355 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e015a900 con 0x7f62e00cde90 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c98b0 con 0x7f62e015cae0 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e6c12640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c9b70 con 0x7f62e00cf170 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62dffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 0x7f62e00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62dffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 0x7f62e00b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52240/0 (socket says 172.21.15.143:52240) 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62dffff640 1 -- 172.21.15.143:0/2079218614 learned_addr learned my addr 172.21.15.143:0/2079218614 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e51af640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62e015cae0 0x7f62e00c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e49ae640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e00cde90 0x7f62e015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e51af640 1 -- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 msgr2=0x7f62e00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e51af640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 0x7f62e00b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e51af640 1 -- 172.21.15.143:0/2079218614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e00cde90 msgr2=0x7f62e015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.351+0000 7f62e51af640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e00cde90 0x7f62e015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62e51af640 1 -- 172.21.15.143:0/2079218614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc009420 con 0x7f62e015cae0 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62dffff640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 0x7f62e00b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:57.356 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62e51af640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62e015cae0 0x7f62e00c7d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62d8007d40 tx=0x7f62d800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80039a0 con 0x7f62e015cae0 2023-12-19T16:14:57.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8003b20 con 0x7f62e015cae0 2023-12-19T16:14:57.357 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00c9e50 con 0x7f62e015cae0 2023-12-19T16:14:57.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8004030 con 0x7f62e015cae0 2023-12-19T16:14:57.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e00ca410 con 0x7f62e015cae0 2023-12-19T16:14:57.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62d8004490 con 0x7f62e015cae0 2023-12-19T16:14:57.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f62d8004740 con 0x7f62e015cae0 2023-12-19T16:14:57.358 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.355+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e00ca600 con 0x7f62e015cae0 2023-12-19T16:14:57.360 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.359+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f62d8019070 con 0x7f62e015cae0 2023-12-19T16:14:57.412 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.409+0000 7f331fa2f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T16:14:57.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.427+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9556f02e-3b66-4f13-8a57-053dcd7dda7c", "id": 5} v 0) v1 -- 0x7f62e004e000 con 0x7f62e015cae0 2023-12-19T16:14:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62dd7fa640 1 -- 172.21.15.143:0/2079218614 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9556f02e-3b66-4f13-8a57-053dcd7dda7c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62d801e440 con 0x7f62e015cae0 2023-12-19T16:14:57.434 INFO:teuthology.orchestra.run.smithi143.stdout:5 2023-12-19T16:14:57.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62e015cae0 msgr2=0x7f62e00c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.435 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62e015cae0 0x7f62e00c7d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62d8007d40 tx=0x7f62d800e4b0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 shutdown_connections 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62e015cae0 0x7f62e00c7d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62e00cf170 0x7f62e00b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 --2- 172.21.15.143:0/2079218614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e00cde90 0x7f62e015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 >> 172.21.15.143:0/2079218614 conn(0x7f62e0089fb0 msgr2=0x7f62e015f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 shutdown_connections 2023-12-19T16:14:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.431+0000 7f62e6c12640 1 -- 172.21.15.143:0/2079218614 wait complete. 2023-12-19T16:14:57.438 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.435+0000 7ff59609b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T16:14:57.460 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 9b549fb1-77f3-4d4c-983e-581ded595cd7 6 2023-12-19T16:14:57.472 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.469+0000 7f331fa2f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T16:14:57.508 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.507+0000 7ff59609b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T16:14:57.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 Processor -- start 2023-12-19T16:14:57.598 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 -- start start 2023-12-19T16:14:57.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feca4070820 0x7feca40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 0x7feca40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.600 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40c9390 con 0x7feca41582d0 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca40ced80 con 0x7feca4070820 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca9125640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca415aee0 con 0x7feca40ce3b0 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.595+0000 7feca359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 0x7feca40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 0x7feca40ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52246/0 (socket says 172.21.15.143:52246) 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 -- 172.21.15.143:0/4130839559 learned_addr learned my addr 172.21.15.143:0/4130839559 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca259c640 1 --2- 172.21.15.143:0/4130839559 >> v2:172.21.15.119:3300/0 conn(0x7feca4070820 0x7feca40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 -- 172.21.15.143:0/4130839559 >> v2:172.21.15.119:3300/0 conn(0x7feca4070820 msgr2=0x7feca40c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.601 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 --2- 172.21.15.143:0/4130839559 >> v2:172.21.15.119:3300/0 conn(0x7feca4070820 0x7feca40c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 -- 172.21.15.143:0/4130839559 >> v1:172.21.15.119:6789/0 conn(0x7feca41582d0 legacy=0x7feca40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.602 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 -- 172.21.15.143:0/4130839559 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca415b1c0 con 0x7feca40ce3b0 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca359e640 1 --2- 172.21.15.143:0/4130839559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 0x7feca40ce840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009e50 tx=0x7fec9c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d252362cddb04f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca1d9b640 1 -- 172.21.15.143:0/4130839559 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0a58a0 con 0x7feca40ce3b0 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca1d9b640 1 -- 172.21.15.143:0/4130839559 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0a5a00 con 0x7feca40ce3b0 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.599+0000 7feca1d9b640 1 -- 172.21.15.143:0/4130839559 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0a5d90 con 0x7feca40ce3b0 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- 172.21.15.143:0/4130839559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 msgr2=0x7feca40ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 --2- 172.21.15.143:0/4130839559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 0x7feca40ce840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009e50 tx=0x7fec9c01c9e0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- 172.21.15.143:0/4130839559 shutdown_connections 2023-12-19T16:14:57.604 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 --2- 172.21.15.143:0/4130839559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca40ce3b0 0x7feca40ce840 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 --2- 172.21.15.143:0/4130839559 >> v2:172.21.15.119:3300/0 conn(0x7feca4070820 0x7feca40c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- 172.21.15.143:0/4130839559 >> 172.21.15.143:0/4130839559 conn(0x7feca406a2a0 msgr2=0x7feca40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- 172.21.15.143:0/4130839559 shutdown_connections 2023-12-19T16:14:57.605 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- 172.21.15.143:0/4130839559 wait complete. 2023-12-19T16:14:57.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 Processor -- start 2023-12-19T16:14:57.606 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- start start 2023-12-19T16:14:57.607 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feca4070820 0x7feca41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca40ce3b0 0x7feca40c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 0x7feca415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca415d600 con 0x7feca40ce3b0 2023-12-19T16:14:57.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca4158850 con 0x7feca4070820 2023-12-19T16:14:57.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca9125640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca4158b30 con 0x7feca41582d0 2023-12-19T16:14:57.608 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 0x7feca415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca40ce3b0 0x7feca40c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 0x7feca415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52248/0 (socket says 172.21.15.143:52248) 2023-12-19T16:14:57.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca359e640 1 -- 172.21.15.143:0/3489546505 learned_addr learned my addr 172.21.15.143:0/3489546505 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.603+0000 7feca2d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feca4070820 0x7feca41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca259c640 1 -- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 msgr2=0x7feca415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.609 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca259c640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 0x7feca415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca259c640 1 -- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feca4070820 msgr2=0x7feca41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca259c640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feca4070820 0x7feca41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca259c640 1 -- 172.21.15.143:0/3489546505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c009b30 con 0x7feca40ce3b0 2023-12-19T16:14:57.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca359e640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 0x7feca415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:57.610 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca259c640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca40ce3b0 0x7feca40c3300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec9800e870 tx=0x7fec9800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.611 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980095d0 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800c940 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800ccb0 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca4158e10 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca41f92c0 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec98005ca0 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fec98006890 con 0x7feca40ce3b0 2023-12-19T16:14:57.612 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.607+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca404e000 con 0x7feca40ce3b0 2023-12-19T16:14:57.619 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.619+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fec98021060 con 0x7feca40ce3b0 2023-12-19T16:14:57.628 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.625+0000 7f331fa2f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T16:14:57.670 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.667+0000 7ff59609b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T16:14:57.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.683+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b549fb1-77f3-4d4c-983e-581ded595cd7", "id": 6} v 0) v1 -- 0x7feca40b0c00 con 0x7feca40ce3b0 2023-12-19T16:14:57.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7fec8b7fe640 1 -- 172.21.15.143:0/3489546505 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b549fb1-77f3-4d4c-983e-581ded595cd7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec98017070 con 0x7feca40ce3b0 2023-12-19T16:14:57.690 INFO:teuthology.orchestra.run.smithi143.stdout:6 2023-12-19T16:14:57.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca40ce3b0 msgr2=0x7feca40c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca40ce3b0 0x7feca40c3300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec9800e870 tx=0x7fec9800ed30 comp rx=0 tx=0).stop 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 shutdown_connections 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feca41582d0 0x7feca415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feca40ce3b0 0x7feca40c3300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 --2- 172.21.15.143:0/3489546505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feca4070820 0x7feca41537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 >> 172.21.15.143:0/3489546505 conn(0x7feca406a2a0 msgr2=0x7feca40aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 shutdown_connections 2023-12-19T16:14:57.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.687+0000 7feca9125640 1 -- 172.21.15.143:0/3489546505 wait complete. 2023-12-19T16:14:57.698 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:57.693+0000 7f331fa2f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T16:14:57.710 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 5f43eba7-83f0-47d5-b3bd-1500df1ffdfb 7 2023-12-19T16:14:57.744 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:57.743+0000 7ff59609b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T16:14:57.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 Processor -- start 2023-12-19T16:14:57.849 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 -- start start 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 0x7f9e840d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e840ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9e840cf170 0x7f9e840cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840cfb40 con 0x7f9e840cf170 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8415cec0 con 0x7f9e8415cae0 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e89df0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840d0530 con 0x7f9e840cde90 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 0x7f9e840d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e840ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e837fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 0x7f9e840d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58674/0 (socket says 172.21.15.143:58674) 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e840ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52260/0 (socket says 172.21.15.143:52260) 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e837fe640 1 -- 172.21.15.143:0/1159199665 learned_addr learned my addr 172.21.15.143:0/1159199665 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.851 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e83fff640 1 --2- 172.21.15.143:0/1159199665 >> v2:172.21.15.119:3300/0 conn(0x7f9e840cf170 0x7f9e840cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 -- 172.21.15.143:0/1159199665 >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 msgr2=0x7f9e840d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 --2- 172.21.15.143:0/1159199665 >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 0x7f9e840d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 -- 172.21.15.143:0/1159199665 >> v2:172.21.15.119:3300/0 conn(0x7f9e840cf170 msgr2=0x7f9e840cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:57.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 --2- 172.21.15.143:0/1159199665 >> v2:172.21.15.119:3300/0 conn(0x7f9e840cf170 0x7f9e840cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e82ffd640 1 -- 172.21.15.143:0/1159199665 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840d0810 con 0x7f9e840cde90 2023-12-19T16:14:57.852 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.847+0000 7f9e837fe640 1 --2- 172.21.15.143:0/1159199665 >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 0x7f9e840d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:57.853 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e82ffd640 1 --2- 172.21.15.143:0/1159199665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e840ce2f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9e8406a520 tx=0x7f9e7801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef0ea4519886bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e827fc640 1 -- 172.21.15.143:0/1159199665 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780ab5f0 con 0x7f9e840cde90 2023-12-19T16:14:57.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e827fc640 1 -- 172.21.15.143:0/1159199665 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780ab750 con 0x7f9e840cde90 2023-12-19T16:14:57.854 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e827fc640 1 -- 172.21.15.143:0/1159199665 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780abae0 con 0x7f9e840cde90 2023-12-19T16:14:57.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 -- 172.21.15.143:0/1159199665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 msgr2=0x7f9e840ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 --2- 172.21.15.143:0/1159199665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e840ce2f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9e8406a520 tx=0x7f9e7801c430 comp rx=0 tx=0).stop 2023-12-19T16:14:57.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 -- 172.21.15.143:0/1159199665 shutdown_connections 2023-12-19T16:14:57.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 --2- 172.21.15.143:0/1159199665 >> v2:172.21.15.119:3300/0 conn(0x7f9e840cf170 0x7f9e840cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 --2- 172.21.15.143:0/1159199665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e840ce2f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.855 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 --2- 172.21.15.143:0/1159199665 >> v2:172.21.15.143:3300/0 conn(0x7f9e8415cae0 0x7f9e840d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 -- 172.21.15.143:0/1159199665 >> 172.21.15.143:0/1159199665 conn(0x7f9e84089fb0 msgr2=0x7f9e840d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 -- 172.21.15.143:0/1159199665 shutdown_connections 2023-12-19T16:14:57.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.851+0000 7f9e89df0640 1 -- 172.21.15.143:0/1159199665 wait complete. 2023-12-19T16:14:57.856 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 Processor -- start 2023-12-19T16:14:57.857 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 -- start start 2023-12-19T16:14:57.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e84155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e840cf170 0x7f9e840ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.858 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e8415cae0 0x7f9e8415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84156040 con 0x7f9e8415cae0 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8415e640 con 0x7f9e840cf170 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840c7d10 con 0x7f9e840cde90 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e84155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e84155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:52274/0 (socket says 172.21.15.143:52274) 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 -- 172.21.15.143:0/2709687681 learned_addr learned my addr 172.21.15.143:0/2709687681 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e82ffd640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e840cf170 0x7f9e840ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e83fff640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e8415cae0 0x7f9e8415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 -- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e840cf170 msgr2=0x7f9e840ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e840cf170 0x7f9e840ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 -- 172.21.15.143:0/2709687681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e8415cae0 msgr2=0x7f9e8415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e8415cae0 0x7f9e8415dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 -- 172.21.15.143:0/2709687681 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009480 con 0x7f9e840cde90 2023-12-19T16:14:57.859 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e82ffd640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e840cf170 0x7f9e840ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e837fe640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e84155b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400e980 tx=0x7f9e7400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740059a0 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74005b00 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74005e90 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.855+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e78009420 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.859+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e840c82d0 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.859+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9e7400cca0 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.859+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9e74013620 con 0x7f9e840cde90 2023-12-19T16:14:57.861 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.859+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8404e000 con 0x7f9e840cde90 2023-12-19T16:14:57.862 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.859+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f9e74020060 con 0x7f9e840cde90 2023-12-19T16:14:57.928 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.927+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f43eba7-83f0-47d5-b3bd-1500df1ffdfb", "id": 7} v 0) v1 -- 0x7f9e840cff40 con 0x7f9e840cde90 2023-12-19T16:14:57.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e6bfff640 1 -- 172.21.15.143:0/2709687681 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f43eba7-83f0-47d5-b3bd-1500df1ffdfb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9e74006030 con 0x7f9e840cde90 2023-12-19T16:14:57.933 INFO:teuthology.orchestra.run.smithi143.stdout:7 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 msgr2=0x7f9e84155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e84155b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400e980 tx=0x7f9e7400ee40 comp rx=0 tx=0).stop 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 shutdown_connections 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e840cf170 0x7f9e840ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e8415cae0 0x7f9e8415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 --2- 172.21.15.143:0/2709687681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e840cde90 0x7f9e84155b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 >> 172.21.15.143:0/2709687681 conn(0x7f9e84089fb0 msgr2=0x7f9e840b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 shutdown_connections 2023-12-19T16:14:57.934 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-19T16:14:57.931+0000 7f9e89df0640 1 -- 172.21.15.143:0/2709687681 wait complete. 2023-12-19T16:14:57.952 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T16:14:57.953 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T16:14:57.958 INFO:tasks.ceph.osd.0:Started 2023-12-19T16:14:57.958 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T16:14:57.959 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T16:14:57.962 INFO:tasks.ceph.osd.1:Started 2023-12-19T16:14:57.962 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T16:14:57.962 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T16:14:57.965 INFO:tasks.ceph.osd.2:Started 2023-12-19T16:14:57.965 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T16:14:57.965 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T16:14:57.969 INFO:tasks.ceph.osd.3:Started 2023-12-19T16:14:57.969 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T16:14:57.970 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T16:14:57.999 INFO:tasks.ceph.osd.4:Started 2023-12-19T16:14:57.999 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T16:14:57.999 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T16:14:58.003 INFO:tasks.ceph.osd.5:Started 2023-12-19T16:14:58.003 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T16:14:58.004 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T16:14:58.007 INFO:tasks.ceph.osd.6:Started 2023-12-19T16:14:58.008 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T16:14:58.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T16:14:58.013 INFO:tasks.ceph.osd.7:Started 2023-12-19T16:14:58.014 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:14:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.217+0000 7f139a77b640 1 Processor -- start 2023-12-19T16:14:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.217+0000 7f139a77b640 1 -- start start 2023-12-19T16:14:58.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f139a77b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ae040 0x7f139406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f139a77b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13940ce460 0x7f13940c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f139a77b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13940cccf0 con 0x7f139406d170 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f139a77b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13940ae420 con 0x7f13940ce460 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f139a77b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13940ccf90 con 0x7f13940ae040 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13940ce460 0x7f13940c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13940ce460 0x7f13940c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44424/0 (socket says 172.21.15.119:44424) 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 -- 172.21.15.119:0/3668249342 learned_addr learned my addr 172.21.15.119:0/3668249342 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1393fff640 1 --2- 172.21.15.119:0/3668249342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ae040 0x7f139406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 -- 172.21.15.119:0/3668249342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ae040 msgr2=0x7f139406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 --2- 172.21.15.119:0/3668249342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ae040 0x7f139406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 -- 172.21.15.119:0/3668249342 >> v1:172.21.15.143:6789/0 conn(0x7f139406d170 legacy=0x7f13940cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1398d18640 1 -- 172.21.15.119:0/3668249342 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940cd270 con 0x7f13940ce460 2023-12-19T16:14:58.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.221+0000 7f1392ffd640 1 -- 172.21.15.119:0/3668249342 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176545106 0 0) 0x7f13940cccf0 con 0x7f139406d170 2023-12-19T16:14:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f1398d18640 1 --2- 172.21.15.119:0/3668249342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ce460 0x7f13940c9920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f138c009e50 tx=0x7f138c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f6767165dd6615 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f1392ffd640 1 -- 172.21.15.119:0/3668249342 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0a57c0 con 0x7f13940ce460 2023-12-19T16:14:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f1392ffd640 1 -- 172.21.15.119:0/3668249342 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0a5920 con 0x7f13940ce460 2023-12-19T16:14:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f1392ffd640 1 -- 172.21.15.119:0/3668249342 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0a5cb0 con 0x7f13940ce460 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 -- 172.21.15.119:0/3668249342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ce460 msgr2=0x7f13940c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 --2- 172.21.15.119:0/3668249342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ce460 0x7f13940c9920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f138c009e50 tx=0x7f138c01c9e0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 -- 172.21.15.119:0/3668249342 shutdown_connections 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 --2- 172.21.15.119:0/3668249342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ce460 0x7f13940c9920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 --2- 172.21.15.119:0/3668249342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ae040 0x7f139406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 -- 172.21.15.119:0/3668249342 >> 172.21.15.119:0/3668249342 conn(0x7f13940cb610 msgr2=0x7f13940cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 -- 172.21.15.119:0/3668249342 shutdown_connections 2023-12-19T16:14:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 -- 172.21.15.119:0/3668249342 wait complete. 2023-12-19T16:14:58.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 Processor -- start 2023-12-19T16:14:58.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.225+0000 7f139a77b640 1 -- start start 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139406d170 0x7f13940b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 0x7f13940c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ce460 0x7f13941536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139415a570 con 0x7f13940ae040 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940b1cf0 con 0x7f139406d170 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1394159f40 con 0x7f13940ce460 2023-12-19T16:14:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 0x7f13940c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 0x7f13940c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44436/0 (socket says 172.21.15.119:44436) 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 -- 172.21.15.119:0/309493099 learned_addr learned my addr 172.21.15.119:0/309493099 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1393fff640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139406d170 0x7f13940b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1398d18640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ce460 0x7f13941536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 -- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ce460 msgr2=0x7f13941536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ce460 0x7f13941536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 -- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139406d170 msgr2=0x7f13940b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:58.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139406d170 0x7f13940b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 -- 172.21.15.119:0/309493099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009b30 con 0x7f13940ae040 2023-12-19T16:14:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f13937fe640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 0x7f13940c4d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f138800c450 tx=0x7f138800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388005480 con 0x7f13940ae040 2023-12-19T16:14:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388003600 con 0x7f13940ae040 2023-12-19T16:14:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13940b4530 con 0x7f13940ae040 2023-12-19T16:14:58.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880039b0 con 0x7f13940ae040 2023-12-19T16:14:58.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139415a200 con 0x7f13940ae040 2023-12-19T16:14:58.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f138801c440 con 0x7f13940ae040 2023-12-19T16:14:58.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1388012ad0 con 0x7f13940ae040 2023-12-19T16:14:58.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.229+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139415a720 con 0x7f13940ae040 2023-12-19T16:14:58.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.233+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f139415a720 con 0x7f13940ae040 2023-12-19T16:14:58.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13940b42c0 con 0x7f13940ae040 2023-12-19T16:14:58.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f1390ff9640 1 -- 172.21.15.119:0/309493099 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1388017070 con 0x7f13940ae040 2023-12-19T16:14:58.294 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:14:58.294 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":10,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:14:57.930518+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:14:58.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 msgr2=0x7f13940c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:58.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 0x7f13940c4d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f138800c450 tx=0x7f138800c910 comp rx=0 tx=0).stop 2023-12-19T16:14:58.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 shutdown_connections 2023-12-19T16:14:58.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13940ce460 0x7f13941536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13940ae040 0x7f13940c4d90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 --2- 172.21.15.119:0/309493099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139406d170 0x7f13940b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:58.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 >> 172.21.15.119:0/309493099 conn(0x7f13940cb610 msgr2=0x7f13940c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:58.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 shutdown_connections 2023-12-19T16:14:58.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:14:58.289+0000 7f139a77b640 1 -- 172.21.15.119:0/309493099 wait complete. 2023-12-19T16:14:58.313 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T16:14:58.313 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T16:14:58.413 INFO:tasks.ceph.mgr.y.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-19T16:14:58.413 INFO:tasks.ceph.mgr.y.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-19T16:14:58.413 INFO:tasks.ceph.mgr.y.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-12-19T16:14:58.461 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:58.457+0000 7f331fa2f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T16:14:58.499 INFO:tasks.ceph.mgr.x.smithi143.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-19T16:14:58.499 INFO:tasks.ceph.mgr.x.smithi143.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-19T16:14:58.499 INFO:tasks.ceph.mgr.x.smithi143.stderr: from numpy import show_config as show_numpy_config 2023-12-19T16:14:58.546 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:58.543+0000 7ff59609b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T16:14:58.596 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:58.589+0000 7f331fa2f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:14:58.637 INFO:tasks.ceph.osd.0.smithi119.stderr:2023-12-19T16:14:58.633+0000 7fb77ddb6640 -1 Falling back to public interface 2023-12-19T16:14:58.656 INFO:tasks.ceph.osd.1.smithi119.stderr:2023-12-19T16:14:58.653+0000 7fa442996640 -1 Falling back to public interface 2023-12-19T16:14:58.681 INFO:tasks.ceph.osd.2.smithi119.stderr:2023-12-19T16:14:58.677+0000 7f6b29872640 -1 Falling back to public interface 2023-12-19T16:14:58.681 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:58.679+0000 7ff59609b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:14:58.696 INFO:tasks.ceph.osd.3.smithi119.stderr:2023-12-19T16:14:58.693+0000 7fe8421b6640 -1 Falling back to public interface 2023-12-19T16:14:58.701 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-19T16:14:58.699+0000 7fdc68bb4640 -1 Falling back to public interface 2023-12-19T16:14:58.701 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-19T16:14:58.699+0000 7fd9418f2640 -1 Falling back to public interface 2023-12-19T16:14:58.702 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-19T16:14:58.699+0000 7f351302b640 -1 Falling back to public interface 2023-12-19T16:14:58.702 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-19T16:14:58.699+0000 7f35115cb640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2023-12-19T16:14:58.705 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-19T16:14:58.703+0000 7f6d7b96e640 -1 Falling back to public interface 2023-12-19T16:14:58.779 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:58.773+0000 7f331fa2f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T16:14:58.852 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:58.849+0000 7f331fa2f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T16:14:58.855 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:58.851+0000 7ff59609b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T16:14:58.928 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:58.927+0000 7ff59609b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T16:14:58.991 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:58.985+0000 7f331fa2f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:14:59.066 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:59.063+0000 7ff59609b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:14:59.120 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:14:59.250 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.241+0000 7f5e973ce640 1 Processor -- start 2023-12-19T16:14:59.250 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.241+0000 7f5e973ce640 1 -- start start 2023-12-19T16:14:59.250 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e973ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9015cdc0 0x7f5e900ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:59.250 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e973ce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900cd280 con 0x7f5e900b4180 2023-12-19T16:14:59.250 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e973ce640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900d3590 con 0x7f5e900d3020 2023-12-19T16:14:59.250 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e973ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900cd4b0 con 0x7f5e9015cdc0 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e9516a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5e900b4180 0x7f5e900b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60734/0 (socket says 172.21.15.119:60734) 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e9516a640 1 -- 172.21.15.119:0/2429538913 learned_addr learned my addr 172.21.15.119:0/2429538913 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e94969640 1 --2- 172.21.15.119:0/2429538913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9015cdc0 0x7f5e900ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e87fff640 1 -- 172.21.15.119:0/2429538913 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092804767 0 0) 0x7f5e900cd280 con 0x7f5e900b4180 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e87fff640 1 -- 172.21.15.119:0/2429538913 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e7c003530 con 0x7f5e900b4180 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e87fff640 1 -- 172.21.15.119:0/2429538913 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675864438 0 0) 0x7f5e900d3590 con 0x7f5e900d3020 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e94969640 1 -- 172.21.15.119:0/2429538913 >> v1:172.21.15.143:6789/0 conn(0x7f5e900d3020 legacy=0x7f5e9006ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e94969640 1 -- 172.21.15.119:0/2429538913 >> v1:172.21.15.119:6789/0 conn(0x7f5e900b4180 legacy=0x7f5e900b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:59.251 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.245+0000 7f5e94969640 1 -- 172.21.15.119:0/2429538913 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900cd790 con 0x7f5e9015cdc0 2023-12-19T16:14:59.252 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e94969640 1 --2- 172.21.15.119:0/2429538913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9015cdc0 0x7f5e900ce270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009820 tx=0x7f5e8001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532cc5a8f417f9c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:59.252 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e87fff640 1 -- 172.21.15.119:0/2429538913 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800ab600 con 0x7f5e9015cdc0 2023-12-19T16:14:59.253 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e87fff640 1 -- 172.21.15.119:0/2429538913 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e800a7050 con 0x7f5e9015cdc0 2023-12-19T16:14:59.253 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e87fff640 1 -- 172.21.15.119:0/2429538913 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800ab980 con 0x7f5e9015cdc0 2023-12-19T16:14:59.253 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 -- 172.21.15.119:0/2429538913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9015cdc0 msgr2=0x7f5e900ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:59.253 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 --2- 172.21.15.119:0/2429538913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9015cdc0 0x7f5e900ce270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009820 tx=0x7f5e8001c3e0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.254 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 -- 172.21.15.119:0/2429538913 shutdown_connections 2023-12-19T16:14:59.254 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 --2- 172.21.15.119:0/2429538913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9015cdc0 0x7f5e900ce270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.254 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 -- 172.21.15.119:0/2429538913 >> 172.21.15.119:0/2429538913 conn(0x7f5e9009ba30 msgr2=0x7f5e900d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:59.254 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 -- 172.21.15.119:0/2429538913 shutdown_connections 2023-12-19T16:14:59.254 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 -- 172.21.15.119:0/2429538913 wait complete. 2023-12-19T16:14:59.255 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 Processor -- start 2023-12-19T16:14:59.255 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.249+0000 7f5e973ce640 1 -- start start 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e900b4180 0x7f5e90160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e900d3020 0x7f5e90152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9015cdc0 0x7f5e9015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90153260 con 0x7f5e9015cdc0 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90157b60 con 0x7f5e900d3020 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900b5320 con 0x7f5e900b4180 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9596b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9015cdc0 0x7f5e9015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e94969640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e900d3020 0x7f5e90152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e900b4180 0x7f5e90160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9596b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9015cdc0 0x7f5e9015d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44442/0 (socket says 172.21.15.119:44442) 2023-12-19T16:14:59.257 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9596b640 1 -- 172.21.15.119:0/3932208481 learned_addr learned my addr 172.21.15.119:0/3932208481 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 -- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e900d3020 msgr2=0x7f5e90152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e900d3020 0x7f5e90152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 -- 172.21.15.119:0/3932208481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9015cdc0 msgr2=0x7f5e9015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9015cdc0 0x7f5e9015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 -- 172.21.15.119:0/3932208481 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80009420 con 0x7f5e900b4180 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e9516a640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e900b4180 0x7f5e90160030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c390 tx=0x7f5e8c001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c005cf0 con 0x7f5e900b4180 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c005e50 con 0x7f5e900b4180 2023-12-19T16:14:59.259 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0072f0 con 0x7f5e900b4180 2023-12-19T16:14:59.260 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e901575a0 con 0x7f5e900b4180 2023-12-19T16:14:59.260 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e8c012400 con 0x7f5e900b4180 2023-12-19T16:14:59.260 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e900b5570 con 0x7f5e900b4180 2023-12-19T16:14:59.260 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5e8c01b400 con 0x7f5e900b4180 2023-12-19T16:14:59.260 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.253+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e90073e90 con 0x7f5e900b4180 2023-12-19T16:14:59.261 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.257+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f5e8c017070 con 0x7f5e900b4180 2023-12-19T16:14:59.318 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.313+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e900b4f60 con 0x7f5e900b4180 2023-12-19T16:14:59.319 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.313+0000 7f5e85ffb640 1 -- 172.21.15.119:0/3932208481 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5e8c01b5c0 con 0x7f5e900b4180 2023-12-19T16:14:59.319 INFO:teuthology.misc.health.smithi119.stdout: 2023-12-19T16:14:59.319 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":10,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:14:57.930518+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e900b4180 msgr2=0x7f5e90160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e900b4180 0x7f5e90160030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c390 tx=0x7f5e8c001e80 comp rx=0 tx=0).stop 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 shutdown_connections 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e900d3020 0x7f5e90152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9015cdc0 0x7f5e9015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 --2- 172.21.15.119:0/3932208481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e900b4180 0x7f5e90160030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 >> 172.21.15.119:0/3932208481 conn(0x7f5e9009ba30 msgr2=0x7f5e900b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 shutdown_connections 2023-12-19T16:14:59.320 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:14:59.317+0000 7f5e973ce640 1 -- 172.21.15.119:0/3932208481 wait complete. 2023-12-19T16:14:59.337 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T16:14:59.672 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:59.669+0000 7f331fa2f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T16:14:59.749 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:59.747+0000 7ff59609b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T16:14:59.759 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:59.753+0000 7f331fa2f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T16:14:59.835 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:14:59.831+0000 7ff59609b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T16:14:59.949 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:14:59.945+0000 7f331fa2f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T16:15:00.025 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:15:00.023+0000 7ff59609b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T16:15:00.034 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:15:00.029+0000 7f331fa2f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T16:15:00.110 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:15:00.107+0000 7ff59609b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T16:15:00.362 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:15:00.357+0000 7f331fa2f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T16:15:00.430 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:15:00.425+0000 7f331fa2f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T16:15:00.440 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:15:00.439+0000 7ff59609b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T16:15:00.513 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-19T16:15:00.511+0000 7ff59609b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T16:15:01.451 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:15:01.445+0000 7f32c5d63640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T16:15:01.451 INFO:tasks.ceph.mgr.y.smithi119.stderr:2023-12-19T16:15:01.445+0000 7f32c5d63640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T16:15:02.465 INFO:tasks.ceph.osd.0.smithi119.stderr:2023-12-19T16:15:02.461+0000 7fb77ddb6640 -1 osd.0 0 log_to_monitors true 2023-12-19T16:15:02.475 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-19T16:15:02.471+0000 7fd9418f2640 -1 osd.5 0 log_to_monitors true 2023-12-19T16:15:02.545 INFO:tasks.ceph.osd.1.smithi119.stderr:2023-12-19T16:15:02.541+0000 7fa442996640 -1 osd.1 0 log_to_monitors true 2023-12-19T16:15:02.603 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-19T16:15:02.599+0000 7fdc68bb4640 -1 osd.7 0 log_to_monitors true 2023-12-19T16:15:02.643 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-19T16:15:02.639+0000 7f6d7b96e640 -1 osd.6 0 log_to_monitors true 2023-12-19T16:15:02.644 INFO:tasks.ceph.osd.3.smithi119.stderr:2023-12-19T16:15:02.641+0000 7fe8421b6640 -1 osd.3 0 log_to_monitors true 2023-12-19T16:15:02.647 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-19T16:15:02.643+0000 7f351302b640 -1 osd.4 0 log_to_monitors true 2023-12-19T16:15:02.678 INFO:tasks.ceph.osd.2.smithi119.stderr:2023-12-19T16:15:02.673+0000 7f6b29872640 -1 osd.2 0 log_to_monitors true 2023-12-19T16:15:06.144 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:06.353 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.349+0000 7f66577a5640 1 Processor -- start 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.349+0000 7f66577a5640 1 -- start start 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.349+0000 7f66577a5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6650160b80 0x7f66500cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f66577a5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66500c19a0 0x7f66500b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f66577a5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665006cbb0 con 0x7f66500b2f60 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f66577a5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665006bb10 con 0x7f6650160b80 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f66577a5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665006bdf0 con 0x7f66500c19a0 2023-12-19T16:15:06.358 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655541640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6650160b80 0x7f66500cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655d42640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66500c19a0 0x7f66500b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655541640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6650160b80 0x7f66500cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50766/0 (socket says 172.21.15.119:50766) 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655d42640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66500c19a0 0x7f66500b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:38702/0 (socket says 172.21.15.119:38702) 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655541640 1 -- 172.21.15.119:0/1999365001 learned_addr learned my addr 172.21.15.119:0/1999365001 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655d42640 1 -- 172.21.15.119:0/1999365001 >> v2:172.21.15.119:3300/0 conn(0x7f6650160b80 msgr2=0x7f66500cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655d42640 1 --2- 172.21.15.119:0/1999365001 >> v2:172.21.15.119:3300/0 conn(0x7f6650160b80 0x7f66500cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.359 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655d42640 1 -- 172.21.15.119:0/1999365001 >> v1:172.21.15.119:6789/0 conn(0x7f66500b2f60 legacy=0x7f66500c1290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:15:06.360 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.353+0000 7f6655d42640 1 -- 172.21.15.119:0/1999365001 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665006c0d0 con 0x7f66500c19a0 2023-12-19T16:15:06.364 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f6655d42640 1 --2- 172.21.15.119:0/1999365001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500c19a0 0x7f66500b1570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6650165870 tx=0x7f664801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d450a830a57db9b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:06.366 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f6647fff640 1 -- 172.21.15.119:0/1999365001 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480a59a0 con 0x7f66500c19a0 2023-12-19T16:15:06.366 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f6647fff640 1 -- 172.21.15.119:0/1999365001 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66480a5b00 con 0x7f66500c19a0 2023-12-19T16:15:06.366 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f6647fff640 1 -- 172.21.15.119:0/1999365001 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480a5e90 con 0x7f66500c19a0 2023-12-19T16:15:06.367 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 -- 172.21.15.119:0/1999365001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500c19a0 msgr2=0x7f66500b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:06.367 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 --2- 172.21.15.119:0/1999365001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500c19a0 0x7f66500b1570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6650165870 tx=0x7f664801c8e0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.367 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 -- 172.21.15.119:0/1999365001 shutdown_connections 2023-12-19T16:15:06.367 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 --2- 172.21.15.119:0/1999365001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500c19a0 0x7f66500b1570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.367 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 --2- 172.21.15.119:0/1999365001 >> v2:172.21.15.119:3300/0 conn(0x7f6650160b80 0x7f66500cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.368 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 -- 172.21.15.119:0/1999365001 >> 172.21.15.119:0/1999365001 conn(0x7f665006a0a0 msgr2=0x7f665006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:06.368 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.361+0000 7f66577a5640 1 -- 172.21.15.119:0/1999365001 shutdown_connections 2023-12-19T16:15:06.369 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 -- 172.21.15.119:0/1999365001 wait complete. 2023-12-19T16:15:06.370 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 Processor -- start 2023-12-19T16:15:06.370 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 -- start start 2023-12-19T16:15:06.372 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500b2f60 0x7f6650156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:06.372 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66500c19a0 0x7f66500ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:06.372 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 0x7f66500cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:06.372 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500cdb20 con 0x7f6650160b80 2023-12-19T16:15:06.372 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500ac0b0 con 0x7f66500b2f60 2023-12-19T16:15:06.372 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.365+0000 7f66577a5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500ac390 con 0x7f66500c19a0 2023-12-19T16:15:06.374 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 0x7f66500cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:06.374 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 0x7f66500cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50780/0 (socket says 172.21.15.119:50780) 2023-12-19T16:15:06.374 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 -- 172.21.15.119:0/975858203 learned_addr learned my addr 172.21.15.119:0/975858203 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:06.374 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6654d40640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66500c19a0 0x7f66500ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:06.375 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 -- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66500c19a0 msgr2=0x7f66500ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:06.375 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66500c19a0 0x7f66500ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.375 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 -- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500b2f60 msgr2=0x7f6650156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:06.375 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500b2f60 0x7f6650156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.375 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 -- 172.21.15.119:0/975858203 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648009a70 con 0x7f6650160b80 2023-12-19T16:15:06.375 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6655d42640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 0x7f66500cd5e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f664801a510 tx=0x7f6648019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:06.376 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480aece0 con 0x7f6650160b80 2023-12-19T16:15:06.376 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66480aee60 con 0x7f6650160b80 2023-12-19T16:15:06.376 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480b7650 con 0x7f6650160b80 2023-12-19T16:15:06.376 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66500ac670 con 0x7f6650160b80 2023-12-19T16:15:06.376 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.369+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500acc30 con 0x7f6650160b80 2023-12-19T16:15:06.377 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.373+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66500ace20 con 0x7f6650160b80 2023-12-19T16:15:06.378 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.373+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f66480b4050 con 0x7f6650160b80 2023-12-19T16:15:06.380 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.377+0000 7f6645ffb640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6634065a50 0x7f6634067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:06.381 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.377+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f664811d060 con 0x7f6650160b80 2023-12-19T16:15:06.385 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.381+0000 7f6655541640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6634065a50 0x7f6634067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:06.385 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.381+0000 7f6655541640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6634065a50 0x7f6634067f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6640006c70 tx=0x7f6640006b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:06.389 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.385+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f66480eba90 con 0x7f6650160b80 2023-12-19T16:15:06.696 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.689+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6650073e90 con 0x7f6650160b80 2023-12-19T16:15:06.697 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.693+0000 7f6645ffb640 1 -- 172.21.15.119:0/975858203 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f66480ef0b0 con 0x7f6650160b80 2023-12-19T16:15:06.700 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-19T16:15:06.694+0000 7fdc64b59640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T16:15:06.702 INFO:teuthology.misc.health.smithi119.stdout: 2023-12-19T16:15:06.702 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":12,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:04.459447+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:06.703 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6634065a50 msgr2=0x7f6634067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:06.703 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6634065a50 0x7f6634067f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6640006c70 tx=0x7f6640006b80 comp rx=0 tx=0).stop 2023-12-19T16:15:06.704 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 msgr2=0x7f66500cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:06.704 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 0x7f66500cd5e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f664801a510 tx=0x7f6648019680 comp rx=0 tx=0).stop 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 shutdown_connections 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6634065a50 0x7f6634067f10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6650160b80 0x7f66500cd5e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66500c19a0 0x7f66500ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 --2- 172.21.15.119:0/975858203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66500b2f60 0x7f6650156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.697+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 >> 172.21.15.119:0/975858203 conn(0x7f665006a0a0 msgr2=0x7f66500ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.701+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 shutdown_connections 2023-12-19T16:15:06.705 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:06.701+0000 7f66577a5640 1 -- 172.21.15.119:0/975858203 wait complete. 2023-12-19T16:15:06.735 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T16:15:06.745 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-19T16:15:06.742+0000 7fdc5c98c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:06.788 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-19T16:15:06.786+0000 7fd93d897640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T16:15:06.813 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-19T16:15:06.810+0000 7fd9356ca640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:06.890 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-19T16:15:06.886+0000 7f350e5af640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T16:15:06.896 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-19T16:15:06.894+0000 7f6d77915640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T16:15:06.897 INFO:tasks.ceph.osd.1.smithi119.stderr:2023-12-19T16:15:06.893+0000 7fa43e93d640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T16:15:06.912 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-19T16:15:06.910+0000 7f35063e2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:06.920 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-19T16:15:06.918+0000 7f6d6f748640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:06.949 INFO:tasks.ceph.osd.1.smithi119.stderr:2023-12-19T16:15:06.945+0000 7fa436770640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:07.006 INFO:tasks.ceph.osd.0.smithi119.stderr:2023-12-19T16:15:07.001+0000 7fb77a572640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T16:15:07.036 INFO:tasks.ceph.osd.2.smithi119.stderr:2023-12-19T16:15:07.033+0000 7f6b25817640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T16:15:07.040 INFO:tasks.ceph.osd.0.smithi119.stderr:2023-12-19T16:15:07.037+0000 7fb771b8e640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:07.055 INFO:tasks.ceph.osd.3.smithi119.stderr:2023-12-19T16:15:07.049+0000 7fe83e15b640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T16:15:07.056 INFO:tasks.ceph.osd.2.smithi119.stderr:2023-12-19T16:15:07.053+0000 7f6b1d64a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:07.096 INFO:tasks.ceph.osd.3.smithi119.stderr:2023-12-19T16:15:07.093+0000 7fe835f8e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:13.542 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:13.678 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 Processor -- start 2023-12-19T16:15:13.678 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 -- start start 2023-12-19T16:15:13.680 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89e015dd80 0x7f89e00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.680 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cec00 0x7f89e00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.680 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89e00cc3d0 0x7f89e015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.680 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00cf060 con 0x7f89e015dd80 2023-12-19T16:15:13.680 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00cd760 con 0x7f89e00cc3d0 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89e5ed1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00ccb50 con 0x7f89e00cec00 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89e015dd80 0x7f89e00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89e015dd80 0x7f89e00ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60790/0 (socket says 172.21.15.119:60790) 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 -- 172.21.15.119:0/1842168076 learned_addr learned my addr 172.21.15.119:0/1842168076 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89dffff640 1 --2- 172.21.15.119:0/1842168076 >> v2:172.21.15.143:3300/0 conn(0x7f89e00cc3d0 0x7f89e015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89deffd640 1 --2- 172.21.15.119:0/1842168076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cec00 0x7f89e00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.681 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 -- 172.21.15.119:0/1842168076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cec00 msgr2=0x7f89e00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:13.682 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 --2- 172.21.15.119:0/1842168076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cec00 0x7f89e00cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.682 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 -- 172.21.15.119:0/1842168076 >> v2:172.21.15.143:3300/0 conn(0x7f89e00cc3d0 msgr2=0x7f89e015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:13.682 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 --2- 172.21.15.119:0/1842168076 >> v2:172.21.15.143:3300/0 conn(0x7f89e00cc3d0 0x7f89e015e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.682 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.676+0000 7f89df7fe640 1 -- 172.21.15.119:0/1842168076 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00cce30 con 0x7f89e015dd80 2023-12-19T16:15:13.682 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89df7fe640 1 --2- 172.21.15.119:0/1842168076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e015dd80 0x7f89e00ce6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cf2d0 tx=0x7f89d001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17c1c29f04cb773 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:13.683 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89de7fc640 1 -- 172.21.15.119:0/1842168076 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00ab600 con 0x7f89e015dd80 2023-12-19T16:15:13.683 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89de7fc640 1 -- 172.21.15.119:0/1842168076 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d00a7050 con 0x7f89e015dd80 2023-12-19T16:15:13.683 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89de7fc640 1 -- 172.21.15.119:0/1842168076 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00ab980 con 0x7f89e015dd80 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 -- 172.21.15.119:0/1842168076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e015dd80 msgr2=0x7f89e00ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/1842168076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e015dd80 0x7f89e00ce6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cf2d0 tx=0x7f89d001c240 comp rx=0 tx=0).stop 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 -- 172.21.15.119:0/1842168076 shutdown_connections 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/1842168076 >> v2:172.21.15.143:3300/0 conn(0x7f89e00cc3d0 0x7f89e015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/1842168076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cec00 0x7f89e00cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/1842168076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e015dd80 0x7f89e00ce6c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.684 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 -- 172.21.15.119:0/1842168076 >> 172.21.15.119:0/1842168076 conn(0x7f89e006a0a0 msgr2=0x7f89e006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:13.685 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 -- 172.21.15.119:0/1842168076 shutdown_connections 2023-12-19T16:15:13.685 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.680+0000 7f89e5ed1640 1 -- 172.21.15.119:0/1842168076 wait complete. 2023-12-19T16:15:13.685 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 Processor -- start 2023-12-19T16:15:13.686 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 -- start start 2023-12-19T16:15:13.687 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cc3d0 0x7f89e0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.687 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 0x7f89e006bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.687 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89e015dd80 0x7f89e006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.687 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00ca9a0 con 0x7f89e00cec00 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00cac80 con 0x7f89e015dd80 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00caf60 con 0x7f89e00cc3d0 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 0x7f89e006bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 0x7f89e006bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60804/0 (socket says 172.21.15.119:60804) 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 -- 172.21.15.119:0/2725810926 learned_addr learned my addr 172.21.15.119:0/2725810926 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89df7fe640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cc3d0 0x7f89e0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89dffff640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89e015dd80 0x7f89e006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 -- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cc3d0 msgr2=0x7f89e0156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cc3d0 0x7f89e0156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 -- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89e015dd80 msgr2=0x7f89e006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89e015dd80 0x7f89e006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 -- 172.21.15.119:0/2725810926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0009480 con 0x7f89e00cec00 2023-12-19T16:15:13.688 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89deffd640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 0x7f89e006bea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f89d400e930 tx=0x7f89d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:13.689 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4009690 con 0x7f89e00cec00 2023-12-19T16:15:13.689 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400ca00 con 0x7f89e00cec00 2023-12-19T16:15:13.689 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400cd70 con 0x7f89e00cec00 2023-12-19T16:15:13.689 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.684+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e00cb240 con 0x7f89e00cec00 2023-12-19T16:15:13.689 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e0156570 con 0x7f89e00cec00 2023-12-19T16:15:13.690 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e0073e90 con 0x7f89e00cec00 2023-12-19T16:15:13.690 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89d4013470 con 0x7f89e00cec00 2023-12-19T16:15:13.690 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89c7fff640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89cc065a60 0x7f89cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:13.690 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89d40830c0 con 0x7f89e00cec00 2023-12-19T16:15:13.691 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89df7fe640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89cc065a60 0x7f89cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:13.691 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.688+0000 7f89df7fe640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89cc065a60 0x7f89cc067f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89d00ad000 tx=0x7f89d00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:13.695 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.692+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f89d4050e90 con 0x7f89e00cec00 2023-12-19T16:15:13.847 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.844+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89e00caae0 con 0x7f89e00cec00 2023-12-19T16:15:13.848 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89c7fff640 1 -- 172.21.15.119:0/2725810926 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f89e00caae0 con 0x7f89e00cec00 2023-12-19T16:15:13.849 INFO:teuthology.misc.health.smithi119.stdout: 2023-12-19T16:15:13.849 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":16,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:11.150041+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89cc065a60 msgr2=0x7f89cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89cc065a60 0x7f89cc067f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89d00ad000 tx=0x7f89d00a6000 comp rx=0 tx=0).stop 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 msgr2=0x7f89e006bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 0x7f89e006bea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f89d400e930 tx=0x7f89d400edf0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 shutdown_connections 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89cc065a60 0x7f89cc067f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89e015dd80 0x7f89e006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.851 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e00cec00 0x7f89e006bea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.852 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 --2- 172.21.15.119:0/2725810926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89e00cc3d0 0x7f89e0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:13.852 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 >> 172.21.15.119:0/2725810926 conn(0x7f89e006a0a0 msgr2=0x7f89e006ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:13.852 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 shutdown_connections 2023-12-19T16:15:13.852 INFO:teuthology.misc.health.smithi119.stderr:2023-12-19T16:15:13.848+0000 7f89e5ed1640 1 -- 172.21.15.119:0/2725810926 wait complete. 2023-12-19T16:15:13.868 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T16:15:13.868 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T16:15:13.868 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:15:13.869 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:15:13.872 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:15:13.872 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:15:13.872 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:15:13.875 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:15:13.875 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:15:13.875 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:15:13.879 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:15:13.879 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:15:13.880 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:15:13.883 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:15:13.883 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T16:15:13.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:13.973 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2023-12-19T16:15:13.974 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2023-12-19T16:15:13.984 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-19T16:15:13.985 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-19T16:15:14.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 Processor -- start 2023-12-19T16:15:14.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 -- start start 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0e3815ca40 0x7f0e380cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e380cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e380cf610 0x7f0e381605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380cfa70 con 0x7f0e380cf610 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380d11c0 con 0x7f0e3815ca40 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e3e198640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380d0310 con 0x7f0e380ce3f0 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e380cf610 0x7f0e381605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e380cf610 0x7f0e381605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60856/0 (socket says 172.21.15.119:60856) 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 -- 172.21.15.119:0/4023178286 learned_addr learned my addr 172.21.15.119:0/4023178286 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:14.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e377fe640 1 --2- 172.21.15.119:0/4023178286 >> v2:172.21.15.143:3300/0 conn(0x7f0e3815ca40 0x7f0e380cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e36ffd640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e380cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 -- 172.21.15.119:0/4023178286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 msgr2=0x7f0e380cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e380cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 -- 172.21.15.119:0/4023178286 >> v2:172.21.15.143:3300/0 conn(0x7f0e3815ca40 msgr2=0x7f0e380cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 --2- 172.21.15.119:0/4023178286 >> v2:172.21.15.143:3300/0 conn(0x7f0e3815ca40 0x7f0e380cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e37fff640 1 -- 172.21.15.119:0/4023178286 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380d05b0 con 0x7f0e380cf610 2023-12-19T16:15:14.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.028+0000 7f0e36ffd640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e380cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:14.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e37fff640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e380cf610 0x7f0e381605b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e380736e0 tx=0x7f0e3001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f3a77ef12826bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e367fc640 1 -- 172.21.15.119:0/4023178286 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300ab600 con 0x7f0e380cf610 2023-12-19T16:15:14.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e367fc640 1 -- 172.21.15.119:0/4023178286 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300a7050 con 0x7f0e380cf610 2023-12-19T16:15:14.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e367fc640 1 -- 172.21.15.119:0/4023178286 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300ab980 con 0x7f0e380cf610 2023-12-19T16:15:14.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 -- 172.21.15.119:0/4023178286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e380cf610 msgr2=0x7f0e381605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e380cf610 0x7f0e381605b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e380736e0 tx=0x7f0e3001c240 comp rx=0 tx=0).stop 2023-12-19T16:15:14.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 -- 172.21.15.119:0/4023178286 shutdown_connections 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e380cf610 0x7f0e381605b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 --2- 172.21.15.119:0/4023178286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e380cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 --2- 172.21.15.119:0/4023178286 >> v2:172.21.15.143:3300/0 conn(0x7f0e3815ca40 0x7f0e380cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 -- 172.21.15.119:0/4023178286 >> 172.21.15.119:0/4023178286 conn(0x7f0e38089fb0 msgr2=0x7f0e380d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 -- 172.21.15.119:0/4023178286 shutdown_connections 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.032+0000 7f0e3e198640 1 -- 172.21.15.119:0/4023178286 wait complete. 2023-12-19T16:15:14.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 Processor -- start 2023-12-19T16:15:14.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 -- start start 2023-12-19T16:15:14.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e3814baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e380cf610 0x7f0e38155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 0x7f0e380c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3815fc50 con 0x7f0e3815ca40 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3814c960 con 0x7f0e380cf610 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380cc640 con 0x7f0e380ce3f0 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 0x7f0e380c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 0x7f0e380c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60858/0 (socket says 172.21.15.119:60858) 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 -- 172.21.15.119:0/2187577714 learned_addr learned my addr 172.21.15.119:0/2187577714 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 -- 172.21.15.119:0/2187577714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 msgr2=0x7f0e3814baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e3814baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 -- 172.21.15.119:0/2187577714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e380cf610 msgr2=0x7f0e38155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e380cf610 0x7f0e38155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 -- 172.21.15.119:0/2187577714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300094d0 con 0x7f0e3815ca40 2023-12-19T16:15:14.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e37fff640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 0x7f0e380c9910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e300ae040 tx=0x7f0e30018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300abe70 con 0x7f0e3815ca40 2023-12-19T16:15:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300a4e90 con 0x7f0e3815ca40 2023-12-19T16:15:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300b4670 con 0x7f0e3815ca40 2023-12-19T16:15:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e380cc080 con 0x7f0e3815ca40 2023-12-19T16:15:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.036+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3815f8e0 con 0x7f0e3815ca40 2023-12-19T16:15:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.040+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3804e000 con 0x7f0e3815ca40 2023-12-19T16:15:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.040+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e300b2040 con 0x7f0e3815ca40 2023-12-19T16:15:14.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.040+0000 7f0e1ffff640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0e24065a60 0x7f0e24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.040+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e3011c930 con 0x7f0e3815ca40 2023-12-19T16:15:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.040+0000 7f0e377fe640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0e24065a60 0x7f0e24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.040+0000 7f0e377fe640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0e24065a60 0x7f0e24067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cbfb0 tx=0x7f0e2800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.044+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e300ea750 con 0x7f0e3815ca40 2023-12-19T16:15:14.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.196+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e380cff10 con 0x7f0e3815ca40 2023-12-19T16:15:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e1ffff640 1 -- 172.21.15.119:0/2187577714 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f0e300edd70 con 0x7f0e3815ca40 2023-12-19T16:15:14.200 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":16,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:11.150041+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:14.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0e24065a60 msgr2=0x7f0e24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0e24065a60 0x7f0e24067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cbfb0 tx=0x7f0e2800b040 comp rx=0 tx=0).stop 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 msgr2=0x7f0e380c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 0x7f0e380c9910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e300ae040 tx=0x7f0e30018fe0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 shutdown_connections 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0e24065a60 0x7f0e24067f20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e380cf610 0x7f0e38155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3815ca40 0x7f0e380c9910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 --2- 172.21.15.119:0/2187577714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e380ce3f0 0x7f0e3814baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 >> 172.21.15.119:0/2187577714 conn(0x7f0e38089fb0 msgr2=0x7f0e380cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 shutdown_connections 2023-12-19T16:15:14.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.200+0000 7f0e3e198640 1 -- 172.21.15.119:0/2187577714 wait complete. 2023-12-19T16:15:14.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:15:14.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:14.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.360+0000 7f16517bc640 1 Processor -- start 2023-12-19T16:15:14.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.360+0000 7f16517bc640 1 -- start start 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f16517bc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f164c15ca70 0x7f164c0d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f16517bc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0d17c0 con 0x7f164c0cd520 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f16517bc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0d1cb0 con 0x7f164c15c690 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f16517bc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0b1c20 con 0x7f164c15ca70 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f164a7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f164c0cd520 0x7f164c0b5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42670/0 (socket says 172.21.15.119:42670) 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f164a7fc640 1 -- 172.21.15.119:0/385188818 learned_addr learned my addr 172.21.15.119:0/385188818 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:14.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f164b7fe640 1 --2- 172.21.15.119:0/385188818 >> v2:172.21.15.119:3300/0 conn(0x7f164c15ca70 0x7f164c0d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461831204 0 0) 0x7f164c0d17c0 con 0x7f164c0cd520 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1634003530 con 0x7f164c0cd520 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338824966 0 0) 0x7f164c0d1cb0 con 0x7f164c15c690 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f164c0d17c0 con 0x7f164c15c690 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f164b7fe640 1 -- 172.21.15.119:0/385188818 >> v1:172.21.15.143:6789/0 conn(0x7f164c15c690 legacy=0x7f164c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f164b7fe640 1 -- 172.21.15.119:0/385188818 >> v1:172.21.15.119:6789/0 conn(0x7f164c0cd520 legacy=0x7f164c0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.364+0000 7f164b7fe640 1 -- 172.21.15.119:0/385188818 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0d1f90 con 0x7f164c15ca70 2023-12-19T16:15:14.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f164b7fe640 1 --2- 172.21.15.119:0/385188818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15ca70 0x7f164c0d2a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1644009d90 tx=0x7f164401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57b254b79b23843 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440af600 con 0x7f164c15ca70 2023-12-19T16:15:14.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440ab050 con 0x7f164c15ca70 2023-12-19T16:15:14.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f1649ffb640 1 -- 172.21.15.119:0/385188818 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440af980 con 0x7f164c15ca70 2023-12-19T16:15:14.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- 172.21.15.119:0/385188818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15ca70 msgr2=0x7f164c0d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 --2- 172.21.15.119:0/385188818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15ca70 0x7f164c0d2a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1644009d90 tx=0x7f164401f130 comp rx=0 tx=0).stop 2023-12-19T16:15:14.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- 172.21.15.119:0/385188818 shutdown_connections 2023-12-19T16:15:14.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 --2- 172.21.15.119:0/385188818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15ca70 0x7f164c0d2a70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- 172.21.15.119:0/385188818 >> 172.21.15.119:0/385188818 conn(0x7f164c0717d0 msgr2=0x7f164c071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:14.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- 172.21.15.119:0/385188818 shutdown_connections 2023-12-19T16:15:14.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- 172.21.15.119:0/385188818 wait complete. 2023-12-19T16:15:14.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 Processor -- start 2023-12-19T16:15:14.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- start start 2023-12-19T16:15:14.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f164c0cd520 0x7f164c149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 0x7f164c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f164c15ca70 0x7f164c159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c158880 con 0x7f164c15c690 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1582c0 con 0x7f164c15ca70 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.368+0000 7f16517bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1585a0 con 0x7f164c0cd520 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 0x7f164c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 0x7f164c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60882/0 (socket says 172.21.15.119:60882) 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 -- 172.21.15.119:0/901091376 learned_addr learned my addr 172.21.15.119:0/901091376 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164b7fe640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f164c15ca70 0x7f164c159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164affd640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f164c0cd520 0x7f164c149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 -- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f164c0cd520 msgr2=0x7f164c149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f164c0cd520 0x7f164c149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 -- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f164c15ca70 msgr2=0x7f164c159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f164c15ca70 0x7f164c159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 -- 172.21.15.119:0/901091376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009a70 con 0x7f164c15c690 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f164a7fc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 0x7f164c159020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1640005890 tx=0x7f164000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640005cf0 con 0x7f164c15c690 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640005e50 con 0x7f164c15c690 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640007290 con 0x7f164c15c690 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0c6210 con 0x7f164c15c690 2023-12-19T16:15:14.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c154400 con 0x7f164c15c690 2023-12-19T16:15:14.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c0c6730 con 0x7f164c15c690 2023-12-19T16:15:14.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16400073f0 con 0x7f164c15c690 2023-12-19T16:15:14.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.372+0000 7f16337fe640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1638065a90 0x7f1638067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.376+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f16400822b0 con 0x7f164c15c690 2023-12-19T16:15:14.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.376+0000 7f164affd640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1638065a90 0x7f1638067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.376+0000 7f164affd640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1638065a90 0x7f1638067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f163c0011f0 tx=0x7f163c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.376+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f164c0c6730 con 0x7f164c15c690 2023-12-19T16:15:14.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f164c0c6730 con 0x7f164c15c690 2023-12-19T16:15:14.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16337fe640 1 -- 172.21.15.119:0/901091376 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f164c0c6730 con 0x7f164c15c690 2023-12-19T16:15:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:15:14.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1638065a90 msgr2=0x7f1638067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1638065a90 0x7f1638067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f163c0011f0 tx=0x7f163c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:14.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 msgr2=0x7f164c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 0x7f164c159020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1640005890 tx=0x7f164000c960 comp rx=0 tx=0).stop 2023-12-19T16:15:14.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 shutdown_connections 2023-12-19T16:15:14.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1638065a90 0x7f1638067f50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f164c15ca70 0x7f164c159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f164c15c690 0x7f164c159020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 --2- 172.21.15.119:0/901091376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f164c0cd520 0x7f164c149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 >> 172.21.15.119:0/901091376 conn(0x7f164c0717d0 msgr2=0x7f164c15d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:14.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.528+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 shutdown_connections 2023-12-19T16:15:14.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.532+0000 7f16517bc640 1 -- 172.21.15.119:0/901091376 wait complete. 2023-12-19T16:15:14.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:14.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.684+0000 7fd087352640 1 Processor -- start 2023-12-19T16:15:14.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.684+0000 7fd087352640 1 -- start start 2023-12-19T16:15:14.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd087352640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd080160cc0 0x7fd0800cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd087352640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd087352640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08006fdb0 con 0x7fd0800c1280 2023-12-19T16:15:14.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd087352640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0801654a0 con 0x7fd080160cc0 2023-12-19T16:15:14.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd087352640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0801610a0 con 0x7fd0800c17d0 2023-12-19T16:15:14.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd080160cc0 0x7fd0800cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd080160cc0 0x7fd0800cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60886/0 (socket says 172.21.15.119:60886) 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 -- 172.21.15.119:0/661976559 learned_addr learned my addr 172.21.15.119:0/661976559 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0858ef640 1 --2- 172.21.15.119:0/661976559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 -- 172.21.15.119:0/661976559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 msgr2=0x7fd0800cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 --2- 172.21.15.119:0/661976559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 -- 172.21.15.119:0/661976559 >> v1:172.21.15.143:6789/0 conn(0x7fd0800c1280 legacy=0x7fd08006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:14.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 -- 172.21.15.119:0/661976559 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800cb6b0 con 0x7fd080160cc0 2023-12-19T16:15:14.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd0850ee640 1 --2- 172.21.15.119:0/661976559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800cac30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009870 tx=0x7fd07c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5021ebfa85f1f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.688+0000 7fd077fff640 1 -- 172.21.15.119:0/661976559 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0ac620 con 0x7fd080160cc0 2023-12-19T16:15:14.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd077fff640 1 -- 172.21.15.119:0/661976559 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c0ac780 con 0x7fd080160cc0 2023-12-19T16:15:14.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd077fff640 1 -- 172.21.15.119:0/661976559 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0acb10 con 0x7fd080160cc0 2023-12-19T16:15:14.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- 172.21.15.119:0/661976559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 msgr2=0x7fd0800cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 --2- 172.21.15.119:0/661976559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800cac30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009870 tx=0x7fd07c01c480 comp rx=0 tx=0).stop 2023-12-19T16:15:14.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- 172.21.15.119:0/661976559 shutdown_connections 2023-12-19T16:15:14.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 --2- 172.21.15.119:0/661976559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 --2- 172.21.15.119:0/661976559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800cac30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- 172.21.15.119:0/661976559 >> 172.21.15.119:0/661976559 conn(0x7fd08006a3e0 msgr2=0x7fd0800afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:14.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- 172.21.15.119:0/661976559 shutdown_connections 2023-12-19T16:15:14.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- 172.21.15.119:0/661976559 wait complete. 2023-12-19T16:15:14.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 Processor -- start 2023-12-19T16:15:14.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- start start 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0800c1280 0x7fd0801580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800c7920 con 0x7fd080160cc0 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800c7c00 con 0x7fd0800c1280 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd087352640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800c7ee0 con 0x7fd0800c17d0 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd0858ef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd0850ee640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0800c1280 0x7fd0801580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd0858ef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60894/0 (socket says 172.21.15.119:60894) 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd0858ef640 1 -- 172.21.15.119:0/2227534559 learned_addr learned my addr 172.21.15.119:0/2227534559 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:14.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.692+0000 7fd0848ed640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0858ef640 1 -- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 msgr2=0x7fd0800c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0858ef640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0858ef640 1 -- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0800c1280 msgr2=0x7fd0801580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0858ef640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0800c1280 0x7fd0801580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0858ef640 1 -- 172.21.15.119:0/2227534559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c0094d0 con 0x7fd080160cc0 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0850ee640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0800c1280 0x7fd0801580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0848ed640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd0858ef640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800c5970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd078007e40 tx=0x7fd07800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078014620 con 0x7fd080160cc0 2023-12-19T16:15:14.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800ee90 con 0x7fd080160cc0 2023-12-19T16:15:14.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780149e0 con 0x7fd080160cc0 2023-12-19T16:15:14.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0800c81c0 con 0x7fd080160cc0 2023-12-19T16:15:14.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0800c7460 con 0x7fd080160cc0 2023-12-19T16:15:14.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0800735b0 con 0x7fd080160cc0 2023-12-19T16:15:14.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.696+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd078014b40 con 0x7fd080160cc0 2023-12-19T16:15:14.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.700+0000 7fd075ffb640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd064065a60 0x7fd064067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:14.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.700+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0780836d0 con 0x7fd080160cc0 2023-12-19T16:15:14.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.700+0000 7fd0850ee640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd064065a60 0x7fd064067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:14.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.700+0000 7fd0850ee640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd064065a60 0x7fd064067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0ae000 tx=0x7fd07c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:14.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.704+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd078051470 con 0x7fd080160cc0 2023-12-19T16:15:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0800adc70 con 0x7fd080160cc0 2023-12-19T16:15:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd075ffb640 1 -- 172.21.15.119:0/2227534559 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fd078054a90 con 0x7fd080160cc0 2023-12-19T16:15:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:14.886 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-19T16:15:14.886 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 2 2023-12-19T16:15:14.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd064065a60 msgr2=0x7fd064067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd064065a60 0x7fd064067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0ae000 tx=0x7fd07c008040 comp rx=0 tx=0).stop 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 msgr2=0x7fd0800c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800c5970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd078007e40 tx=0x7fd07800e4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 shutdown_connections 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd064065a60 0x7fd064067f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd080160cc0 0x7fd0800c5970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0800c17d0 0x7fd0800c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 --2- 172.21.15.119:0/2227534559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0800c1280 0x7fd0801580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 >> 172.21.15.119:0/2227534559 conn(0x7fd08006a3e0 msgr2=0x7fd080159510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 shutdown_connections 2023-12-19T16:15:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:14.884+0000 7fd087352640 1 -- 172.21.15.119:0/2227534559 wait complete. 2023-12-19T16:15:16.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.052+0000 7f2b80952640 1 Processor -- start 2023-12-19T16:15:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.052+0000 7f2b80952640 1 -- start start 2023-12-19T16:15:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b80952640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2b7c0ca000 0x7f2b7c164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b80952640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0c9460 con 0x7f2b7c06c4f0 2023-12-19T16:15:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b80952640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c1574a0 con 0x7f2b7c1570c0 2023-12-19T16:15:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b80952640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c8b30 con 0x7f2b7c0ca000 2023-12-19T16:15:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b73fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2b7c06c4f0 0x7f2b7c0c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42676/0 (socket says 172.21.15.119:42676) 2023-12-19T16:15:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b73fff640 1 -- 172.21.15.119:0/409100040 learned_addr learned my addr 172.21.15.119:0/409100040 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 --2- 172.21.15.119:0/409100040 >> v2:172.21.15.143:3300/0 conn(0x7f2b7c0ca000 0x7f2b7c164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634665085 0 0) 0x7f2b7c0c9460 con 0x7f2b7c06c4f0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b68003530 con 0x7f2b7c06c4f0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550343987 0 0) 0x7f2b7c1574a0 con 0x7f2b7c1570c0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c0c9460 con 0x7f2b7c1570c0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334378561 0 0) 0x7f2b68003530 con 0x7f2b7c06c4f0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 >> v2:172.21.15.143:3300/0 conn(0x7f2b7c0ca000 msgr2=0x7f2b7c164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 --2- 172.21.15.119:0/409100040 >> v2:172.21.15.143:3300/0 conn(0x7f2b7c0ca000 0x7f2b7c164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 >> v1:172.21.15.143:6789/0 conn(0x7f2b7c1570c0 legacy=0x7f2b7c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0c8e10 con 0x7f2b7c06c4f0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f2b64001680 con 0x7f2b7c06c4f0 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 >> v1:172.21.15.119:6789/0 conn(0x7f2b7c06c4f0 legacy=0x7f2b7c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b68003b10 0x7f2b68003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b680047d0 0x7f2b68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b6800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c8b30 con 0x7f2b68005190 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6800e2d0 con 0x7f2b680047d0 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6800e490 con 0x7f2b68003b10 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b6800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b73fff640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b680047d0 0x7f2b68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7a59c640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b68003b10 0x7f2b68003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 -- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b68003b10 msgr2=0x7f2b68003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b68003b10 0x7f2b68003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 -- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b680047d0 msgr2=0x7f2b68004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b680047d0 0x7f2b68004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.056+0000 7f2b7ad9d640 1 -- 172.21.15.119:0/409100040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68003530 con 0x7f2b68005190 2023-12-19T16:15:17.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b7ad9d640 1 -- 172.21.15.119:0/409100040 reap_dead start 2023-12-19T16:15:17.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b7ad9d640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b6800dba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009fc0 tx=0x7f2b7401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0a631aabba44f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740a5cb0 con 0x7f2b68005190 2023-12-19T16:15:17.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400f040 con 0x7f2b68005190 2023-12-19T16:15:17.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b79d9b640 1 -- 172.21.15.119:0/409100040 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74003be0 con 0x7f2b68005190 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 -- 172.21.15.119:0/409100040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 msgr2=0x7f2b6800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b6800dba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009fc0 tx=0x7f2b7401cca0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 -- 172.21.15.119:0/409100040 shutdown_connections 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 --2- 172.21.15.119:0/409100040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b6800dba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 -- 172.21.15.119:0/409100040 >> 172.21.15.119:0/409100040 conn(0x7f2b7c06a3e0 msgr2=0x7f2b7c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 -- 172.21.15.119:0/409100040 shutdown_connections 2023-12-19T16:15:17.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 -- 172.21.15.119:0/409100040 wait complete. 2023-12-19T16:15:17.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.060+0000 7f2b80952640 1 Processor -- start 2023-12-19T16:15:17.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- start start 2023-12-19T16:15:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b7c14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b7c15c210 0x7f2b7c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b7c0c2f40 0x7f2b7c0c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c15cbd0 con 0x7f2b68005190 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c3900 con 0x7f2b7c15c210 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c6ed0 con 0x7f2b7c0c2f40 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b7c14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b7c14fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60912/0 (socket says 172.21.15.119:60912) 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 -- 172.21.15.119:0/4248039967 learned_addr learned my addr 172.21.15.119:0/4248039967 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b73fff640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b7c15c210 0x7f2b7c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7ad9d640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b7c0c2f40 0x7f2b7c0c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 -- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b7c0c2f40 msgr2=0x7f2b7c0c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b7c0c2f40 0x7f2b7c0c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 -- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b7c15c210 msgr2=0x7f2b7c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b7c15c210 0x7f2b7c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 -- 172.21.15.119:0/4248039967 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0c1e90 con 0x7f2b68005190 2023-12-19T16:15:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b73fff640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b7c15c210 0x7f2b7c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b7a59c640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b7c14fa20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c012890 tx=0x7f2b6c012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c010b70 con 0x7f2b68005190 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c010cf0 con 0x7f2b68005190 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0c2a10 con 0x7f2b68005190 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0166c0 con 0x7f2b68005190 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c0c23c0 con 0x7f2b68005190 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.064+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0735b0 con 0x7f2b68005190 2023-12-19T16:15:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.068+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b6c016820 con 0x7f2b68005190 2023-12-19T16:15:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.068+0000 7f2b72ffd640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b5c065a90 0x7f2b5c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.068+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b6c086460 con 0x7f2b68005190 2023-12-19T16:15:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.068+0000 7f2b73fff640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b5c065a90 0x7f2b5c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.068+0000 7f2b73fff640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b5c065a90 0x7f2b5c067f50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0ce8f0 tx=0x7f2b64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.072+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b6c054160 con 0x7f2b68005190 2023-12-19T16:15:17.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b7c04e000 con 0x7f2b68005190 2023-12-19T16:15:17.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b72ffd640 1 -- 172.21.15.119:0/4248039967 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f2b6c057780 con 0x7f2b68005190 2023-12-19T16:15:17.257 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:17.258 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T16:15:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 3 2023-12-19T16:15:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b5c065a90 msgr2=0x7f2b5c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b5c065a90 0x7f2b5c067f50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0ce8f0 tx=0x7f2b64009040 comp rx=0 tx=0).stop 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 msgr2=0x7f2b7c14fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b7c14fa20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c012890 tx=0x7f2b6c012d50 comp rx=0 tx=0).stop 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 shutdown_connections 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b5c065a90 0x7f2b5c067f50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b7c15c210 0x7f2b7c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b7c0c2f40 0x7f2b7c0c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 --2- 172.21.15.119:0/4248039967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b68005190 0x7f2b7c14fa20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 >> 172.21.15.119:0/4248039967 conn(0x7f2b7c06a3e0 msgr2=0x7f2b7c151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 shutdown_connections 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.256+0000 7f2b80952640 1 -- 172.21.15.119:0/4248039967 wait complete. 2023-12-19T16:15:17.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:17.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 Processor -- start 2023-12-19T16:15:17.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 -- start start 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc15ffb0 0x7f98dc0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98dc0d1280 0x7f98dc0af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0d33d0 con 0x7f98dc0b13d0 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0ce500 con 0x7f98dc0d1280 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e349a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0af330 con 0x7f98dc15ffb0 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e2c99640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98dc0d1280 0x7f98dc0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e1c97640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f98dc0b13d0 0x7f98dc0d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42680/0 (socket says 172.21.15.119:42680) 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e2c99640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98dc0d1280 0x7f98dc0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60928/0 (socket says 172.21.15.119:60928) 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.416+0000 7f98e1c97640 1 -- 172.21.15.119:0/1925903655 learned_addr learned my addr 172.21.15.119:0/1925903655 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:17.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2498640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc15ffb0 0x7f98dc0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2c99640 1 -- 172.21.15.119:0/1925903655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc15ffb0 msgr2=0x7f98dc0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2c99640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc15ffb0 0x7f98dc0d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2c99640 1 -- 172.21.15.119:0/1925903655 >> v1:172.21.15.119:6789/0 conn(0x7f98dc0b13d0 legacy=0x7f98dc0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2c99640 1 -- 172.21.15.119:0/1925903655 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0d3060 con 0x7f98dc0d1280 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2498640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc15ffb0 0x7f98dc0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e1496640 1 -- 172.21.15.119:0/1925903655 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096107843 0 0) 0x7f98dc0d33d0 con 0x7f98dc0b13d0 2023-12-19T16:15:17.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e2c99640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0af850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009d90 tx=0x7f98d401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610f995e89ff5c9f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e1496640 1 -- 172.21.15.119:0/1925903655 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40a5810 con 0x7f98dc0d1280 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e1496640 1 -- 172.21.15.119:0/1925903655 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40a5970 con 0x7f98dc0d1280 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e1496640 1 -- 172.21.15.119:0/1925903655 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40a5d00 con 0x7f98dc0d1280 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e349a640 1 -- 172.21.15.119:0/1925903655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 msgr2=0x7f98dc0af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.420+0000 7f98e349a640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0af850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009d90 tx=0x7f98d401c950 comp rx=0 tx=0).stop 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- 172.21.15.119:0/1925903655 shutdown_connections 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0af850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 --2- 172.21.15.119:0/1925903655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc15ffb0 0x7f98dc0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- 172.21.15.119:0/1925903655 >> 172.21.15.119:0/1925903655 conn(0x7f98dc09b930 msgr2=0x7f98dc0d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- 172.21.15.119:0/1925903655 shutdown_connections 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- 172.21.15.119:0/1925903655 wait complete. 2023-12-19T16:15:17.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 Processor -- start 2023-12-19T16:15:17.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- start start 2023-12-19T16:15:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0b13d0 0x7f98dc0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc15ffb0 0x7f98dc0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0ca920 con 0x7f98dc0d1280 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc1f4a10 con 0x7f98dc15ffb0 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e349a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0cacc0 con 0x7f98dc0b13d0 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0b79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60930/0 (socket says 172.21.15.119:60930) 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 -- 172.21.15.119:0/3143121201 learned_addr learned my addr 172.21.15.119:0/3143121201 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e2498640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0b13d0 0x7f98dc0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e2c99640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc15ffb0 0x7f98dc0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 -- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0b13d0 msgr2=0x7f98dc0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0b13d0 0x7f98dc0c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 -- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc15ffb0 msgr2=0x7f98dc0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc15ffb0 0x7f98dc0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 -- 172.21.15.119:0/3143121201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009a70 con 0x7f98dc0d1280 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e2c99640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc15ffb0 0x7f98dc0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98e1c97640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0b79e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00c4e0 tx=0x7f98cc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.424+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0074e0 con 0x7f98dc0d1280 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc007660 con 0x7f98dc0d1280 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc004a30 con 0x7f98dc0d1280 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc1f84b0 con 0x7f98dc0d1280 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc1f8a70 con 0x7f98dc0d1280 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc0caec0 con 0x7f98dc0d1280 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98cc004b90 con 0x7f98dc0d1280 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98d2ffd640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98cc0820b0 con 0x7f98dc0d1280 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98e2498640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.428+0000 7f98e2498640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98d800ba10 tx=0x7f98d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.432+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98dc0caec0 con 0x7f98dc0d1280 2023-12-19T16:15:17.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.584+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98dc0cae80 con 0x7f98dc0d1280 2023-12-19T16:15:17.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98d2ffd640 1 -- 172.21.15.119:0/3143121201 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f98cc018090 con 0x7f98dc0d1280 2023-12-19T16:15:17.589 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:17.589 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":16,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:11.150041+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:17.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 msgr2=0x7f98c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98d800ba10 tx=0x7f98d8008040 comp rx=0 tx=0).stop 2023-12-19T16:15:17.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 msgr2=0x7f98dc0b79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0b79e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00c4e0 tx=0x7f98cc00c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 shutdown_connections 2023-12-19T16:15:17.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc15ffb0 0x7f98dc0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0d1280 0x7f98dc0b79e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 --2- 172.21.15.119:0/3143121201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0b13d0 0x7f98dc0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 >> 172.21.15.119:0/3143121201 conn(0x7f98dc09b930 msgr2=0x7f98dc15f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 shutdown_connections 2023-12-19T16:15:17.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.588+0000 7f98e349a640 1 -- 172.21.15.119:0/3143121201 wait complete. 2023-12-19T16:15:17.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:15:17.610 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:17.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.748+0000 7f965ee2a640 1 Processor -- start 2023-12-19T16:15:17.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.748+0000 7f965ee2a640 1 -- start start 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965ee2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f965806bdf0 0x7f96580c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965ee2a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f965806c1d0 0x7f965814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965ee2a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965815d8c0 con 0x7f96580cb810 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965ee2a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965815dba0 con 0x7f965806c1d0 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965ee2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965815de80 con 0x7f965806bdf0 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f965806c1d0 0x7f965814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f965806c1d0 0x7f965814ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60946/0 (socket says 172.21.15.119:60946) 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 -- 172.21.15.119:0/751434551 learned_addr learned my addr 172.21.15.119:0/751434551 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965de28640 1 --2- 172.21.15.119:0/751434551 >> v2:172.21.15.143:3300/0 conn(0x7f965806bdf0 0x7f96580c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 -- 172.21.15.119:0/751434551 >> v2:172.21.15.143:3300/0 conn(0x7f965806bdf0 msgr2=0x7f96580c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 --2- 172.21.15.119:0/751434551 >> v2:172.21.15.143:3300/0 conn(0x7f965806bdf0 0x7f96580c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 -- 172.21.15.119:0/751434551 >> v1:172.21.15.119:6789/0 conn(0x7f96580cb810 legacy=0x7f965815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965e629640 1 -- 172.21.15.119:0/751434551 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580c8880 con 0x7f965806c1d0 2023-12-19T16:15:17.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.752+0000 7f965ce26640 1 -- 172.21.15.119:0/751434551 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372454530 0 0) 0x7f965815d8c0 con 0x7f96580cb810 2023-12-19T16:15:17.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965e629640 1 --2- 172.21.15.119:0/751434551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965806c1d0 0x7f965814ff90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f965806de60 tx=0x7f965001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e35440d1d3a4dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ce26640 1 -- 172.21.15.119:0/751434551 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5860 con 0x7f965806c1d0 2023-12-19T16:15:17.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ce26640 1 -- 172.21.15.119:0/751434551 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500a59c0 con 0x7f965806c1d0 2023-12-19T16:15:17.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ce26640 1 -- 172.21.15.119:0/751434551 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5d50 con 0x7f965806c1d0 2023-12-19T16:15:17.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- 172.21.15.119:0/751434551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965806c1d0 msgr2=0x7f965814ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 --2- 172.21.15.119:0/751434551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965806c1d0 0x7f965814ff90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f965806de60 tx=0x7f965001c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- 172.21.15.119:0/751434551 shutdown_connections 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 --2- 172.21.15.119:0/751434551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965806c1d0 0x7f965814ff90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 --2- 172.21.15.119:0/751434551 >> v2:172.21.15.143:3300/0 conn(0x7f965806bdf0 0x7f96580c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- 172.21.15.119:0/751434551 >> 172.21.15.119:0/751434551 conn(0x7f965806a2a0 msgr2=0x7f96580cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- 172.21.15.119:0/751434551 shutdown_connections 2023-12-19T16:15:17.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- 172.21.15.119:0/751434551 wait complete. 2023-12-19T16:15:17.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 Processor -- start 2023-12-19T16:15:17.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- start start 2023-12-19T16:15:17.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965806bdf0 0x7f96580c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965806c1d0 0x7f96580c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 0x7f96580c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965813a050 con 0x7f96580cb810 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965813c630 con 0x7f965806bdf0 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.756+0000 7f965ee2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965813c910 con 0x7f965806c1d0 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 0x7f96580c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 0x7f96580c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60952/0 (socket says 172.21.15.119:60952) 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 -- 172.21.15.119:0/4093854808 learned_addr learned my addr 172.21.15.119:0/4093854808 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965de28640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965806bdf0 0x7f96580c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965d627640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965806c1d0 0x7f96580c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 -- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965806c1d0 msgr2=0x7f96580c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965806c1d0 0x7f96580c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 -- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965806bdf0 msgr2=0x7f96580c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965806bdf0 0x7f96580c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 -- 172.21.15.119:0/4093854808 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009b30 con 0x7f96580cb810 2023-12-19T16:15:17.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965de28640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965806bdf0 0x7f96580c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:17.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965e629640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 0x7f96580c0dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96500195b0 tx=0x7f9650019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500b8670 con 0x7f96580cb810 2023-12-19T16:15:17.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500b87f0 con 0x7f96580cb810 2023-12-19T16:15:17.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965813cbf0 con 0x7f96580cb810 2023-12-19T16:15:17.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500b8ba0 con 0x7f96580cb810 2023-12-19T16:15:17.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965814d8e0 con 0x7f96580cb810 2023-12-19T16:15:17.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965813a200 con 0x7f96580cb810 2023-12-19T16:15:17.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.760+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96500b8d00 con 0x7f96580cb810 2023-12-19T16:15:17.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.764+0000 7f964e7fc640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f963c065a60 0x7f963c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.764+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f965011e550 con 0x7f96580cb810 2023-12-19T16:15:17.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.764+0000 7f965de28640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f963c065a60 0x7f963c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.764+0000 7f965de28640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f963c065a60 0x7f963c067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f965400b9f0 tx=0x7f9654008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.768+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f965813a200 con 0x7f96580cb810 2023-12-19T16:15:17.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.916+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f965804e850 con 0x7f96580cb810 2023-12-19T16:15:17.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.916+0000 7f964e7fc640 1 -- 172.21.15.119:0/4093854808 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96500ec2f0 con 0x7f96580cb810 2023-12-19T16:15:17.919 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:15:17.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f963c065a60 msgr2=0x7f963c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f963c065a60 0x7f963c067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f965400b9f0 tx=0x7f9654008040 comp rx=0 tx=0).stop 2023-12-19T16:15:17.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 msgr2=0x7f96580c0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 0x7f96580c0dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96500195b0 tx=0x7f9650019740 comp rx=0 tx=0).stop 2023-12-19T16:15:17.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 shutdown_connections 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f963c065a60 0x7f963c067f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96580cb810 0x7f96580c0dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965806c1d0 0x7f96580c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 --2- 172.21.15.119:0/4093854808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965806bdf0 0x7f96580c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 >> 172.21.15.119:0/4093854808 conn(0x7f965806a2a0 msgr2=0x7f96580c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 shutdown_connections 2023-12-19T16:15:17.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:17.920+0000 7f965ee2a640 1 -- 172.21.15.119:0/4093854808 wait complete. 2023-12-19T16:15:17.939 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:15:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 Processor -- start 2023-12-19T16:15:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 -- start start 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98bc0cf0d0 0x7f98bc0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f98bc1648d0 0x7f98bc166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc0cfa70 con 0x7f98bc15ca40 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98bc0d11c0 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98c0f25640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98bc0d0310 con 0x7f98bc1648d0 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98ba59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f98bc15ca40 0x7f98bc0cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42698/0 (socket says 172.21.15.119:42698) 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98ba59c640 1 -- 172.21.15.119:0/3879514079 learned_addr learned my addr 172.21.15.119:0/3879514079 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98b3fff640 1 --2- 172.21.15.119:0/3879514079 >> v2:172.21.15.119:3300/0 conn(0x7f98bc0cf0d0 0x7f98bc0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98bad9d640 1 --2- 172.21.15.119:0/3879514079 >> v2:172.21.15.143:3300/0 conn(0x7f98bc1648d0 0x7f98bc166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98b3fff640 1 -- 172.21.15.119:0/3879514079 >> v2:172.21.15.143:3300/0 conn(0x7f98bc1648d0 msgr2=0x7f98bc166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98b3fff640 1 --2- 172.21.15.119:0/3879514079 >> v2:172.21.15.143:3300/0 conn(0x7f98bc1648d0 0x7f98bc166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98b3fff640 1 -- 172.21.15.119:0/3879514079 >> v1:172.21.15.119:6789/0 conn(0x7f98bc15ca40 legacy=0x7f98bc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98b3fff640 1 -- 172.21.15.119:0/3879514079 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0d05b0 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.076+0000 7f98b9d9b640 1 -- 172.21.15.119:0/3879514079 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122598041 0 0) 0x7f98bc0cfa70 con 0x7f98bc15ca40 2023-12-19T16:15:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98b3fff640 1 --2- 172.21.15.119:0/3879514079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc0cf530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98bc08ca20 tx=0x7f98a401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b452bd4e76d5a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98b9d9b640 1 -- 172.21.15.119:0/3879514079 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40ab610 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98b9d9b640 1 -- 172.21.15.119:0/3879514079 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40ab770 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98b9d9b640 1 -- 172.21.15.119:0/3879514079 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40abb00 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 -- 172.21.15.119:0/3879514079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 msgr2=0x7f98bc0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 --2- 172.21.15.119:0/3879514079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc0cf530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98bc08ca20 tx=0x7f98a401c410 comp rx=0 tx=0).stop 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 -- 172.21.15.119:0/3879514079 shutdown_connections 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 --2- 172.21.15.119:0/3879514079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc0cf530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 --2- 172.21.15.119:0/3879514079 >> v2:172.21.15.143:3300/0 conn(0x7f98bc1648d0 0x7f98bc166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 -- 172.21.15.119:0/3879514079 >> 172.21.15.119:0/3879514079 conn(0x7f98bc089fb0 msgr2=0x7f98bc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 -- 172.21.15.119:0/3879514079 shutdown_connections 2023-12-19T16:15:18.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.080+0000 7f98c0f25640 1 -- 172.21.15.119:0/3879514079 wait complete. 2023-12-19T16:15:18.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 Processor -- start 2023-12-19T16:15:18.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 -- start start 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98bc15ca40 0x7f98bc0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98bc1648d0 0x7f98bc165d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc158280 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0cac30 con 0x7f98bc1648d0 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0c9d50 con 0x7f98bc15ca40 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60960/0 (socket says 172.21.15.119:60960) 2023-12-19T16:15:18.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 -- 172.21.15.119:0/239985483 learned_addr learned my addr 172.21.15.119:0/239985483 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:18.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 -- 172.21.15.119:0/239985483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98bc15ca40 msgr2=0x7f98bc0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98bc15ca40 0x7f98bc0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 -- 172.21.15.119:0/239985483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98bc1648d0 msgr2=0x7f98bc165d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98bc1648d0 0x7f98bc165d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 -- 172.21.15.119:0/239985483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40093b0 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98ba59c640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc157d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00c430 tx=0x7f98ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0074e0 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac007640 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc0ca020 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0059d0 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.084+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98bc0ca5e0 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.088+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98bc0d1630 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.088+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98ac005b30 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.088+0000 7f98b2ffd640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f989c065a90 0x7f989c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.088+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98ac082520 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.088+0000 7f98b3fff640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f989c065a90 0x7f989c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.088+0000 7f98b3fff640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f989c065a90 0x7f989c067f50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98a40af000 tx=0x7f98a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.095 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.092+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98bc0d1630 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.222 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:18.227 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:18.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.248+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98bc0d1630 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.248+0000 7f98b2ffd640 1 -- 172.21.15.119:0/239985483 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f98bc0d1630 con 0x7f98bc0cf0d0 2023-12-19T16:15:18.250 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:18.250 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2023-12-19T16:15:18.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:15:18.251 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2023-12-19T16:15:18.251 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2023-12-19T16:15:18.251 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:15:18.251 INFO:teuthology.orchestra.run.smithi119.stdout:] 2023-12-19T16:15:18.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f989c065a90 msgr2=0x7f989c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f989c065a90 0x7f989c067f50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98a40af000 tx=0x7f98a4008040 comp rx=0 tx=0).stop 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 msgr2=0x7f98bc157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc157d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00c430 tx=0x7f98ac00c8f0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 shutdown_connections 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f989c065a90 0x7f989c067f50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98bc1648d0 0x7f98bc165d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98bc15ca40 0x7f98bc0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 --2- 172.21.15.119:0/239985483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98bc0cf0d0 0x7f98bc157d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 >> 172.21.15.119:0/239985483 conn(0x7f98bc089fb0 msgr2=0x7f98bc15bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 shutdown_connections 2023-12-19T16:15:18.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.252+0000 7f98c0f25640 1 -- 172.21.15.119:0/239985483 wait complete. 2023-12-19T16:15:18.272 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:15:18.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:15:18.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.456+0000 7fed3355a640 1 Processor -- start 2023-12-19T16:15:18.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed3355a640 1 -- start start 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed3355a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed2c06c280 0x7fed2c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed3355a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0cc670 con 0x7fed2c0cd910 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed3355a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0cc950 con 0x7fed2c0c9e20 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed3355a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c1598c0 con 0x7fed2c06c280 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed32d59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed2c06c280 0x7fed2c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed31d57640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fed2c0cd910 0x7fed2c06bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42708/0 (socket says 172.21.15.119:42708) 2023-12-19T16:15:18.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed31d57640 1 -- 172.21.15.119:0/3245463501 learned_addr learned my addr 172.21.15.119:0/3245463501 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:18.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed32d59640 1 -- 172.21.15.119:0/3245463501 >> v1:172.21.15.143:6789/0 conn(0x7fed2c0c9e20 legacy=0x7fed2c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:18.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed31556640 1 -- 172.21.15.119:0/3245463501 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531036867 0 0) 0x7fed2c0cc670 con 0x7fed2c0cd910 2023-12-19T16:15:18.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed32d59640 1 -- 172.21.15.119:0/3245463501 >> v1:172.21.15.119:6789/0 conn(0x7fed2c0cd910 legacy=0x7fed2c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.460+0000 7fed32d59640 1 -- 172.21.15.119:0/3245463501 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c159ab0 con 0x7fed2c06c280 2023-12-19T16:15:18.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed32d59640 1 --2- 172.21.15.119:0/3245463501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c06c280 0x7fed2c15a2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed24009dc0 tx=0x7fed2401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbddf7e7e4082ef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed31556640 1 -- 172.21.15.119:0/3245463501 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240a5900 con 0x7fed2c06c280 2023-12-19T16:15:18.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed31556640 1 -- 172.21.15.119:0/3245463501 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240a5a60 con 0x7fed2c06c280 2023-12-19T16:15:18.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed31556640 1 -- 172.21.15.119:0/3245463501 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240a5df0 con 0x7fed2c06c280 2023-12-19T16:15:18.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 -- 172.21.15.119:0/3245463501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c06c280 msgr2=0x7fed2c15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 --2- 172.21.15.119:0/3245463501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c06c280 0x7fed2c15a2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed24009dc0 tx=0x7fed2401c930 comp rx=0 tx=0).stop 2023-12-19T16:15:18.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 -- 172.21.15.119:0/3245463501 shutdown_connections 2023-12-19T16:15:18.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 --2- 172.21.15.119:0/3245463501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c06c280 0x7fed2c15a2b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 -- 172.21.15.119:0/3245463501 >> 172.21.15.119:0/3245463501 conn(0x7fed2c06a2a0 msgr2=0x7fed2c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:18.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 -- 172.21.15.119:0/3245463501 shutdown_connections 2023-12-19T16:15:18.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 -- 172.21.15.119:0/3245463501 wait complete. 2023-12-19T16:15:18.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 Processor -- start 2023-12-19T16:15:18.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.464+0000 7fed3355a640 1 -- start start 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed2c06c280 0x7fed2c0c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 0x7fed2c0c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed2c0cd910 0x7fed2c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0b1090 con 0x7fed2c0c9e20 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0c4430 con 0x7fed2c0cd910 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0c4710 con 0x7fed2c06c280 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 0x7fed2c0c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 0x7fed2c0c1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60976/0 (socket says 172.21.15.119:60976) 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 -- 172.21.15.119:0/758477216 learned_addr learned my addr 172.21.15.119:0/758477216 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed32d59640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed2c0cd910 0x7fed2c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed32558640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed2c06c280 0x7fed2c0c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 -- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed2c06c280 msgr2=0x7fed2c0c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed2c06c280 0x7fed2c0c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 -- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed2c0cd910 msgr2=0x7fed2c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed2c0cd910 0x7fed2c0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 -- 172.21.15.119:0/758477216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24009a70 con 0x7fed2c0c9e20 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed32558640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed2c06c280 0x7fed2c0c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:18.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed31d57640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 0x7fed2c0c1c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c410 tx=0x7fed1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0074e0 con 0x7fed2c0c9e20 2023-12-19T16:15:18.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c007640 con 0x7fed2c0c9e20 2023-12-19T16:15:18.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c004a30 con 0x7fed2c0c9e20 2023-12-19T16:15:18.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c0c49f0 con 0x7fed2c0c9e20 2023-12-19T16:15:18.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c0c10c0 con 0x7fed2c0c9e20 2023-12-19T16:15:18.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.468+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c0b1240 con 0x7fed2c0c9e20 2023-12-19T16:15:18.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.472+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed1c004b90 con 0x7fed2c0c9e20 2023-12-19T16:15:18.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.472+0000 7fed22ffd640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fed10065a60 0x7fed10067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.472+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed1c082be0 con 0x7fed2c0c9e20 2023-12-19T16:15:18.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.472+0000 7fed32558640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fed10065a60 0x7fed10067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.472+0000 7fed32558640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fed10065a60 0x7fed10067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed28000f70 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.476+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fed2c0b1240 con 0x7fed2c0c9e20 2023-12-19T16:15:18.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:18.628+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fed2c04e000 con 0x7fed2c0c9e20 2023-12-19T16:15:19.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.164+0000 7fed22ffd640 1 -- 172.21.15.119:0/758477216 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fed1c050850 con 0x7fed2c0c9e20 2023-12-19T16:15:19.166 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fed10065a60 msgr2=0x7fed10067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fed10065a60 0x7fed10067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed28000f70 tx=0x7fed28009040 comp rx=0 tx=0).stop 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 msgr2=0x7fed2c0c1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 0x7fed2c0c1c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c410 tx=0x7fed1c00c8d0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 shutdown_connections 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fed10065a60 0x7fed10067f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed2c0cd910 0x7fed2c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed2c0c9e20 0x7fed2c0c1c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 --2- 172.21.15.119:0/758477216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed2c06c280 0x7fed2c0c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 >> 172.21.15.119:0/758477216 conn(0x7fed2c06a2a0 msgr2=0x7fed2c070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 shutdown_connections 2023-12-19T16:15:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.168+0000 7fed3355a640 1 -- 172.21.15.119:0/758477216 wait complete. 2023-12-19T16:15:19.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-19T16:15:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 Processor -- start 2023-12-19T16:15:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 -- start start 2023-12-19T16:15:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2e40702d0 0x7fd2e40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415b530 0x7fd2e415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4155410 con 0x7fd2e415e4f0 2023-12-19T16:15:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4070bf0 con 0x7fd2e40702d0 2023-12-19T16:15:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2ea6c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e415ea60 con 0x7fd2e415b530 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2e3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2e40702d0 0x7fd2e40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2e3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2e40702d0 0x7fd2e40706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60990/0 (socket says 172.21.15.119:60990) 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2e3fff640 1 -- 172.21.15.119:0/669593647 learned_addr learned my addr 172.21.15.119:0/669593647 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2e8c61640 1 --2- 172.21.15.119:0/669593647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415b530 0x7fd2e415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2e3fff640 1 -- 172.21.15.119:0/669593647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415b530 msgr2=0x7fd2e415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.336+0000 7fd2e3fff640 1 --2- 172.21.15.119:0/669593647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415b530 0x7fd2e415b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2e3fff640 1 -- 172.21.15.119:0/669593647 >> v1:172.21.15.143:6789/0 conn(0x7fd2e415e4f0 legacy=0x7fd2e40cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2e3fff640 1 -- 172.21.15.119:0/669593647 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e415ed40 con 0x7fd2e40702d0 2023-12-19T16:15:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2e3fff640 1 --2- 172.21.15.119:0/669593647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e40702d0 0x7fd2e40706b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40098a0 tx=0x7fd2d401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b41ca31cb96f0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2e2ffd640 1 -- 172.21.15.119:0/669593647 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40ab670 con 0x7fd2e40702d0 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2e2ffd640 1 -- 172.21.15.119:0/669593647 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d40ab7d0 con 0x7fd2e40702d0 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2e2ffd640 1 -- 172.21.15.119:0/669593647 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40abb60 con 0x7fd2e40702d0 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/669593647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e40702d0 msgr2=0x7fd2e40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/669593647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e40702d0 0x7fd2e40706b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40098a0 tx=0x7fd2d401c4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/669593647 shutdown_connections 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/669593647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415b530 0x7fd2e415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/669593647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e40702d0 0x7fd2e40706b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/669593647 >> 172.21.15.119:0/669593647 conn(0x7fd2e40ce450 msgr2=0x7fd2e40ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:19.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/669593647 shutdown_connections 2023-12-19T16:15:19.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.340+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/669593647 wait complete. 2023-12-19T16:15:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 Processor -- start 2023-12-19T16:15:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 -- start start 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2e40702d0 0x7fd2e4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 0x7fd2e40c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415e4f0 0x7fd2e40c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40c8150 con 0x7fd2e415b530 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40c5720 con 0x7fd2e40702d0 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40c4d50 con 0x7fd2e415e4f0 2023-12-19T16:15:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 0x7fd2e40c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 0x7fd2e40c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32770/0 (socket says 172.21.15.119:32770) 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 -- 172.21.15.119:0/2344934232 learned_addr learned my addr 172.21.15.119:0/2344934232 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e3fff640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2e40702d0 0x7fd2e4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e8c61640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415e4f0 0x7fd2e40c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 -- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415e4f0 msgr2=0x7fd2e40c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415e4f0 0x7fd2e40c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 -- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2e40702d0 msgr2=0x7fd2e4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2e40702d0 0x7fd2e4154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 -- 172.21.15.119:0/2344934232 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40094d0 con 0x7fd2e415b530 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e37fe640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 0x7fd2e40c41c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b410 tx=0x7fd2d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8004020 con 0x7fd2e415b530 2023-12-19T16:15:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8004180 con 0x7fd2e415b530 2023-12-19T16:15:19.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e40c7820 con 0x7fd2e415b530 2023-12-19T16:15:19.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8011630 con 0x7fd2e415b530 2023-12-19T16:15:19.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.344+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e40c7de0 con 0x7fd2e415b530 2023-12-19T16:15:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.348+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e404e000 con 0x7fd2e415b530 2023-12-19T16:15:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.348+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd2d8011790 con 0x7fd2e415b530 2023-12-19T16:15:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.348+0000 7fd2e0ff9640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd2d0065a60 0x7fd2d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.348+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd2d8082bd0 con 0x7fd2e415b530 2023-12-19T16:15:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.348+0000 7fd2e3fff640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd2d0065a60 0x7fd2d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.348+0000 7fd2e3fff640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd2d0065a60 0x7fd2d0067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40af000 tx=0x7fd2d40b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:19.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.352+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd2d8050810 con 0x7fd2e415b530 2023-12-19T16:15:19.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:19.504+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd2e4154c40 con 0x7fd2e415b530 2023-12-19T16:15:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.172+0000 7fd2e0ff9640 1 -- 172.21.15.119:0/2344934232 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd2d8053e30 con 0x7fd2e415b530 2023-12-19T16:15:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2023-12-19T16:15:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.176+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd2d0065a60 msgr2=0x7fd2d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.176+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd2d0065a60 0x7fd2d0067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40af000 tx=0x7fd2d40b6040 comp rx=0 tx=0).stop 2023-12-19T16:15:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.176+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 msgr2=0x7fd2e40c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.176+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 0x7fd2e40c41c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b410 tx=0x7fd2d800b8d0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.180+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 shutdown_connections 2023-12-19T16:15:20.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.180+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd2d0065a60 0x7fd2d0067f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.180+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2e415e4f0 0x7fd2e40c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.180+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e415b530 0x7fd2e40c41c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.180+0000 7fd2ea6c4640 1 --2- 172.21.15.119:0/2344934232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2e40702d0 0x7fd2e4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.180+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 >> 172.21.15.119:0/2344934232 conn(0x7fd2e40ce450 msgr2=0x7fd2e415cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:20.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.184+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 shutdown_connections 2023-12-19T16:15:20.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.184+0000 7fd2ea6c4640 1 -- 172.21.15.119:0/2344934232 wait complete. 2023-12-19T16:15:20.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:15:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 Processor -- start 2023-12-19T16:15:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 -- start start 2023-12-19T16:15:20.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78c815cae0 0x7f78c80d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f78c80cf880 0x7f78c80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c815cec0 con 0x7f78c80cde90 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c80d0530 con 0x7f78c815cae0 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78ce760640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c80d0810 con 0x7f78c80cf880 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78c815cae0 0x7f78c80d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78c815cae0 0x7f78c80d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32774/0 (socket says 172.21.15.119:32774) 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 -- 172.21.15.119:0/129748148 learned_addr learned my addr 172.21.15.119:0/129748148 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78cccfd640 1 --2- 172.21.15.119:0/129748148 >> v2:172.21.15.143:3300/0 conn(0x7f78c80cf880 0x7f78c80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 -- 172.21.15.119:0/129748148 >> v2:172.21.15.143:3300/0 conn(0x7f78c80cf880 msgr2=0x7f78c80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 --2- 172.21.15.119:0/129748148 >> v2:172.21.15.143:3300/0 conn(0x7f78c80cf880 0x7f78c80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 -- 172.21.15.119:0/129748148 >> v1:172.21.15.119:6789/0 conn(0x7f78c80cde90 legacy=0x7f78c80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c7fff640 1 -- 172.21.15.119:0/129748148 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c80d0af0 con 0x7f78c815cae0 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78cccfd640 1 --2- 172.21.15.119:0/129748148 >> v2:172.21.15.143:3300/0 conn(0x7f78c80cf880 0x7f78c80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:20.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.356+0000 7f78c6ffd640 1 -- 172.21.15.119:0/129748148 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040550005 0 0) 0x7f78c815cec0 con 0x7f78c80cde90 2023-12-19T16:15:20.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78c7fff640 1 --2- 172.21.15.119:0/129748148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c815cae0 0x7f78c80d12f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f78c808bf80 tx=0x7f78b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e95a380c9eea417 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:20.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78c6ffd640 1 -- 172.21.15.119:0/129748148 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80ab660 con 0x7f78c815cae0 2023-12-19T16:15:20.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78c6ffd640 1 -- 172.21.15.119:0/129748148 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b80ab7c0 con 0x7f78c815cae0 2023-12-19T16:15:20.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78c6ffd640 1 -- 172.21.15.119:0/129748148 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80abb50 con 0x7f78c815cae0 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 -- 172.21.15.119:0/129748148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c815cae0 msgr2=0x7f78c80d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 --2- 172.21.15.119:0/129748148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c815cae0 0x7f78c80d12f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f78c808bf80 tx=0x7f78b801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 -- 172.21.15.119:0/129748148 shutdown_connections 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 --2- 172.21.15.119:0/129748148 >> v2:172.21.15.143:3300/0 conn(0x7f78c80cf880 0x7f78c80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 --2- 172.21.15.119:0/129748148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c815cae0 0x7f78c80d12f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 -- 172.21.15.119:0/129748148 >> 172.21.15.119:0/129748148 conn(0x7f78c8089fb0 msgr2=0x7f78c80d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:20.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 -- 172.21.15.119:0/129748148 shutdown_connections 2023-12-19T16:15:20.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.360+0000 7f78ce760640 1 -- 172.21.15.119:0/129748148 wait complete. 2023-12-19T16:15:20.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 Processor -- start 2023-12-19T16:15:20.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- start start 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78c80cde90 0x7f78c80b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 0x7f78c80b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78c815cae0 0x7f78c8155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80b5b70 con 0x7f78c80cf880 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80c99e0 con 0x7f78c815cae0 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80b58d0 con 0x7f78c80cde90 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 0x7f78c80b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 0x7f78c80b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32780/0 (socket says 172.21.15.119:32780) 2023-12-19T16:15:20.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 -- 172.21.15.119:0/370874392 learned_addr learned my addr 172.21.15.119:0/370874392 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 -- 172.21.15.119:0/370874392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78c80cde90 msgr2=0x7f78c80b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78c80cde90 0x7f78c80b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 -- 172.21.15.119:0/370874392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78c815cae0 msgr2=0x7f78c8155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78c815cae0 0x7f78c8155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 -- 172.21.15.119:0/370874392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009480 con 0x7f78c80cf880 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c77fe640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 0x7f78c80b5390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c4d0 tx=0x7f78bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc005480 con 0x7f78c80cf880 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc003600 con 0x7f78c80cf880 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c80c9c80 con 0x7f78c80cf880 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0039b0 con 0x7f78c80cf880 2023-12-19T16:15:20.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c80ca240 con 0x7f78c80cf880 2023-12-19T16:15:20.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.364+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c80ca460 con 0x7f78c80cf880 2023-12-19T16:15:20.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.368+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78bc003b10 con 0x7f78c80cf880 2023-12-19T16:15:20.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.368+0000 7f78c4ff9640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78b4065a60 0x7f78b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.368+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f78bc082750 con 0x7f78c80cf880 2023-12-19T16:15:20.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.368+0000 7f78c7fff640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78b4065a60 0x7f78b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.368+0000 7f78c7fff640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78b4065a60 0x7f78b4067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78b80af000 tx=0x7f78b8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:20.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.372+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78bc050220 con 0x7f78c80cf880 2023-12-19T16:15:20.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.556+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78c804e000 con 0x7f78c80cf880 2023-12-19T16:15:20.566 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.564+0000 7f78c4ff9640 1 -- 172.21.15.119:0/370874392 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f78bc017020 con 0x7f78c80cf880 2023-12-19T16:15:20.570 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T16:15:20.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78b4065a60 msgr2=0x7f78b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78b4065a60 0x7f78b4067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78b80af000 tx=0x7f78b8004740 comp rx=0 tx=0).stop 2023-12-19T16:15:20.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 msgr2=0x7f78c80b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 0x7f78c80b5390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c4d0 tx=0x7f78bc00c990 comp rx=0 tx=0).stop 2023-12-19T16:15:20.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 shutdown_connections 2023-12-19T16:15:20.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78b4065a60 0x7f78b4067f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78c815cae0 0x7f78c8155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78c80cf880 0x7f78c80b5390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 --2- 172.21.15.119:0/370874392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78c80cde90 0x7f78c80b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 >> 172.21.15.119:0/370874392 conn(0x7f78c8089fb0 msgr2=0x7f78c80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:20.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.568+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 shutdown_connections 2023-12-19T16:15:20.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.572+0000 7f78ce760640 1 -- 172.21.15.119:0/370874392 wait complete. 2023-12-19T16:15:20.620 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-19T16:15:20.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-19T16:15:20.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 Processor -- start 2023-12-19T16:15:20.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 -- start start 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70440d07c0 0x7f70440d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f704406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440af360 con 0x7f704415cab0 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440d1740 con 0x7f70440d07c0 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f704958f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ce6b0 con 0x7f70440d12b0 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70440d07c0 0x7f70440d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70440d07c0 0x7f70440d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32786/0 (socket says 172.21.15.119:32786) 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 -- 172.21.15.119:0/1851978809 learned_addr learned my addr 172.21.15.119:0/1851978809 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:20.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f70437fe640 1 --2- 172.21.15.119:0/1851978809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f704406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 -- 172.21.15.119:0/1851978809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 msgr2=0x7f704406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:20.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 --2- 172.21.15.119:0/1851978809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f704406bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 -- 172.21.15.119:0/1851978809 >> v1:172.21.15.143:6789/0 conn(0x7f704415cab0 legacy=0x7f70440cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f703bfff640 1 -- 172.21.15.119:0/1851978809 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704406ae90 con 0x7f70440d07c0 2023-12-19T16:15:20.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.764+0000 7f70427fc640 1 -- 172.21.15.119:0/1851978809 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219344587 0 0) 0x7f70440af360 con 0x7f704415cab0 2023-12-19T16:15:20.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f703bfff640 1 --2- 172.21.15.119:0/1851978809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440d0d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f702c009870 tx=0x7f702c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4161851fd3c5b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:20.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f70427fc640 1 -- 172.21.15.119:0/1851978809 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a7070 con 0x7f70440d07c0 2023-12-19T16:15:20.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f70427fc640 1 -- 172.21.15.119:0/1851978809 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c0ab430 con 0x7f70440d07c0 2023-12-19T16:15:20.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f70427fc640 1 -- 172.21.15.119:0/1851978809 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0ab7c0 con 0x7f70440d07c0 2023-12-19T16:15:20.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 -- 172.21.15.119:0/1851978809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 msgr2=0x7f70440d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 --2- 172.21.15.119:0/1851978809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440d0d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f702c009870 tx=0x7f702c01c540 comp rx=0 tx=0).stop 2023-12-19T16:15:20.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 -- 172.21.15.119:0/1851978809 shutdown_connections 2023-12-19T16:15:20.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 --2- 172.21.15.119:0/1851978809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f704406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 --2- 172.21.15.119:0/1851978809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440d0d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 -- 172.21.15.119:0/1851978809 >> 172.21.15.119:0/1851978809 conn(0x7f7044089fb0 msgr2=0x7f70440d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:20.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 -- 172.21.15.119:0/1851978809 shutdown_connections 2023-12-19T16:15:20.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 -- 172.21.15.119:0/1851978809 wait complete. 2023-12-19T16:15:20.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 Processor -- start 2023-12-19T16:15:20.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.768+0000 7f704958f640 1 -- start start 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f70440cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f704415cab0 0x7f70440c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044154d40 con 0x7f70440d07c0 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704415f070 con 0x7f704415cab0 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704415f350 con 0x7f70440d12b0 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32802/0 (socket says 172.21.15.119:32802) 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 -- 172.21.15.119:0/2350086691 learned_addr learned my addr 172.21.15.119:0/2350086691 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f703bfff640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f70440cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f70437fe640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f704415cab0 0x7f70440c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 -- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 msgr2=0x7f70440cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f70440cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 -- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f704415cab0 msgr2=0x7f70440c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:20.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f704415cab0 0x7f70440c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:20.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 -- 172.21.15.119:0/2350086691 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0094d0 con 0x7f70440d07c0 2023-12-19T16:15:20.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f7042ffd640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440cbb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7034001ec0 tx=0x7f703400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:20.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340054e0 con 0x7f70440d07c0 2023-12-19T16:15:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034003600 con 0x7f70440d07c0 2023-12-19T16:15:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704415f630 con 0x7f70440d07c0 2023-12-19T16:15:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340039b0 con 0x7f70440d07c0 2023-12-19T16:15:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7044154980 con 0x7f70440d07c0 2023-12-19T16:15:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.772+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704404e070 con 0x7f70440d07c0 2023-12-19T16:15:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.776+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7034003b10 con 0x7f70440d07c0 2023-12-19T16:15:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.776+0000 7f703b7fe640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7024065a90 0x7f7024067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.776+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7034082660 con 0x7f70440d07c0 2023-12-19T16:15:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.776+0000 7f703bfff640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7024065a90 0x7f7024067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.776+0000 7f703bfff640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7024065a90 0x7f7024067f50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f702c0af000 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:20.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.780+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f70340500d0 con 0x7f70440d07c0 2023-12-19T16:15:20.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:20.936+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f704415fae0 con 0x7f70440d07c0 2023-12-19T16:15:21.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.568+0000 7f703b7fe640 1 -- 172.21.15.119:0/2350086691 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f70340170e0 con 0x7f70440d07c0 2023-12-19T16:15:21.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7024065a90 msgr2=0x7f7024067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7024065a90 0x7f7024067f50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f702c0af000 tx=0x7f702c008040 comp rx=0 tx=0).stop 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 msgr2=0x7f70440cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440cbb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7034001ec0 tx=0x7f703400c8e0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 shutdown_connections 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7024065a90 0x7f7024067f50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f704415cab0 0x7f70440c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70440d12b0 0x7f70440cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 --2- 172.21.15.119:0/2350086691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d07c0 0x7f70440cbb60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 >> 172.21.15.119:0/2350086691 conn(0x7f7044089fb0 msgr2=0x7f70440b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 shutdown_connections 2023-12-19T16:15:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.572+0000 7f704958f640 1 -- 172.21.15.119:0/2350086691 wait complete. 2023-12-19T16:15:21.595 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:15:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 Processor -- start 2023-12-19T16:15:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 -- start start 2023-12-19T16:15:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff49c15e020 0x7ff49c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 0x7ff49c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0cdf90 con 0x7ff49c0afed0 2023-12-19T16:15:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0cc820 con 0x7ff49c15e020 2023-12-19T16:15:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff4a08c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15b4a0 con 0x7ff49c070750 2023-12-19T16:15:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff49ad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff49c0afed0 0x7ff49c0ccd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42716/0 (socket says 172.21.15.119:42716) 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff49ad9d640 1 -- 172.21.15.119:0/3206678940 learned_addr learned my addr 172.21.15.119:0/3206678940 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff491d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 0x7ff49c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff49a59c640 1 --2- 172.21.15.119:0/3206678940 >> v2:172.21.15.143:3300/0 conn(0x7ff49c15e020 0x7ff49c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683282446 0 0) 0x7ff49c0cdf90 con 0x7ff49c0afed0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff488003530 con 0x7ff49c0afed0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2023137610 0 0) 0x7ff488003530 con 0x7ff49c0afed0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 msgr2=0x7ff49c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 0x7ff49c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 >> v2:172.21.15.143:3300/0 conn(0x7ff49c15e020 msgr2=0x7ff49c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 --2- 172.21.15.119:0/3206678940 >> v2:172.21.15.143:3300/0 conn(0x7ff49c15e020 0x7ff49c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c15b780 con 0x7ff49c0afed0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7ff494001680 con 0x7ff49c0afed0 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 >> v1:172.21.15.119:6789/0 conn(0x7ff49c0afed0 legacy=0x7ff49c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880039f0 0x7ff488003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4880047d0 0x7ff488004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 0x7ff488005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0cc820 con 0x7ff4880047d0 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15b4a0 con 0x7ff4880039f0 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.740+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48800b990 con 0x7ff49c070750 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4880047d0 0x7ff488004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff49a59c640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880039f0 0x7ff488003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff49ad9d640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 0x7ff488005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 -- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 msgr2=0x7ff488005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c070750 0x7ff488005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 -- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880039f0 msgr2=0x7ff488003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880039f0 0x7ff488003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 -- 172.21.15.119:0/3206678940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488003530 con 0x7ff4880047d0 2023-12-19T16:15:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff491d9b640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4880047d0 0x7ff488004c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff484009b10 tx=0x7ff48401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e589c4c15985605f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840a5560 con 0x7ff4880047d0 2023-12-19T16:15:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4840a56c0 con 0x7ff4880047d0 2023-12-19T16:15:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.744+0000 7ff499d9b640 1 -- 172.21.15.119:0/3206678940 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840a5a70 con 0x7ff4880047d0 2023-12-19T16:15:21.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- 172.21.15.119:0/3206678940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4880047d0 msgr2=0x7ff488004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:21.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/3206678940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4880047d0 0x7ff488004c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff484009b10 tx=0x7ff48401ca50 comp rx=0 tx=0).stop 2023-12-19T16:15:21.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff49ad9d640 1 -- 172.21.15.119:0/3206678940 reap_dead start 2023-12-19T16:15:21.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- 172.21.15.119:0/3206678940 shutdown_connections 2023-12-19T16:15:21.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- 172.21.15.119:0/3206678940 >> 172.21.15.119:0/3206678940 conn(0x7ff49c0ce450 msgr2=0x7ff49c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:21.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- 172.21.15.119:0/3206678940 shutdown_connections 2023-12-19T16:15:21.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- 172.21.15.119:0/3206678940 wait complete. 2023-12-19T16:15:21.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 Processor -- start 2023-12-19T16:15:21.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- start start 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880047d0 0x7ff49c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 0x7ff49c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c1f2400 0x7ff49c1f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b0d20 con 0x7ff49c0b0360 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1f3130 con 0x7ff4880047d0 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff4a08c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c75b0 con 0x7ff49c1f2400 2023-12-19T16:15:21.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff491d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 0x7ff49c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff491d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 0x7ff49c0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32818/0 (socket says 172.21.15.119:32818) 2023-12-19T16:15:21.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff491d9b640 1 -- 172.21.15.119:0/2148587875 learned_addr learned my addr 172.21.15.119:0/2148587875 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:21.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff49a59c640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880047d0 0x7ff49c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.748+0000 7ff49ad9d640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c1f2400 0x7ff49c1f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff491d9b640 1 -- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c1f2400 msgr2=0x7ff49c1f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:21.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff491d9b640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c1f2400 0x7ff49c1f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff491d9b640 1 -- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880047d0 msgr2=0x7ff49c0aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:21.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff491d9b640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880047d0 0x7ff49c0aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:21.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff491d9b640 1 -- 172.21.15.119:0/2148587875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0c7890 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff491d9b640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 0x7ff49c0b07e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff484009b10 tx=0x7ff488005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840bc070 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4840a5e50 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0c7b70 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840a5560 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c1f2df0 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c04e000 con 0x7ff49c0b0360 2023-12-19T16:15:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4840b4040 con 0x7ff49c0b0360 2023-12-19T16:15:21.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4937fe640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff47c065a90 0x7ff47c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:21.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.752+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff48411c9b0 con 0x7ff49c0b0360 2023-12-19T16:15:21.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.756+0000 7ff49a59c640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff47c065a90 0x7ff47c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:21.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.756+0000 7ff49a59c640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff47c065a90 0x7ff47c067f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff48c014450 tx=0x7ff48c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.760+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff4840ea330 con 0x7ff49c0b0360 2023-12-19T16:15:21.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:21.908+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff49c0b26e0 con 0x7ff49c0b0360 2023-12-19T16:15:23.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.576+0000 7ff4937fe640 1 -- 172.21.15.119:0/2148587875 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff4840ed950 con 0x7ff49c0b0360 2023-12-19T16:15:23.578 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data_ec' created 2023-12-19T16:15:23.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff47c065a90 msgr2=0x7ff47c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:23.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff47c065a90 0x7ff47c067f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff48c014450 tx=0x7ff48c00b040 comp rx=0 tx=0).stop 2023-12-19T16:15:23.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 msgr2=0x7ff49c0b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:23.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 0x7ff49c0b07e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff484009b10 tx=0x7ff488005800 comp rx=0 tx=0).stop 2023-12-19T16:15:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 shutdown_connections 2023-12-19T16:15:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff47c065a90 0x7ff47c067f50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49c1f2400 0x7ff49c1f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff49c0b0360 0x7ff49c0b07e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 --2- 172.21.15.119:0/2148587875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4880047d0 0x7ff49c0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.584+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 >> 172.21.15.119:0/2148587875 conn(0x7ff49c0ce450 msgr2=0x7ff49c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:23.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.588+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 shutdown_connections 2023-12-19T16:15:23.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.588+0000 7ff4a08c4640 1 -- 172.21.15.119:0/2148587875 wait complete. 2023-12-19T16:15:23.615 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-19T16:15:23.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.756+0000 7fad11ac3640 1 Processor -- start 2023-12-19T16:15:23.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.756+0000 7fad11ac3640 1 -- start start 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad11ac3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad11ac3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad0c0b2860 0x7fad0c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad11ac3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c0cb730 con 0x7fad0c0719b0 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad11ac3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c06cbb0 con 0x7fad0c0b2860 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad11ac3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0cd2a0 con 0x7fad0c0cad70 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fad0c0719b0 0x7fad0c0ce5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60920/0 (socket says 172.21.15.119:60920) 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0b7fe640 1 -- 172.21.15.119:0/1568636632 learned_addr learned my addr 172.21.15.119:0/1568636632 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0affd640 1 --2- 172.21.15.119:0/1568636632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0bfff640 1 --2- 172.21.15.119:0/1568636632 >> v2:172.21.15.143:3300/0 conn(0x7fad0c0b2860 0x7fad0c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:23.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0a7fc640 1 -- 172.21.15.119:0/1568636632 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419280153 0 0) 0x7fad0c0cb730 con 0x7fad0c0719b0 2023-12-19T16:15:23.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0a7fc640 1 -- 172.21.15.119:0/1568636632 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf4003530 con 0x7fad0c0719b0 2023-12-19T16:15:23.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0affd640 1 -- 172.21.15.119:0/1568636632 >> v2:172.21.15.143:3300/0 conn(0x7fad0c0b2860 msgr2=0x7fad0c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:23.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0affd640 1 --2- 172.21.15.119:0/1568636632 >> v2:172.21.15.143:3300/0 conn(0x7fad0c0b2860 0x7fad0c0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0affd640 1 -- 172.21.15.119:0/1568636632 >> v1:172.21.15.119:6789/0 conn(0x7fad0c0719b0 legacy=0x7fad0c0ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:23.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.760+0000 7fad0affd640 1 -- 172.21.15.119:0/1568636632 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c06bf30 con 0x7fad0c0cad70 2023-12-19T16:15:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad0affd640 1 --2- 172.21.15.119:0/1568636632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c0cb1f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad000097c0 tx=0x7fad0001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6e55d5cbd42369 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad0a7fc640 1 -- 172.21.15.119:0/1568636632 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000ab600 con 0x7fad0c0cad70 2023-12-19T16:15:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad0a7fc640 1 -- 172.21.15.119:0/1568636632 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad000a7050 con 0x7fad0c0cad70 2023-12-19T16:15:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad0a7fc640 1 -- 172.21.15.119:0/1568636632 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000ab980 con 0x7fad0c0cad70 2023-12-19T16:15:23.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 -- 172.21.15.119:0/1568636632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 msgr2=0x7fad0c0cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:23.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 --2- 172.21.15.119:0/1568636632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c0cb1f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad000097c0 tx=0x7fad0001c480 comp rx=0 tx=0).stop 2023-12-19T16:15:23.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 -- 172.21.15.119:0/1568636632 shutdown_connections 2023-12-19T16:15:23.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 --2- 172.21.15.119:0/1568636632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c0cb1f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 --2- 172.21.15.119:0/1568636632 >> v2:172.21.15.143:3300/0 conn(0x7fad0c0b2860 0x7fad0c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 -- 172.21.15.119:0/1568636632 >> 172.21.15.119:0/1568636632 conn(0x7fad0c069e70 msgr2=0x7fad0c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:23.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 -- 172.21.15.119:0/1568636632 shutdown_connections 2023-12-19T16:15:23.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 -- 172.21.15.119:0/1568636632 wait complete. 2023-12-19T16:15:23.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 Processor -- start 2023-12-19T16:15:23.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.764+0000 7fad11ac3640 1 -- start start 2023-12-19T16:15:23.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0719b0 0x7fad0c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 0x7fad0c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c150b20 con 0x7fad0c0b2860 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c158960 con 0x7fad0c0719b0 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c155f40 con 0x7fad0c0cad70 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 0x7fad0c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 0x7fad0c155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55014/0 (socket says 172.21.15.119:55014) 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 -- 172.21.15.119:0/2567659959 learned_addr learned my addr 172.21.15.119:0/2567659959 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0bfff640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0b7fe640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0719b0 0x7fad0c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 -- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 msgr2=0x7fad0c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 -- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0719b0 msgr2=0x7fad0c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:23.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0719b0 0x7fad0c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:23.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 -- 172.21.15.119:0/2567659959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00009420 con 0x7fad0c0b2860 2023-12-19T16:15:23.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad0affd640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 0x7fad0c155540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad000ae040 tx=0x7fad00019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:23.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000b4430 con 0x7fad0c0b2860 2023-12-19T16:15:23.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad000b45b0 con 0x7fad0c0b2860 2023-12-19T16:15:23.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c156220 con 0x7fad0c0b2860 2023-12-19T16:15:23.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000b4960 con 0x7fad0c0b2860 2023-12-19T16:15:23.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c158e90 con 0x7fad0c0b2860 2023-12-19T16:15:23.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.768+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c04e070 con 0x7fad0c0b2860 2023-12-19T16:15:23.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.772+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fad000b2040 con 0x7fad0c0b2860 2023-12-19T16:15:23.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.772+0000 7facf3fff640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7facf8065a60 0x7facf8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:23.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.772+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fad0011ddf0 con 0x7fad0c0b2860 2023-12-19T16:15:23.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.772+0000 7fad0b7fe640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7facf8065a60 0x7facf8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:23.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.772+0000 7fad0b7fe640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7facf8065a60 0x7facf8067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facfc0011f0 tx=0x7facfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:23.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.776+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fad000eb6f0 con 0x7fad0c0b2860 2023-12-19T16:15:23.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:23.924+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fad0c06d010 con 0x7fad0c0b2860 2023-12-19T16:15:24.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.576+0000 7facf3fff640 1 -- 172.21.15.119:0/2567659959 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fad000eed10 con 0x7fad0c0b2860 2023-12-19T16:15:24.581 INFO:teuthology.orchestra.run.smithi119.stderr:set pool 4 allow_ec_overwrites to true 2023-12-19T16:15:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.584+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7facf8065a60 msgr2=0x7facf8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.584+0000 7fad11ac3640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7facf8065a60 0x7facf8067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facfc0011f0 tx=0x7facfc009040 comp rx=0 tx=0).stop 2023-12-19T16:15:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.584+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 msgr2=0x7fad0c155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.584+0000 7fad11ac3640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 0x7fad0c155540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad000ae040 tx=0x7fad00019220 comp rx=0 tx=0).stop 2023-12-19T16:15:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 shutdown_connections 2023-12-19T16:15:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7facf8065a60 0x7facf8067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad0c0cad70 0x7fad0c15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad0c0b2860 0x7fad0c155540 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 --2- 172.21.15.119:0/2567659959 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad0c0719b0 0x7fad0c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 >> 172.21.15.119:0/2567659959 conn(0x7fad0c069e70 msgr2=0x7fad0c15d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 shutdown_connections 2023-12-19T16:15:24.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.588+0000 7fad11ac3640 1 -- 172.21.15.119:0/2567659959 wait complete. 2023-12-19T16:15:24.638 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-19T16:15:24.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 Processor -- start 2023-12-19T16:15:24.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 -- start start 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f42400cc8d0 0x7f42400cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4240070c20 con 0x7f42400ccd30 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42400c91c0 con 0x7f42400cc8d0 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4246d96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42400c97d0 con 0x7f42401588c0 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f423ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f42400cc8d0 0x7f42400cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f423ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f42400cc8d0 0x7f42400cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55030/0 (socket says 172.21.15.119:55030) 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f423ffff640 1 -- 172.21.15.119:0/267927229 learned_addr learned my addr 172.21.15.119:0/267927229 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:24.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.776+0000 7f4245333640 1 --1- 172.21.15.119:0/267927229 >> v1:172.21.15.119:6789/0 conn(0x7f42400ccd30 0x7f4240071670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60928/0 (socket says 172.21.15.119:60928) 2023-12-19T16:15:24.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f4244b32640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:24.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423ffff640 1 -- 172.21.15.119:0/267927229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 msgr2=0x7f42400c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:24.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423ffff640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423ffff640 1 -- 172.21.15.119:0/267927229 >> v1:172.21.15.119:6789/0 conn(0x7f42400ccd30 legacy=0x7f4240071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423ffff640 1 -- 172.21.15.119:0/267927229 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400c9ab0 con 0x7f42400cc8d0 2023-12-19T16:15:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423f7fe640 1 -- 172.21.15.119:0/267927229 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999870679 0 0) 0x7f4240070c20 con 0x7f42400ccd30 2023-12-19T16:15:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f4244b32640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:24.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423ffff640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400cc8d0 0x7f42400cae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f422c00b1e0 tx=0x7f422c01ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384d012b2ddc5620 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:24.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423f7fe640 1 -- 172.21.15.119:0/267927229 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0a5c70 con 0x7f42400cc8d0 2023-12-19T16:15:24.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423f7fe640 1 -- 172.21.15.119:0/267927229 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0a5dd0 con 0x7f42400cc8d0 2023-12-19T16:15:24.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f423f7fe640 1 -- 172.21.15.119:0/267927229 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c007af0 con 0x7f42400cc8d0 2023-12-19T16:15:24.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f4246d96640 1 -- 172.21.15.119:0/267927229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400cc8d0 msgr2=0x7f42400cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.780+0000 7f4246d96640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400cc8d0 0x7f42400cae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f422c00b1e0 tx=0x7f422c01ccb0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- 172.21.15.119:0/267927229 shutdown_connections 2023-12-19T16:15:24.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400cc8d0 0x7f42400cae30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 --2- 172.21.15.119:0/267927229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- 172.21.15.119:0/267927229 >> 172.21.15.119:0/267927229 conn(0x7f424006a2a0 msgr2=0x7f42400aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:24.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- 172.21.15.119:0/267927229 shutdown_connections 2023-12-19T16:15:24.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- 172.21.15.119:0/267927229 wait complete. 2023-12-19T16:15:24.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 Processor -- start 2023-12-19T16:15:24.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- start start 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42400cc8d0 0x7f42400c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 0x7f4240151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42401f5930 con 0x7f42400ccd30 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42401f5ba0 con 0x7f42400cc8d0 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4246d96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4240151760 con 0x7f42401588c0 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 0x7f4240151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 0x7f4240151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55040/0 (socket says 172.21.15.119:55040) 2023-12-19T16:15:24.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 -- 172.21.15.119:0/3612404247 learned_addr learned my addr 172.21.15.119:0/3612404247 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4244b32640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42400cc8d0 0x7f42400c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f4245333640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 -- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 msgr2=0x7f42400c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 -- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42400cc8d0 msgr2=0x7f42400c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42400cc8d0 0x7f42400c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 -- 172.21.15.119:0/3612404247 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009df0 con 0x7f42400ccd30 2023-12-19T16:15:24.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.784+0000 7f423ffff640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 0x7f4240151220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f422c01a8e0 tx=0x7f422c019a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0b6660 con 0x7f42400ccd30 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0b6800 con 0x7f42400ccd30 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0b6bb0 con 0x7f42400ccd30 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42400b0060 con 0x7f42400ccd30 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42400c2210 con 0x7f42400ccd30 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42400c9400 con 0x7f42400ccd30 2023-12-19T16:15:24.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f422c0b6d10 con 0x7f42400ccd30 2023-12-19T16:15:24.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f423d7fa640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4224065a60 0x7f4224067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:24.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f422c11df40 con 0x7f42400ccd30 2023-12-19T16:15:24.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f4244b32640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4224065a60 0x7f4224067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:24.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.788+0000 7f4244b32640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4224065a60 0x7f4224067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4234006fd0 tx=0x7f4234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:24.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.792+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f422c0eb620 con 0x7f42400ccd30 2023-12-19T16:15:24.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.976+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f424004e000 con 0x7f42400ccd30 2023-12-19T16:15:24.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.984+0000 7f423d7fa640 1 -- 172.21.15.119:0/3612404247 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f422c0eec40 con 0x7f42400ccd30 2023-12-19T16:15:24.986 INFO:teuthology.orchestra.run.smithi119.stderr:added data pool 4 to fsmap 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4224065a60 msgr2=0x7f4224067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4224065a60 0x7f4224067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4234006fd0 tx=0x7f4234008040 comp rx=0 tx=0).stop 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 msgr2=0x7f4240151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 0x7f4240151220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f422c01a8e0 tx=0x7f422c019a50 comp rx=0 tx=0).stop 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 shutdown_connections 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4224065a60 0x7f4224067f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42401588c0 0x7f42400c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42400ccd30 0x7f4240151220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 --2- 172.21.15.119:0/3612404247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42400cc8d0 0x7f42400c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:24.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 >> 172.21.15.119:0/3612404247 conn(0x7f424006a2a0 msgr2=0x7f4240165fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:24.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 shutdown_connections 2023-12-19T16:15:24.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:24.988+0000 7f4246d96640 1 -- 172.21.15.119:0/3612404247 wait complete. 2023-12-19T16:15:25.002 INFO:tasks.ceph.mds.a.smithi119.stderr:2023-12-19T16:15:25.000+0000 7fbf2939b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:15:25.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:25.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 Processor -- start 2023-12-19T16:15:25.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 -- start start 2023-12-19T16:15:25.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d7415a680 0x7f7d7415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7d7406fdb0 0x7f7d74070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7415f100 con 0x7f7d740cac10 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d74070780 con 0x7f7d7406fdb0 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d794c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740ca7d0 con 0x7f7d7415a680 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7d7406fdb0 0x7f7d74070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7d7406fdb0 0x7f7d74070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55052/0 (socket says 172.21.15.119:55052) 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d6bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7d740cac10 0x7f7d7415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60930/0 (socket says 172.21.15.119:60930) 2023-12-19T16:15:25.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 -- 172.21.15.119:0/3293360292 learned_addr learned my addr 172.21.15.119:0/3293360292 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:25.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d72ffd640 1 --2- 172.21.15.119:0/3293360292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d7415a680 0x7f7d7415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 -- 172.21.15.119:0/3293360292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d7415a680 msgr2=0x7f7d7415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:25.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 --2- 172.21.15.119:0/3293360292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d7415a680 0x7f7d7415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 -- 172.21.15.119:0/3293360292 >> v1:172.21.15.119:6789/0 conn(0x7f7d740cac10 legacy=0x7f7d7415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.148+0000 7f7d737fe640 1 -- 172.21.15.119:0/3293360292 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7415e860 con 0x7f7d7406fdb0 2023-12-19T16:15:25.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d737fe640 1 --2- 172.21.15.119:0/3293360292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7406fdb0 0x7f7d74070240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009e50 tx=0x7f7d6c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af55b2728918eda3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d727fc640 1 -- 172.21.15.119:0/3293360292 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0a5840 con 0x7f7d7406fdb0 2023-12-19T16:15:25.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d727fc640 1 -- 172.21.15.119:0/3293360292 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0a59a0 con 0x7f7d7406fdb0 2023-12-19T16:15:25.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d727fc640 1 -- 172.21.15.119:0/3293360292 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0a5d30 con 0x7f7d7406fdb0 2023-12-19T16:15:25.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 -- 172.21.15.119:0/3293360292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7406fdb0 msgr2=0x7f7d74070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 --2- 172.21.15.119:0/3293360292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7406fdb0 0x7f7d74070240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009e50 tx=0x7f7d6c01c980 comp rx=0 tx=0).stop 2023-12-19T16:15:25.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 -- 172.21.15.119:0/3293360292 shutdown_connections 2023-12-19T16:15:25.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 --2- 172.21.15.119:0/3293360292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7406fdb0 0x7f7d74070240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 --2- 172.21.15.119:0/3293360292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d7415a680 0x7f7d7415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 -- 172.21.15.119:0/3293360292 >> 172.21.15.119:0/3293360292 conn(0x7f7d7406a3e0 msgr2=0x7f7d740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:25.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 -- 172.21.15.119:0/3293360292 shutdown_connections 2023-12-19T16:15:25.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.152+0000 7f7d794c4640 1 -- 172.21.15.119:0/3293360292 wait complete. 2023-12-19T16:15:25.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 Processor -- start 2023-12-19T16:15:25.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 -- start start 2023-12-19T16:15:25.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d7406fdb0 0x7f7d740c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d740cac10 0x7f7d741575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 0x7f7d7415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c1e90 con 0x7f7d7415a680 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c2130 con 0x7f7d7406fdb0 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74158a60 con 0x7f7d740cac10 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 0x7f7d7415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 0x7f7d7415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55054/0 (socket says 172.21.15.119:55054) 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 -- 172.21.15.119:0/588781484 learned_addr learned my addr 172.21.15.119:0/588781484 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d72ffd640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d7406fdb0 0x7f7d740c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d6bfff640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d740cac10 0x7f7d741575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 -- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d740cac10 msgr2=0x7f7d741575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d740cac10 0x7f7d741575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 -- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d7406fdb0 msgr2=0x7f7d740c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d7406fdb0 0x7f7d740c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 -- 172.21.15.119:0/588781484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009b30 con 0x7f7d7415a680 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d6bfff640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d740cac10 0x7f7d741575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d72ffd640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d7406fdb0 0x7f7d740c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d737fe640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 0x7f7d7415d740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c01a5b0 tx=0x7f7d6c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0b8670 con 0x7f7d7415a680 2023-12-19T16:15:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0b87d0 con 0x7f7d7415a680 2023-12-19T16:15:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d74158d40 con 0x7f7d7415a680 2023-12-19T16:15:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0b8b40 con 0x7f7d7415a680 2023-12-19T16:15:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.156+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d740c5120 con 0x7f7d7415a680 2023-12-19T16:15:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.160+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d74159260 con 0x7f7d7415a680 2023-12-19T16:15:25.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.160+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d6c0b8ca0 con 0x7f7d7415a680 2023-12-19T16:15:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.160+0000 7f7d6b7fe640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d54065a90 0x7f7d54067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.160+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d6c11e990 con 0x7f7d7415a680 2023-12-19T16:15:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.160+0000 7f7d72ffd640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d54065a90 0x7f7d54067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.160+0000 7f7d72ffd640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d54065a90 0x7f7d54067f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d64007a70 tx=0x7f7d64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.164+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d6c0ebfc0 con 0x7f7d7415a680 2023-12-19T16:15:25.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.344+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d740735b0 con 0x7f7d7415a680 2023-12-19T16:15:25.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.344+0000 7f7d6b7fe640 1 -- 172.21.15.119:0/588781484 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f7d6c0ef5e0 con 0x7f7d7415a680 2023-12-19T16:15:25.348 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:25.348 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:24.980795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-19T16:15:25.348 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 7 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d54065a90 msgr2=0x7f7d54067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d54065a90 0x7f7d54067f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d64007a70 tx=0x7f7d64008040 comp rx=0 tx=0).stop 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 msgr2=0x7f7d7415d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 0x7f7d7415d740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c01a5b0 tx=0x7f7d6c019720 comp rx=0 tx=0).stop 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 shutdown_connections 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d54065a90 0x7f7d54067f50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d7415a680 0x7f7d7415d740 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d740cac10 0x7f7d741575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 --2- 172.21.15.119:0/588781484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d7406fdb0 0x7f7d740c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 >> 172.21.15.119:0/588781484 conn(0x7f7d7406a3e0 msgr2=0x7f7d7415cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 shutdown_connections 2023-12-19T16:15:25.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.348+0000 7f7d794c4640 1 -- 172.21.15.119:0/588781484 wait complete. 2023-12-19T16:15:25.370 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:25.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.504+0000 7fc2f5fbe640 1 Processor -- start 2023-12-19T16:15:25.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2f5fbe640 1 -- start start 2023-12-19T16:15:25.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2f5fbe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc2f00cf530 0x7fc2f0168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2f5fbe640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00d11c0 con 0x7fc2f00cf0d0 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2f5fbe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00d0310 con 0x7fc2f015ca40 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2f5fbe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f00d05b0 con 0x7fc2f00cf530 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2e7fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc2f00cf0d0 0x7fc2f01648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60940/0 (socket says 172.21.15.119:60940) 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2e7fff640 1 -- 172.21.15.119:0/3676982291 learned_addr learned my addr 172.21.15.119:0/3676982291 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2effff640 1 --2- 172.21.15.119:0/3676982291 >> v2:172.21.15.143:3300/0 conn(0x7fc2f00cf530 0x7fc2f0168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564562506 0 0) 0x7fc2f00d11c0 con 0x7fc2f00cf0d0 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003530 con 0x7fc2f00cf0d0 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739614925 0 0) 0x7fc2dc003530 con 0x7fc2f00cf0d0 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 >> v2:172.21.15.143:3300/0 conn(0x7fc2f00cf530 msgr2=0x7fc2f0168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3676982291 >> v2:172.21.15.143:3300/0 conn(0x7fc2f00cf530 0x7fc2f0168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 >> v1:172.21.15.143:6789/0 conn(0x7fc2f015ca40 legacy=0x7fc2f00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00d0890 con 0x7fc2f00cf0d0 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fc2d8001800 con 0x7fc2f00cf0d0 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 >> v1:172.21.15.119:6789/0 conn(0x7fc2f00cf0d0 legacy=0x7fc2f01648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2dc003980 0x7fc2dc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2dc004380 0x7fc2dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc005050 0x7fc2dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00d05b0 con 0x7fc2dc003980 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00bfb0 con 0x7fc2dc004380 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c170 con 0x7fc2dc005050 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2dc003980 0x7fc2dc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2e7fff640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2dc004380 0x7fc2dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2effff640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc005050 0x7fc2dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc005050 msgr2=0x7fc2dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:25.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc005050 0x7fc2dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2dc004380 msgr2=0x7fc2dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:25.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2dc004380 0x7fc2dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3676982291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003530 con 0x7fc2dc003980 2023-12-19T16:15:25.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2effff640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc005050 0x7fc2dc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:25.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.508+0000 7fc2effff640 1 -- 172.21.15.119:0/3676982291 reap_dead start 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2dc003980 0x7fc2dc003d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00018c0 tx=0x7fc2e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42e727059ff6c08 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00ab600 con 0x7fc2dc003980 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00a7050 con 0x7fc2dc003980 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2eeffd640 1 -- 172.21.15.119:0/3676982291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00ab9c0 con 0x7fc2dc003980 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/3676982291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2dc003980 msgr2=0x7fc2dc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2dc003980 0x7fc2dc003d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00018c0 tx=0x7fc2e001c490 comp rx=0 tx=0).stop 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/3676982291 shutdown_connections 2023-12-19T16:15:25.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/3676982291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2dc003980 0x7fc2dc003d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/3676982291 >> 172.21.15.119:0/3676982291 conn(0x7fc2f0089fb0 msgr2=0x7fc2f00d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:25.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/3676982291 shutdown_connections 2023-12-19T16:15:25.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.512+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/3676982291 wait complete. 2023-12-19T16:15:25.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 Processor -- start 2023-12-19T16:15:25.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- start start 2023-12-19T16:15:25.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc003980 0x7fc2f00cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f0151f50 0x7fc2f0152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 0x7fc2f00b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01532d0 con 0x7fc2f0152e50 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00b52d0 con 0x7fc2f0151f50 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c9e20 con 0x7fc2dc003980 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 0x7fc2f00b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 0x7fc2f00b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55078/0 (socket says 172.21.15.119:55078) 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 -- 172.21.15.119:0/874560932 learned_addr learned my addr 172.21.15.119:0/874560932 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2e7fff640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f0151f50 0x7fc2f0152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc003980 0x7fc2f00cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 -- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc003980 msgr2=0x7fc2f00cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc003980 0x7fc2f00cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 -- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f0151f50 msgr2=0x7fc2f0152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f0151f50 0x7fc2f0152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 -- 172.21.15.119:0/874560932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00c8a80 con 0x7fc2f0152e50 2023-12-19T16:15:25.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2e7fff640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f0151f50 0x7fc2f0152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:25.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2effff640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 0x7fc2f00b21a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8007cf0 tx=0x7fc2e8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800e050 con 0x7fc2f0152e50 2023-12-19T16:15:25.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800f040 con 0x7fc2f0152e50 2023-12-19T16:15:25.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00c8d20 con 0x7fc2f0152e50 2023-12-19T16:15:25.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80039a0 con 0x7fc2f0152e50 2023-12-19T16:15:25.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f00c63f0 con 0x7fc2f0152e50 2023-12-19T16:15:25.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.516+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f00c91d0 con 0x7fc2f0152e50 2023-12-19T16:15:25.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.520+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2e8015440 con 0x7fc2f0152e50 2023-12-19T16:15:25.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.520+0000 7fc2ecff9640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc2d0065a60 0x7fc2d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.520+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc2e8083ec0 con 0x7fc2f0152e50 2023-12-19T16:15:25.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.520+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc2d0065a60 0x7fc2d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.520+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc2d0065a60 0x7fc2d0067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00ad000 tx=0x7fc2e00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.524+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc2e8051580 con 0x7fc2f0152e50 2023-12-19T16:15:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.680+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f00c9c10 con 0x7fc2f0152e50 2023-12-19T16:15:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2ecff9640 1 -- 172.21.15.119:0/874560932 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc2e8054ba0 con 0x7fc2f0152e50 2023-12-19T16:15:25.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:25.687 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc2d0065a60 msgr2=0x7fc2d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc2d0065a60 0x7fc2d0067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00ad000 tx=0x7fc2e00a6000 comp rx=0 tx=0).stop 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 msgr2=0x7fc2f00b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 0x7fc2f00b21a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8007cf0 tx=0x7fc2e8010590 comp rx=0 tx=0).stop 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 shutdown_connections 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc2d0065a60 0x7fc2d0067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f0151f50 0x7fc2f0152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f0152e50 0x7fc2f00b21a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 --2- 172.21.15.119:0/874560932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc2dc003980 0x7fc2f00cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 >> 172.21.15.119:0/874560932 conn(0x7fc2f0089fb0 msgr2=0x7fc2f0153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 shutdown_connections 2023-12-19T16:15:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.684+0000 7fc2f5fbe640 1 -- 172.21.15.119:0/874560932 wait complete. 2023-12-19T16:15:25.707 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:25.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.840+0000 7f906d08c640 1 Processor -- start 2023-12-19T16:15:25.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.840+0000 7f906d08c640 1 -- start start 2023-12-19T16:15:25.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906d08c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f90680cb180 0x7f9068070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906d08c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f906815c800 0x7f90680ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906d08c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9068070b80 con 0x7f9068158c20 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906d08c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9068070e60 con 0x7f906815c800 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906d08c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9068071140 con 0x7f90680cb180 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f906815c800 0x7f90680ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f906815c800 0x7f90680ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55088/0 (socket says 172.21.15.119:55088) 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 -- 172.21.15.119:0/880063075 learned_addr learned my addr 172.21.15.119:0/880063075 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f905ffff640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f90680cb180 0x7f9068070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 -- 172.21.15.119:0/880063075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f90680cb180 msgr2=0x7f9068070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:25.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f90680cb180 0x7f9068070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 -- 172.21.15.119:0/880063075 >> v1:172.21.15.143:6789/0 conn(0x7f9068158c20 legacy=0x7f90680caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:25.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f906759e640 1 -- 172.21.15.119:0/880063075 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068071420 con 0x7f906815c800 2023-12-19T16:15:25.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.844+0000 7f905ffff640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f90680cb180 0x7f9068070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:25.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906759e640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f906815c800 0x7f90680ccc10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9060009e50 tx=0x7f906001d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1156b870e373771a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906659c640 1 -- 172.21.15.119:0/880063075 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600a5730 con 0x7f906815c800 2023-12-19T16:15:25.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906659c640 1 -- 172.21.15.119:0/880063075 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600a5890 con 0x7f906815c800 2023-12-19T16:15:25.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906659c640 1 -- 172.21.15.119:0/880063075 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600a5c20 con 0x7f906815c800 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 -- 172.21.15.119:0/880063075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f906815c800 msgr2=0x7f90680ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f906815c800 0x7f90680ccc10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9060009e50 tx=0x7f906001d370 comp rx=0 tx=0).stop 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 -- 172.21.15.119:0/880063075 shutdown_connections 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f906815c800 0x7f90680ccc10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 --2- 172.21.15.119:0/880063075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f90680cb180 0x7f9068070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 -- 172.21.15.119:0/880063075 >> 172.21.15.119:0/880063075 conn(0x7f906806a3e0 msgr2=0x7f90680afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 -- 172.21.15.119:0/880063075 shutdown_connections 2023-12-19T16:15:25.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 -- 172.21.15.119:0/880063075 wait complete. 2023-12-19T16:15:25.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 Processor -- start 2023-12-19T16:15:25.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.848+0000 7f906d08c640 1 -- start start 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 0x7f9068149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9068158c20 0x7f90680b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f906815c800 0x7f906814a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680ac2b0 con 0x7f90680cb180 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9068149f90 con 0x7f9068158c20 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b0380 con 0x7f906815c800 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 0x7f9068149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 0x7f9068149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55094/0 (socket says 172.21.15.119:55094) 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 -- 172.21.15.119:0/3396720783 learned_addr learned my addr 172.21.15.119:0/3396720783 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:25.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f905ffff640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9068158c20 0x7f90680b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906759e640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f906815c800 0x7f906814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 -- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f906815c800 msgr2=0x7f906814a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f906815c800 0x7f906814a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 -- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9068158c20 msgr2=0x7f90680b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9068158c20 0x7f90680b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 -- 172.21.15.119:0/3396720783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060009b30 con 0x7f90680cb180 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f9066d9d640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 0x7f9068149a50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f905800c480 tx=0x7f905800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058012830 con 0x7f90680cb180 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90580129b0 con 0x7f90680cb180 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90680c8800 con 0x7f90680cb180 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058012d60 con 0x7f90680cb180 2023-12-19T16:15:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9068150280 con 0x7f90680cb180 2023-12-19T16:15:25.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90680735b0 con 0x7f90680cb180 2023-12-19T16:15:25.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.852+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f905801c460 con 0x7f90680cb180 2023-12-19T16:15:25.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.856+0000 7f905f7fe640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9048065a60 0x7f9048067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:25.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.856+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9058083240 con 0x7f90680cb180 2023-12-19T16:15:25.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.856+0000 7f905ffff640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9048065a60 0x7f9048067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:25.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.856+0000 7f905ffff640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9048065a60 0x7f9048067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f906814cfc0 tx=0x7f9050008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:25.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:25.860+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f90580509b0 con 0x7f90680cb180 2023-12-19T16:15:26.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.012+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f906804e000 con 0x7f90680cb180 2023-12-19T16:15:26.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.012+0000 7f905f7fe640 1 -- 172.21.15.119:0/3396720783 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f9058053fd0 con 0x7f90680cb180 2023-12-19T16:15:26.016 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:26.016 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9048065a60 msgr2=0x7f9048067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9048065a60 0x7f9048067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f906814cfc0 tx=0x7f9050008040 comp rx=0 tx=0).stop 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 msgr2=0x7f9068149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 0x7f9068149a50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f905800c480 tx=0x7f905800c940 comp rx=0 tx=0).stop 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 shutdown_connections 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9048065a60 0x7f9048067f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9068158c20 0x7f90680b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f906815c800 0x7f906814a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 --2- 172.21.15.119:0/3396720783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90680cb180 0x7f9068149a50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 >> 172.21.15.119:0/3396720783 conn(0x7f906806a3e0 msgr2=0x7f90680cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 shutdown_connections 2023-12-19T16:15:26.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.016+0000 7f906d08c640 1 -- 172.21.15.119:0/3396720783 wait complete. 2023-12-19T16:15:26.051 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:26.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe803866640 1 Processor -- start 2023-12-19T16:15:26.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe803866640 1 -- start start 2023-12-19T16:15:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe803866640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7fc0ce210 0x7fe7fc0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe803866640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0cf390 con 0x7fe7fc0cd050 2023-12-19T16:15:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe803866640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0ce780 con 0x7fe7fc15a840 2023-12-19T16:15:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe803866640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc0cb8c0 con 0x7fe7fc0ce210 2023-12-19T16:15:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe801602640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe7fc0cd050 0x7fe7fc0cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60948/0 (socket says 172.21.15.119:60948) 2023-12-19T16:15:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe801602640 1 -- 172.21.15.119:0/2125998421 learned_addr learned my addr 172.21.15.119:0/2125998421 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe801e03640 1 --2- 172.21.15.119:0/2125998421 >> v2:172.21.15.143:3300/0 conn(0x7fe7fc0ce210 0x7fe7fc0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296833054 0 0) 0x7fe7fc0cf390 con 0x7fe7fc0cd050 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e8003530 con 0x7fe7fc0cd050 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130623397 0 0) 0x7fe7fc0ce780 con 0x7fe7fc15a840 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.188+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7fc0cf390 con 0x7fe7fc15a840 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe801e03640 1 -- 172.21.15.119:0/2125998421 >> v1:172.21.15.143:6789/0 conn(0x7fe7fc15a840 legacy=0x7fe7fc0c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe801e03640 1 -- 172.21.15.119:0/2125998421 >> v1:172.21.15.119:6789/0 conn(0x7fe7fc0cd050 legacy=0x7fe7fc0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe801e03640 1 -- 172.21.15.119:0/2125998421 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0cea60 con 0x7fe7fc0ce210 2023-12-19T16:15:26.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe801e03640 1 --2- 172.21.15.119:0/2125998421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc0c49a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009d90 tx=0x7fe7fc0c56f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dacddb3096d5dab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40a59e0 con 0x7fe7fc0ce210 2023-12-19T16:15:26.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f40a5b40 con 0x7fe7fc0ce210 2023-12-19T16:15:26.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.192+0000 7fe7f3fff640 1 -- 172.21.15.119:0/2125998421 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40ad440 con 0x7fe7fc0ce210 2023-12-19T16:15:26.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- 172.21.15.119:0/2125998421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc0ce210 msgr2=0x7fe7fc0c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 --2- 172.21.15.119:0/2125998421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc0c49a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009d90 tx=0x7fe7fc0c56f0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- 172.21.15.119:0/2125998421 shutdown_connections 2023-12-19T16:15:26.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 --2- 172.21.15.119:0/2125998421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc0c49a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- 172.21.15.119:0/2125998421 >> 172.21.15.119:0/2125998421 conn(0x7fe7fc069ca0 msgr2=0x7fe7fc06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- 172.21.15.119:0/2125998421 shutdown_connections 2023-12-19T16:15:26.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- 172.21.15.119:0/2125998421 wait complete. 2023-12-19T16:15:26.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 Processor -- start 2023-12-19T16:15:26.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- start start 2023-12-19T16:15:26.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7fc0cd050 0x7fe7fc14e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc15a840 0x7fe7fc1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06b300 con 0x7fe7fc0ce210 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06b5e0 con 0x7fe7fc15a840 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe803866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06b8c0 con 0x7fe7fc0cd050 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc06c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55104/0 (socket says 172.21.15.119:55104) 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 -- 172.21.15.119:0/756354398 learned_addr learned my addr 172.21.15.119:0/756354398 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe801e03640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc15a840 0x7fe7fc1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe801602640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7fc0cd050 0x7fe7fc14e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 -- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7fc0cd050 msgr2=0x7fe7fc14e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7fc0cd050 0x7fe7fc14e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 -- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc15a840 msgr2=0x7fe7fc1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc15a840 0x7fe7fc1486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe800e01640 1 -- 172.21.15.119:0/756354398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f4009a70 con 0x7fe7fc0ce210 2023-12-19T16:15:26.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.196+0000 7fe801602640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7fc0cd050 0x7fe7fc14e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:26.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe800e01640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc06c3a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c430 tx=0x7fe7ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0052d0 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec005450 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc06bba0 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec003840 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc14fd80 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc04e000 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe7ec0039a0 con 0x7fe7fc0ce210 2023-12-19T16:15:26.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe7f1ffb640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe7e0065a60 0x7fe7e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7ec082a00 con 0x7fe7fc0ce210 2023-12-19T16:15:26.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.200+0000 7fe801602640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe7e0065a60 0x7fe7e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.204+0000 7fe801602640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe7e0065a60 0x7fe7e0067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80011f0 tx=0x7fe7f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.204+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe7ec050180 con 0x7fe7fc0ce210 2023-12-19T16:15:26.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7fc0cba00 con 0x7fe7fc0ce210 2023-12-19T16:15:26.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe7f1ffb640 1 -- 172.21.15.119:0/756354398 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4711 (secure 0 0 0) 0x7fe7ec017090 con 0x7fe7fc0ce210 2023-12-19T16:15:26.390 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:26.390 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:24.980795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-19T16:15:26.390 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 7 2023-12-19T16:15:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe7e0065a60 msgr2=0x7fe7e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe7e0065a60 0x7fe7e0067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80011f0 tx=0x7fe7f8009040 comp rx=0 tx=0).stop 2023-12-19T16:15:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 msgr2=0x7fe7fc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc06c3a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c430 tx=0x7fe7ec00c8f0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 shutdown_connections 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe7e0065a60 0x7fe7e0067f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7fc15a840 0x7fe7fc1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7fc0ce210 0x7fe7fc06c3a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 --2- 172.21.15.119:0/756354398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7fc0cd050 0x7fe7fc14e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 >> 172.21.15.119:0/756354398 conn(0x7fe7fc069ca0 msgr2=0x7fe7fc0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 shutdown_connections 2023-12-19T16:15:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.388+0000 7fe803866640 1 -- 172.21.15.119:0/756354398 wait complete. 2023-12-19T16:15:26.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:26.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 Processor -- start 2023-12-19T16:15:26.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 -- start start 2023-12-19T16:15:26.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b240cac10 0x7f6b2415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b2406fdb0 0x7f6b24070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2415f100 con 0x7f6b2415a680 2023-12-19T16:15:26.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240707a0 con 0x7f6b2406fdb0 2023-12-19T16:15:26.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b29b7b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240ca7d0 con 0x7f6b240cac10 2023-12-19T16:15:26.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b2406fdb0 0x7f6b24070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b1bfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b240cac10 0x7f6b2415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b2406fdb0 0x7f6b24070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:52664/0 (socket says 172.21.15.119:52664) 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 -- 172.21.15.119:0/3475035121 learned_addr learned my addr 172.21.15.119:0/3475035121 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b237fe640 1 --1- 172.21.15.119:0/3475035121 >> v1:172.21.15.143:6789/0 conn(0x7f6b2415a680 0x7f6b2415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:38630/0 (socket says 172.21.15.119:38630) 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 -- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b240cac10 msgr2=0x7f6b2415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 --2- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b240cac10 0x7f6b2415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 -- 172.21.15.119:0/3475035121 >> v1:172.21.15.143:6789/0 conn(0x7f6b2415a680 legacy=0x7f6b2415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.548+0000 7f6b23fff640 1 -- 172.21.15.119:0/3475035121 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2415e860 con 0x7f6b2406fdb0 2023-12-19T16:15:26.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b23fff640 1 --2- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2406fdb0 0x7f6b24070260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009e50 tx=0x7f6b1c01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b972f76f6ff5401 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b22ffd640 1 -- 172.21.15.119:0/3475035121 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0a5840 con 0x7f6b2406fdb0 2023-12-19T16:15:26.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b22ffd640 1 -- 172.21.15.119:0/3475035121 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c0a59a0 con 0x7f6b2406fdb0 2023-12-19T16:15:26.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b22ffd640 1 -- 172.21.15.119:0/3475035121 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0a5d30 con 0x7f6b2406fdb0 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 -- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2406fdb0 msgr2=0x7f6b24070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2406fdb0 0x7f6b24070260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009e50 tx=0x7f6b1c01c980 comp rx=0 tx=0).stop 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 -- 172.21.15.119:0/3475035121 shutdown_connections 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2406fdb0 0x7f6b24070260 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/3475035121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b240cac10 0x7f6b2415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 -- 172.21.15.119:0/3475035121 >> 172.21.15.119:0/3475035121 conn(0x7f6b2406a3e0 msgr2=0x7f6b240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 -- 172.21.15.119:0/3475035121 shutdown_connections 2023-12-19T16:15:26.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.552+0000 7f6b29b7b640 1 -- 172.21.15.119:0/3475035121 wait complete. 2023-12-19T16:15:26.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 Processor -- start 2023-12-19T16:15:26.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 -- start start 2023-12-19T16:15:26.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b2406fdb0 0x7f6b24152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 0x7f6b240c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2415a680 0x7f6b240c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24152db0 con 0x7f6b240cac10 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240c4750 con 0x7f6b2415a680 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240c3eb0 con 0x7f6b2406fdb0 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 0x7f6b240c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 0x7f6b240c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55108/0 (socket says 172.21.15.119:55108) 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 -- 172.21.15.119:0/4145937804 learned_addr learned my addr 172.21.15.119:0/4145937804 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b237fe640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b2406fdb0 0x7f6b24152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b23fff640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2415a680 0x7f6b240c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 -- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b2406fdb0 msgr2=0x7f6b24152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b2406fdb0 0x7f6b24152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 -- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2415a680 msgr2=0x7f6b240c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2415a680 0x7f6b240c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 -- 172.21.15.119:0/4145937804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c009b30 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b1bfff640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 0x7f6b240c1e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00e870 tx=0x7f6b0c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c009510 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c00eec0 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00cb60 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b240c4190 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.556+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b240c1a80 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.560+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b240735b0 con 0x7f6b240cac10 2023-12-19T16:15:26.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.560+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b0c00ccc0 con 0x7f6b240cac10 2023-12-19T16:15:26.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.560+0000 7f6b20ff9640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b04065a60 0x7f6b04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.560+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b0c0833e0 con 0x7f6b240cac10 2023-12-19T16:15:26.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.560+0000 7f6b237fe640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b04065a60 0x7f6b04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.560+0000 7f6b237fe640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b04065a60 0x7f6b04067f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b14000f70 tx=0x7f6b14007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.566 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.564+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b0c050bf0 con 0x7f6b240cac10 2023-12-19T16:15:26.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.716+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b2404e000 con 0x7f6b240cac10 2023-12-19T16:15:26.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.716+0000 7f6b20ff9640 1 -- 172.21.15.119:0/4145937804 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f6b0c054210 con 0x7f6b240cac10 2023-12-19T16:15:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:26.720 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b04065a60 msgr2=0x7f6b04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b04065a60 0x7f6b04067f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b14000f70 tx=0x7f6b14007e50 comp rx=0 tx=0).stop 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 msgr2=0x7f6b240c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 0x7f6b240c1e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00e870 tx=0x7f6b0c00ec70 comp rx=0 tx=0).stop 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 shutdown_connections 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b04065a60 0x7f6b04067f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b2415a680 0x7f6b240c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b240cac10 0x7f6b240c1e90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 --2- 172.21.15.119:0/4145937804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b2406fdb0 0x7f6b24152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 >> 172.21.15.119:0/4145937804 conn(0x7f6b2406a3e0 msgr2=0x7f6b2415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 shutdown_connections 2023-12-19T16:15:26.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:26.720+0000 7f6b29b7b640 1 -- 172.21.15.119:0/4145937804 wait complete. 2023-12-19T16:15:27.144 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:15:20.558027+0000', 'modified': '2023-12-19T16:15:24.980795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6837/2766451211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6835', 'nonce': 2766451211}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 2766451211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-19T16:15:27.144 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:15:27.144 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T16:15:27.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.284+0000 7f4e2048c640 1 Processor -- start 2023-12-19T16:15:27.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.284+0000 7f4e2048c640 1 -- start start 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e2048c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e181570c0 0x7f4e1806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e2048c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e1806c320 0x7f4e180c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e2048c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180c9460 con 0x7f4e180c9e30 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e2048c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1806c7a0 con 0x7f4e181570c0 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e2048c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e181574a0 con 0x7f4e1806c320 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e181570c0 0x7f4e1806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e181570c0 0x7f4e1806bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55114/0 (socket says 172.21.15.119:55114) 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 -- 172.21.15.119:0/1218025612 learned_addr learned my addr 172.21.15.119:0/1218025612 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1218025612 >> v2:172.21.15.143:3300/0 conn(0x7f4e1806c320 0x7f4e180c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 -- 172.21.15.119:0/1218025612 >> v2:172.21.15.143:3300/0 conn(0x7f4e1806c320 msgr2=0x7f4e180c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1218025612 >> v2:172.21.15.143:3300/0 conn(0x7f4e1806c320 0x7f4e180c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 -- 172.21.15.119:0/1218025612 >> v1:172.21.15.143:6789/0 conn(0x7f4e180c9e30 legacy=0x7f4e1815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.288+0000 7f4e1e228640 1 -- 172.21.15.119:0/1218025612 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180c8b30 con 0x7f4e181570c0 2023-12-19T16:15:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1218025612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e181570c0 0x7f4e1806bde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e180ce330 tx=0x7f4e1401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6b44d2273c16b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e1d226640 1 -- 172.21.15.119:0/1218025612 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140a7ca0 con 0x7f4e181570c0 2023-12-19T16:15:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e1d226640 1 -- 172.21.15.119:0/1218025612 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140a7e00 con 0x7f4e181570c0 2023-12-19T16:15:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e1d226640 1 -- 172.21.15.119:0/1218025612 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140af660 con 0x7f4e181570c0 2023-12-19T16:15:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- 172.21.15.119:0/1218025612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e181570c0 msgr2=0x7f4e1806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1218025612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e181570c0 0x7f4e1806bde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e180ce330 tx=0x7f4e1401ebd0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- 172.21.15.119:0/1218025612 shutdown_connections 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1218025612 >> v2:172.21.15.143:3300/0 conn(0x7f4e1806c320 0x7f4e180c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1218025612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e181570c0 0x7f4e1806bde0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- 172.21.15.119:0/1218025612 >> 172.21.15.119:0/1218025612 conn(0x7f4e1806a3e0 msgr2=0x7f4e180afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- 172.21.15.119:0/1218025612 shutdown_connections 2023-12-19T16:15:27.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- 172.21.15.119:0/1218025612 wait complete. 2023-12-19T16:15:27.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 Processor -- start 2023-12-19T16:15:27.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- start start 2023-12-19T16:15:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e1806c320 0x7f4e1814d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 0x7f4e181f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e181570c0 0x7f4e18070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1814d4f0 con 0x7f4e180c9e30 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1814cbc0 con 0x7f4e1806c320 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.292+0000 7f4e2048c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1814ce30 con 0x7f4e181570c0 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 0x7f4e181f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 0x7f4e181f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55130/0 (socket says 172.21.15.119:55130) 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 -- 172.21.15.119:0/1471893853 learned_addr learned my addr 172.21.15.119:0/1471893853 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e1806c320 0x7f4e1814d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e181570c0 0x7f4e18070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 -- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e181570c0 msgr2=0x7f4e18070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e181570c0 0x7f4e18070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 -- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e1806c320 msgr2=0x7f4e1814d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e1806c320 0x7f4e1814d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 -- 172.21.15.119:0/1471893853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1400b770 con 0x7f4e180c9e30 2023-12-19T16:15:27.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 0x7f4e181f43e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800d620 tx=0x7f4e0800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e0effd640 1 -- 172.21.15.119:0/1471893853 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800b620 con 0x7f4e180c9e30 2023-12-19T16:15:27.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e0effd640 1 -- 172.21.15.119:0/1471893853 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0800b780 con 0x7f4e180c9e30 2023-12-19T16:15:27.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e0effd640 1 -- 172.21.15.119:0/1471893853 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800bb10 con 0x7f4e180c9e30 2023-12-19T16:15:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1814d110 con 0x7f4e180c9e30 2023-12-19T16:15:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e181f4920 con 0x7f4e180c9e30 2023-12-19T16:15:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.296+0000 7f4e0effd640 1 -- 172.21.15.119:0/1471893853 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4e0800bc70 con 0x7f4e180c9e30 2023-12-19T16:15:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e0effd640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4dfc065a60 0x7f4dfc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e0effd640 1 -- 172.21.15.119:0/1471893853 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e080838f0 con 0x7f4e180c9e30 2023-12-19T16:15:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4dfc065a60 0x7f4dfc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 Processor -- start 2023-12-19T16:15:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- start start 2023-12-19T16:15:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4dfc065a60 0x7f4dfc067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b1000 tx=0x7f4e14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f4a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70effc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70d23c90 con 0x557f70f001c0 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70d55220 con 0x557f70f4a070 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f70d527f0 con 0x557f70f4a990 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f005a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55138/0 (socket says 172.21.15.119:55138) 2023-12-19T16:15:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 -- 172.21.15.119:0/1717200630 learned_addr learned my addr 172.21.15.119:0/1717200630 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f4a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70effc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 -- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 msgr2=0x557f70effc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70effc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 -- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 msgr2=0x557f70f4a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f4a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 -- 172.21.15.119:0/1717200630 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f70a4a890 con 0x557f70f001c0 2023-12-19T16:15:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f005a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e10001dc0 tx=0x7f4e100016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec44384334b74bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4dfbfff640 1 -- 172.21.15.119:0/1717200630 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000fc40 con 0x557f70f001c0 2023-12-19T16:15:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4dfbfff640 1 -- 172.21.15.119:0/1717200630 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000fda0 con 0x557f70f001c0 2023-12-19T16:15:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4dfbfff640 1 -- 172.21.15.119:0/1717200630 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10003b80 con 0x557f70f001c0 2023-12-19T16:15:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- 172.21.15.119:0/1717200630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 msgr2=0x557f70f005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f005a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e10001dc0 tx=0x7f4e100016b0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- 172.21.15.119:0/1717200630 shutdown_connections 2023-12-19T16:15:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f005a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70effc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1717200630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f4a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- 172.21.15.119:0/1717200630 >> 172.21.15.119:0/1717200630 conn(0x557f70f06950 msgr2=0x557f70efe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- 172.21.15.119:0/1717200630 shutdown_connections 2023-12-19T16:15:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.300+0000 7f4e237f8000 1 -- 172.21.15.119:0/1717200630 wait complete. 2023-12-19T16:15:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- start start 2023-12-19T16:15:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 Processor -- start 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f05780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f0c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70f0c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70d4e0e0 con 0x557f70f001c0 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70ced310 con 0x557f70f4a070 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f70d0b770 con 0x557f70f4a990 2023-12-19T16:15:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 10 client.0 _ll_register_callbacks cb 0x557f70eebb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:15:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f05780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f05780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55146/0 (socket says 172.21.15.119:55146) 2023-12-19T16:15:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 -- 172.21.15.119:0/1607629498 learned_addr learned my addr 172.21.15.119:0/1607629498 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70f0c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f0c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 -- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 msgr2=0x557f70f0c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70f0c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 -- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 msgr2=0x557f70f0c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f0c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 -- 172.21.15.119:0/1607629498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e180c9460 con 0x557f70f001c0 2023-12-19T16:15:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e1e228640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f05780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e14000c10 tx=0x7f4e140046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824f14ffa29d2190 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4df97fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:15:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4df97fa640 1 -- 172.21.15.119:0/1607629498 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140c1040 con 0x557f70f001c0 2023-12-19T16:15:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f70d1dc10 con 0x557f70f001c0 2023-12-19T16:15:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4df97fa640 1 -- 172.21.15.119:0/1607629498 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e140b9820 con 0x557f70f001c0 2023-12-19T16:15:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4df97fa640 1 -- 172.21.15.119:0/1607629498 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e140b99e0 con 0x557f70f001c0 2023-12-19T16:15:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 10 client.4431 fetch_fsmap learned FSMap version 7 2023-12-19T16:15:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557f70d13260 con 0x557f70f001c0 2023-12-19T16:15:27.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4df97fa640 1 -- 172.21.15.119:0/1607629498 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f70d1dc10 con 0x557f70f001c0 2023-12-19T16:15:27.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4df97fa640 1 -- 172.21.15.119:0/1607629498 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4e140c4030 con 0x557f70f001c0 2023-12-19T16:15:27.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T16:15:27.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 10 client.4431 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T16:15:27.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 20 client.4431 populate_metadata read hostname 'smithi119' 2023-12-19T16:15:27.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f518d0 0x557f70f51cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 4 client.4431 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:15:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.304+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 --> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f70d4ca30 con 0x557f70f518d0 2023-12-19T16:15:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f518d0 0x557f70f51cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e1da27640 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f518d0 0x557f70f51cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3358602210bde7cb server_cookie=89dca90e444d6100 in_seq=0 out_seq=0 2023-12-19T16:15:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4df97fa640 10 client.4431 ms_handle_connect on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4df97fa640 1 -- 172.21.15.119:0/1607629498 <== mds.0 v2:172.21.15.119:6835/2766451211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x557f70d4ca30 con 0x557f70f518d0 2023-12-19T16:15:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4df97fa640 10 client.4431 handle_command_reply: tid=0 2023-12-19T16:15:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 client.4431 shutdown 2023-12-19T16:15:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 msgr2=0x557f70f05780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f05780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e14000c10 tx=0x7f4e140046d0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 shutdown_connections 2023-12-19T16:15:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f518d0 0x557f70f51cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a070 0x557f70f0c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a990 0x557f70f0c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 --2- 172.21.15.119:0/1607629498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70f05780 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4df97fa640 0 client.4431 ms_handle_reset on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 >> 172.21.15.119:0/1607629498 conn(0x557f70f06950 msgr2=0x557f70efec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 shutdown_connections 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 1 -- 172.21.15.119:0/1607629498 wait complete. 2023-12-19T16:15:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.308+0000 7f4e237f8000 20 client.4431 trim_cache size 0 max 16384 2023-12-19T16:15:27.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 Processor -- start 2023-12-19T16:15:27.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- start start 2023-12-19T16:15:27.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70faa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70faac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a990 0x557f70fab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70a0b940 con 0x557f70f001c0 2023-12-19T16:15:27.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70d564b0 con 0x557f70f4a990 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f70d49a50 con 0x557f70f4a070 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70faa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70faa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55150/0 (socket says 172.21.15.119:55150) 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 -- 172.21.15.119:0/900192254 learned_addr learned my addr 172.21.15.119:0/900192254 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 -- 172.21.15.119:0/900192254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 msgr2=0x557f70faac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70faac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 -- 172.21.15.119:0/900192254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a990 msgr2=0x557f70fab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a990 0x557f70fab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 -- 172.21.15.119:0/900192254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f70cf93b0 con 0x557f70f001c0 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e1e228640 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70faa6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b2c0 tx=0x7f4e1400b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14473f5f5206868f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e0cff9640 1 -- 172.21.15.119:0/900192254 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140dc070 con 0x557f70f001c0 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e0cff9640 1 -- 172.21.15.119:0/900192254 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140bd070 con 0x557f70f001c0 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e0cff9640 1 -- 172.21.15.119:0/900192254 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140a7ca0 con 0x557f70f001c0 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- 172.21.15.119:0/900192254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 msgr2=0x557f70faa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70faa6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b2c0 tx=0x7f4e1400b450 comp rx=0 tx=0).stop 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- 172.21.15.119:0/900192254 shutdown_connections 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f4a990 0x557f70fab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70faac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 --2- 172.21.15.119:0/900192254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f001c0 0x557f70faa6e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- 172.21.15.119:0/900192254 >> 172.21.15.119:0/900192254 conn(0x557f70f06950 msgr2=0x557f70f0bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- 172.21.15.119:0/900192254 shutdown_connections 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- 172.21.15.119:0/900192254 wait complete. 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 -- start start 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.324+0000 7f4e237f8000 1 Processor -- start 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f001c0 0x557f70f93960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70f93ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 0x557f70f943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70d431f0 con 0x557f70f4a990 2023-12-19T16:15:27.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f70d50c40 con 0x557f70f001c0 2023-12-19T16:15:27.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f70cf6860 con 0x557f70f4a070 2023-12-19T16:15:27.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 10 client.0 _ll_register_callbacks cb 0x557f70cfc640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:15:27.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 0x557f70f943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 0x557f70f943e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55164/0 (socket says 172.21.15.119:55164) 2023-12-19T16:15:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1e228640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f001c0 0x557f70f93960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 -- 172.21.15.119:0/3312855773 learned_addr learned my addr 172.21.15.119:0/3312855773 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1da27640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70f93ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 -- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 msgr2=0x557f70f93ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70f93ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 -- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f001c0 msgr2=0x557f70f93960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f001c0 0x557f70f93960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 -- 172.21.15.119:0/3312855773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f70d13260 con 0x557f70f4a990 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1e228640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f001c0 0x557f70f93960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1ea29640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 0x557f70f943e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e10014000 tx=0x7f4e100014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eaa7164f54dd414 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 1 -- 172.21.15.119:0/3312855773 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10005790 con 0x557f70f4a990 2023-12-19T16:15:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 1 -- 172.21.15.119:0/3312855773 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e10027d90 con 0x557f70f4a990 2023-12-19T16:15:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f70d13e00 con 0x557f70f4a990 2023-12-19T16:15:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 1 -- 172.21.15.119:0/3312855773 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e1001d400 con 0x557f70f4a990 2023-12-19T16:15:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 10 client.4437 fetch_fsmap learned FSMap version 7 2023-12-19T16:15:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557f70a4acc0 con 0x557f70f4a990 2023-12-19T16:15:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 1 -- 172.21.15.119:0/3312855773 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f70d13e00 con 0x557f70f4a990 2023-12-19T16:15:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 1 -- 172.21.15.119:0/3312855773 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4e10012070 con 0x557f70f4a990 2023-12-19T16:15:27.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T16:15:27.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 10 client.4437 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T16:15:27.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 20 client.4437 populate_metadata read hostname 'smithi119' 2023-12-19T16:15:27.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f94920 0x557f70fb7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 4 client.4437 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-12-19T16:15:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 --> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557f70d47160 con 0x557f70f94920 2023-12-19T16:15:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1e228640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f94920 0x557f70fb7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 10 client.4437 ms_handle_connect on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e1e228640 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f94920 0x557f70fb7980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e8f68dc381f936d server_cookie=3150e4462632841e in_seq=0 out_seq=0 2023-12-19T16:15:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 1 -- 172.21.15.119:0/3312855773 <== mds.0 v2:172.21.15.119:6835/2766451211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557f70d47160 con 0x557f70f94920 2023-12-19T16:15:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4df97fa640 10 client.4437 handle_command_reply: tid=0 2023-12-19T16:15:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 client.4437 shutdown 2023-12-19T16:15:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 msgr2=0x557f70f943e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.328+0000 7f4e237f8000 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 0x557f70f943e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e10014000 tx=0x7f4e100014b0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 shutdown_connections 2023-12-19T16:15:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x557f70f94920 0x557f70fb7980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f70f4a990 0x557f70f943e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557f70f4a070 0x557f70f93ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 --2- 172.21.15.119:0/3312855773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557f70f001c0 0x557f70f93960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4df97fa640 0 client.4437 ms_handle_reset on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:27.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 >> 172.21.15.119:0/3312855773 conn(0x557f70f06950 msgr2=0x557f70f47060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 shutdown_connections 2023-12-19T16:15:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 1 -- 172.21.15.119:0/3312855773 wait complete. 2023-12-19T16:15:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e237f8000 20 client.4437 trim_cache size 0 max 16384 2023-12-19T16:15:27.346 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:15:27.347 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "95401411-8d68-4720-80be-89deeb6bcc32", 2023-12-19T16:15:27.347 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2023-12-19T16:15:27.347 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4278, 2023-12-19T16:15:27.347 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2023-12-19T16:15:27.347 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2023-12-19T16:15:27.348 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2023-12-19T16:15:27.348 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 6.7710904210000002, 2023-12-19T16:15:27.348 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 7, 2023-12-19T16:15:27.348 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 24, 2023-12-19T16:15:27.348 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 23, 2023-12-19T16:15:27.348 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 13.354601617 2023-12-19T16:15:27.349 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:15:27.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4dfc065a60 msgr2=0x7f4dfc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4dfc065a60 0x7f4dfc067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b1000 tx=0x7f4e14008040 comp rx=0 tx=0).stop 2023-12-19T16:15:27.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 msgr2=0x7f4e181f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 0x7f4e181f43e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800d620 tx=0x7f4e0800dae0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 shutdown_connections 2023-12-19T16:15:27.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4dfc065a60 0x7f4dfc067f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e181570c0 0x7f4e18070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e180c9e30 0x7f4e181f43e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 --2- 172.21.15.119:0/1471893853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e1806c320 0x7f4e1814d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 >> 172.21.15.119:0/1471893853 conn(0x7f4e1806a3e0 msgr2=0x7f4e1814b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 shutdown_connections 2023-12-19T16:15:27.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.332+0000 7f4e2048c640 1 -- 172.21.15.119:0/1471893853 wait complete. 2023-12-19T16:15:27.353 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:27.354 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:27.354 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:27.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.488+0000 7ff153820640 1 Processor -- start 2023-12-19T16:15:27.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff153820640 1 -- start start 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff153820640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff14c06c4f0 0x7ff14c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff153820640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0c9460 con 0x7ff14c1570c0 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff153820640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c1574a0 con 0x7ff14c0c9e30 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff153820640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0c8b30 con 0x7ff14c06c4f0 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff150dbb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff14c06c4f0 0x7ff14c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff150dbb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff14c06c4f0 0x7ff14c0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55174/0 (socket says 172.21.15.119:55174) 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff1515bc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff14c1570c0 0x7ff14c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60962/0 (socket says 172.21.15.119:60962) 2023-12-19T16:15:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff150dbb640 1 -- 172.21.15.119:0/686274746 learned_addr learned my addr 172.21.15.119:0/686274746 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff150dbb640 1 -- 172.21.15.119:0/686274746 >> v1:172.21.15.143:6789/0 conn(0x7ff14c0c9e30 legacy=0x7ff14c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff150dbb640 1 -- 172.21.15.119:0/686274746 >> v1:172.21.15.119:6789/0 conn(0x7ff14c1570c0 legacy=0x7ff14c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff150dbb640 1 -- 172.21.15.119:0/686274746 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0c8e10 con 0x7ff14c06c4f0 2023-12-19T16:15:27.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.492+0000 7ff143fff640 1 -- 172.21.15.119:0/686274746 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977343562 0 0) 0x7ff14c0c9460 con 0x7ff14c1570c0 2023-12-19T16:15:27.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff150dbb640 1 --2- 172.21.15.119:0/686274746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c98f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ef39bcc1b2bfc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff143fff640 1 -- 172.21.15.119:0/686274746 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0a8050 con 0x7ff14c06c4f0 2023-12-19T16:15:27.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff143fff640 1 -- 172.21.15.119:0/686274746 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c0ac5f0 con 0x7ff14c06c4f0 2023-12-19T16:15:27.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff143fff640 1 -- 172.21.15.119:0/686274746 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0ac980 con 0x7ff14c06c4f0 2023-12-19T16:15:27.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 -- 172.21.15.119:0/686274746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c06c4f0 msgr2=0x7ff14c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 --2- 172.21.15.119:0/686274746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c98f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c01c480 comp rx=0 tx=0).stop 2023-12-19T16:15:27.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 -- 172.21.15.119:0/686274746 shutdown_connections 2023-12-19T16:15:27.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 --2- 172.21.15.119:0/686274746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c98f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 -- 172.21.15.119:0/686274746 >> 172.21.15.119:0/686274746 conn(0x7ff14c06a3e0 msgr2=0x7ff14c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 -- 172.21.15.119:0/686274746 shutdown_connections 2023-12-19T16:15:27.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 -- 172.21.15.119:0/686274746 wait complete. 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 Processor -- start 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.496+0000 7ff153820640 1 -- start start 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 0x7ff14c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff14c1570c0 0x7ff14c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0cde80 con 0x7ff14c0c9e30 2023-12-19T16:15:27.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1576c0 con 0x7ff14c06c4f0 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c158490 con 0x7ff14c1570c0 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 0x7ff14c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 0x7ff14c159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55190/0 (socket says 172.21.15.119:55190) 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 -- 172.21.15.119:0/1739546096 learned_addr learned my addr 172.21.15.119:0/1739546096 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff1515bc640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 -- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff14c1570c0 msgr2=0x7ff14c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff151dbd640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff14c1570c0 0x7ff14c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff14c1570c0 0x7ff14c14d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 -- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff14c06c4f0 msgr2=0x7ff14c0c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 -- 172.21.15.119:0/1739546096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0094d0 con 0x7ff14c0c9e30 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff1515bc640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:27.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff151dbd640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff14c1570c0 0x7ff14c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff150dbb640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 0x7ff14c159e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff13c01a0b0 tx=0x7ff13c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c004020 con 0x7ff14c0c9e30 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c004180 con 0x7ff14c0c9e30 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0044f0 con 0x7ff14c0c9e30 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 -- 172.21.15.119:0/1739546096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c157910 con 0x7ff14c0c9e30 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff153820640 1 -- 172.21.15.119:0/1739546096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c157ed0 con 0x7ff14c0c9e30 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff128005260 con 0x7ff14c0c9e30 2023-12-19T16:15:27.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.500+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff13c0b3050 con 0x7ff14c0c9e30 2023-12-19T16:15:27.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.504+0000 7ff141ffb640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff130065a60 0x7ff130067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:27.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.504+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff13c11d3d0 con 0x7ff14c0c9e30 2023-12-19T16:15:27.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.504+0000 7ff1515bc640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff130065a60 0x7ff130067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:27.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.504+0000 7ff1515bc640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff130065a60 0x7ff130067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f70 tx=0x7ff148009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:27.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.508+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff13c0eab20 con 0x7ff14c0c9e30 2023-12-19T16:15:27.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff128005d20 con 0x7ff14c0c9e30 2023-12-19T16:15:27.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff141ffb640 1 -- 172.21.15.119:0/1739546096 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff13c0ee140 con 0x7ff14c0c9e30 2023-12-19T16:15:27.693 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff130065a60 msgr2=0x7ff130067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff130065a60 0x7ff130067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f70 tx=0x7ff148009040 comp rx=0 tx=0).stop 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 msgr2=0x7ff14c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 0x7ff14c159e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff13c01a0b0 tx=0x7ff13c01acc0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 shutdown_connections 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff130065a60 0x7ff130067f20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff14c1570c0 0x7ff14c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff14c0c9e30 0x7ff14c159e60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 --2- 172.21.15.119:0/1739546096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff14c06c4f0 0x7ff14c0c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:27.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 >> 172.21.15.119:0/1739546096 conn(0x7ff14c06a3e0 msgr2=0x7ff14c0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:27.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 shutdown_connections 2023-12-19T16:15:27.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:27.692+0000 7ff12f7fe640 1 -- 172.21.15.119:0/1739546096 wait complete. 2023-12-19T16:15:27.714 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T16:15:27.714 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:27.714 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:15:27.714 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-19T16:15:27.714 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:27.714 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T16:15:27.715 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:27.715 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:27.715 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-19T16:15:27.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:27.715 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:15:27.725 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:27.726 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42431sec preferred_lft 42431sec 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:15:27.727 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:27.728 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:27.728 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:27.728 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:27.728 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:27.729 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T16:15:27.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T16:15:27.729 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:27.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:27.838 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:27.858 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:15:27.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:27.860 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:15:27.929 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:15:27.929 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:27.929 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:27.929 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:27.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:27.930 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:27.930 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:27.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:27.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:27.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:27.931 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:28.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.023 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:15:28.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.033 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-12-19T16:15:28.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.090 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:28.090 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:28.090 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-19T16:15:28.090 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-19T16:15:28.090 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:28.172 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-19T16:15:28.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-19T16:15:28.173 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:28.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.365 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:28.365 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:28.365 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:15:28.365 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T16:15:28.366 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:28.406 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-19T16:15:28.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:28.406 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:28.457 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-19T16:15:28.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:28.457 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:28.508 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:28.573 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:28.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:28.635 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:28.637 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:28.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.637 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:28.688 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:15:28.688 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-19T16:15:28.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:28.756 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:28.756 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:28.819 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:28.821 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:28.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:28.821 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:28.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:2023-12-19T16:15:28.836+0000 7fb1ae846580 -1 init, newargv = 0x55dc3dd20c80 newargc=15 2023-12-19T16:15:28.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[44401]: starting ceph client 2023-12-19T16:15:28.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[44401]: starting fuse 2023-12-19T16:15:29.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:29.972 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:29.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:30.042 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:30.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:30.043 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:30.097 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:15:30.097 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:15:30.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:30.098 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.admin")) 2023-12-19T16:15:30.099 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:15:30.229 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.admin.44401.asok 2023-12-19T16:15:30.412 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44401.asok 2023-12-19T16:15:30.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:30.412 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44401.asok status 2023-12-19T16:15:30.588 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "admin", 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "44401", 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4455, 2023-12-19T16:15:30.589 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4455 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 4058334228 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 4058334228 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:30.590 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4455 192.168.0.1:0/4058334228", 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/4058334228", 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 7, 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 24, 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:15:30.591 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:15:30.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:30.603 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:15:30.603 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:30.613 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:15:30.613 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:30.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:30.613 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:30.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:30.681 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-19T16:15:30.756 INFO:teuthology.orchestra.run.smithi119.stdout:# file: . 2023-12-19T16:15:30.756 INFO:teuthology.orchestra.run.smithi119.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-19T16:15:30.756 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:30.757 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:15:30.757 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:15:30.813 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:30.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.987+0000 7fc6bc396640 1 Processor -- start 2023-12-19T16:15:30.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.987+0000 7fc6bc396640 1 -- start start 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6bc396640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b415a680 0x7fc6b415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6bc396640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6b40cac10 0x7fc6b415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6bc396640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b415f100 con 0x7fc6b415afa0 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6bc396640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b40ca7d0 con 0x7fc6b40cac10 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6bc396640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b415e860 con 0x7fc6b415a680 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6b9931640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6b40cac10 0x7fc6b415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6ba132640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b415a680 0x7fc6b415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6ba933640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc6b415afa0 0x7fc6b406fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:38658/0 (socket says 172.21.15.119:38658) 2023-12-19T16:15:30.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6ba933640 1 -- 172.21.15.119:0/1299647806 learned_addr learned my addr 172.21.15.119:0/1299647806 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:30.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6b9931640 1 -- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b415a680 msgr2=0x7fc6b415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:30.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6b9931640 1 --2- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b415a680 0x7fc6b415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:30.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6b9931640 1 -- 172.21.15.119:0/1299647806 >> v1:172.21.15.143:6789/0 conn(0x7fc6b415afa0 legacy=0x7fc6b406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:30.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6b9130640 1 -- 172.21.15.119:0/1299647806 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906498303 0 0) 0x7fc6b415f100 con 0x7fc6b415afa0 2023-12-19T16:15:30.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.991+0000 7fc6b9931640 1 -- 172.21.15.119:0/1299647806 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b415eb40 con 0x7fc6b40cac10 2023-12-19T16:15:30.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6b9931640 1 --2- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b40cac10 0x7fc6b415aa60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40097c0 tx=0x7fc6a401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46e315203174ca8f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6b9130640 1 -- 172.21.15.119:0/1299647806 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40ab410 con 0x7fc6b40cac10 2023-12-19T16:15:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6b9130640 1 -- 172.21.15.119:0/1299647806 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a40ab570 con 0x7fc6b40cac10 2023-12-19T16:15:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6b9130640 1 -- 172.21.15.119:0/1299647806 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40ab900 con 0x7fc6b40cac10 2023-12-19T16:15:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 -- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b40cac10 msgr2=0x7fc6b415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 --2- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b40cac10 0x7fc6b415aa60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40097c0 tx=0x7fc6a401c3f0 comp rx=0 tx=0).stop 2023-12-19T16:15:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 -- 172.21.15.119:0/1299647806 shutdown_connections 2023-12-19T16:15:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 --2- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b40cac10 0x7fc6b415aa60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 --2- 172.21.15.119:0/1299647806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b415a680 0x7fc6b415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 -- 172.21.15.119:0/1299647806 >> 172.21.15.119:0/1299647806 conn(0x7fc6b406a3e0 msgr2=0x7fc6b40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 -- 172.21.15.119:0/1299647806 shutdown_connections 2023-12-19T16:15:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.995+0000 7fc6bc396640 1 -- 172.21.15.119:0/1299647806 wait complete. 2023-12-19T16:15:31.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 Processor -- start 2023-12-19T16:15:31.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- start start 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b40cac10 0x7fc6b415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 0x7fc6b4140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b415afa0 0x7fc6b41405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c8130 con 0x7fc6b415a680 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4143020 con 0x7fc6b415afa0 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4143300 con 0x7fc6b40cac10 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 0x7fc6b4140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 0x7fc6b4140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55202/0 (socket says 172.21.15.119:55202) 2023-12-19T16:15:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 -- 172.21.15.119:0/3514667989 learned_addr learned my addr 172.21.15.119:0/3514667989 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6ba933640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b415afa0 0x7fc6b41405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6ba132640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b40cac10 0x7fc6b415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 -- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b40cac10 msgr2=0x7fc6b415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b40cac10 0x7fc6b415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 -- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b415afa0 msgr2=0x7fc6b41405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b415afa0 0x7fc6b41405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 -- 172.21.15.119:0/3514667989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a4009420 con 0x7fc6b415a680 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6b9931640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 0x7fc6b4140060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40ad040 tx=0x7fc6a401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40ab410 con 0x7fc6b415a680 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a40b5830 con 0x7fc6b415a680 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40b5be0 con 0x7fc6b415a680 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b41435e0 con 0x7fc6b415a680 2023-12-19T16:15:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b4143b00 con 0x7fc6b415a680 2023-12-19T16:15:31.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:30.999+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b4142e90 con 0x7fc6b415a680 2023-12-19T16:15:31.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.003+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6a40b5d40 con 0x7fc6b415a680 2023-12-19T16:15:31.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.003+0000 7fc6aaffd640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc698065a60 0x7fc698067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.003+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6a411db10 con 0x7fc6b415a680 2023-12-19T16:15:31.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.003+0000 7fc6ba132640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc698065a60 0x7fc698067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.003+0000 7fc6ba132640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc698065a60 0x7fc698067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0015230 tx=0x7fc6b000f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.007+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc6a40eb300 con 0x7fc6b415a680 2023-12-19T16:15:31.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6b40735b0 con 0x7fc6b415a680 2023-12-19T16:15:31.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6aaffd640 1 -- 172.21.15.119:0/3514667989 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc6a4006e20 con 0x7fc6b415a680 2023-12-19T16:15:31.163 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:31.163 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:31.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc698065a60 msgr2=0x7fc698067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc698065a60 0x7fc698067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0015230 tx=0x7fc6b000f040 comp rx=0 tx=0).stop 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 msgr2=0x7fc6b4140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 0x7fc6b4140060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40ad040 tx=0x7fc6a401ac30 comp rx=0 tx=0).stop 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 shutdown_connections 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc698065a60 0x7fc698067f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6b415afa0 0x7fc6b41405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b415a680 0x7fc6b4140060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.159+0000 7fc6bc396640 1 --2- 172.21.15.119:0/3514667989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6b40cac10 0x7fc6b415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.163+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 >> 172.21.15.119:0/3514667989 conn(0x7fc6b406a3e0 msgr2=0x7fc6b4159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.163+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 shutdown_connections 2023-12-19T16:15:31.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.163+0000 7fc6bc396640 1 -- 172.21.15.119:0/3514667989 wait complete. 2023-12-19T16:15:31.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:15:31.184 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.319+0000 7f71d44f9640 1 Processor -- start 2023-12-19T16:15:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.319+0000 7f71d44f9640 1 -- start start 2023-12-19T16:15:31.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d44f9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71cc0c9690 0x7f71cc160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d44f9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc142cd0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d44f9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc1604c0 con 0x7f71cc0ceac0 2023-12-19T16:15:31.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d44f9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc142fb0 con 0x7f71cc0c9690 2023-12-19T16:15:31.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d2295640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f71cc0c92b0 0x7f71cc0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60972/0 (socket says 172.21.15.119:60972) 2023-12-19T16:15:31.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d2295640 1 -- 172.21.15.119:0/1560581770 learned_addr learned my addr 172.21.15.119:0/1560581770 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:31.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d2a96640 1 --2- 172.21.15.119:0/1560581770 >> v2:172.21.15.119:3300/0 conn(0x7f71cc0c9690 0x7f71cc160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d1293640 1 -- 172.21.15.119:0/1560581770 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170059747 0 0) 0x7f71cc142cd0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d1293640 1 -- 172.21.15.119:0/1560581770 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b8003530 con 0x7f71cc0c92b0 2023-12-19T16:15:31.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d2a96640 1 -- 172.21.15.119:0/1560581770 >> v1:172.21.15.143:6789/0 conn(0x7f71cc0ceac0 legacy=0x7f71cc142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d2a96640 1 -- 172.21.15.119:0/1560581770 >> v1:172.21.15.119:6789/0 conn(0x7f71cc0c92b0 legacy=0x7f71cc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.323+0000 7f71d2a96640 1 -- 172.21.15.119:0/1560581770 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc1607a0 con 0x7f71cc0c9690 2023-12-19T16:15:31.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d2a96640 1 --2- 172.21.15.119:0/1560581770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c9690 0x7f71cc160fa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009d90 tx=0x7f71c401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38ad88e732a9a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d1293640 1 -- 172.21.15.119:0/1560581770 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40a59a0 con 0x7f71cc0c9690 2023-12-19T16:15:31.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d1293640 1 -- 172.21.15.119:0/1560581770 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c40a5b00 con 0x7f71cc0c9690 2023-12-19T16:15:31.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d1293640 1 -- 172.21.15.119:0/1560581770 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40a5e70 con 0x7f71cc0c9690 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 -- 172.21.15.119:0/1560581770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c9690 msgr2=0x7f71cc160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1560581770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c9690 0x7f71cc160fa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009d90 tx=0x7f71c401c8c0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 -- 172.21.15.119:0/1560581770 shutdown_connections 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1560581770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c9690 0x7f71cc160fa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 -- 172.21.15.119:0/1560581770 >> 172.21.15.119:0/1560581770 conn(0x7f71cc06a2a0 msgr2=0x7f71cc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 -- 172.21.15.119:0/1560581770 shutdown_connections 2023-12-19T16:15:31.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 -- 172.21.15.119:0/1560581770 wait complete. 2023-12-19T16:15:31.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 Processor -- start 2023-12-19T16:15:31.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.327+0000 7f71d44f9640 1 -- start start 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 0x7f71cc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71cc0c9690 0x7f71cc156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71cc0ceac0 0x7f71cc140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc15bcd0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc15bfb0 con 0x7f71cc0c9690 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc15c290 con 0x7f71cc0ceac0 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 0x7f71cc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 0x7f71cc15ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55214/0 (socket says 172.21.15.119:55214) 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 -- 172.21.15.119:0/1189857837 learned_addr learned my addr 172.21.15.119:0/1189857837 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d1a94640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71cc0c9690 0x7f71cc156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2a96640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71cc0ceac0 0x7f71cc140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 -- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71cc0ceac0 msgr2=0x7f71cc140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71cc0ceac0 0x7f71cc140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 -- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71cc0c9690 msgr2=0x7f71cc156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71cc0c9690 0x7f71cc156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 -- 172.21.15.119:0/1189857837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009a70 con 0x7f71cc0c92b0 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d2295640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 0x7f71cc15ce10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c4d0 tx=0x7f71c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8005cf0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8005e50 con 0x7f71cc0c92b0 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8007270 con 0x7f71cc0c92b0 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc15c570 con 0x7f71cc0c92b0 2023-12-19T16:15:31.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc156670 con 0x7f71cc0c92b0 2023-12-19T16:15:31.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc156890 con 0x7f71cc0c92b0 2023-12-19T16:15:31.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.331+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f71c80073d0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.335+0000 7f71c2ffd640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f71b0065a60 0x7f71b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.335+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71c8082950 con 0x7f71cc0c92b0 2023-12-19T16:15:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.335+0000 7f71d1a94640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f71b0065a60 0x7f71b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.335+0000 7f71d1a94640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f71b0065a60 0x7f71b0067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0ce7d0 tx=0x7f71bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.339+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f71c80500c0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71cc04e000 con 0x7f71cc0c92b0 2023-12-19T16:15:31.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71c2ffd640 1 -- 172.21.15.119:0/1189857837 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71c80170a0 con 0x7f71cc0c92b0 2023-12-19T16:15:31.490 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f71b0065a60 msgr2=0x7f71b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f71b0065a60 0x7f71b0067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0ce7d0 tx=0x7f71bc009040 comp rx=0 tx=0).stop 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 msgr2=0x7f71cc15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 0x7f71cc15ce10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c4d0 tx=0x7f71c800c990 comp rx=0 tx=0).stop 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 shutdown_connections 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f71b0065a60 0x7f71b0067f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71cc0c9690 0x7f71cc156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71cc0ceac0 0x7f71cc140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 --2- 172.21.15.119:0/1189857837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc0c92b0 0x7f71cc15ce10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 >> 172.21.15.119:0/1189857837 conn(0x7f71cc06a2a0 msgr2=0x7f71cc0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:31.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 shutdown_connections 2023-12-19T16:15:31.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.487+0000 7f71d44f9640 1 -- 172.21.15.119:0/1189857837 wait complete. 2023-12-19T16:15:31.511 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:15:31.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.647+0000 7f9c193f3640 1 Processor -- start 2023-12-19T16:15:31.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.647+0000 7f9c193f3640 1 -- start start 2023-12-19T16:15:31.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c193f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9c140ca410 0x7f9c14159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c193f3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c14159fb0 0x7f9c14071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c193f3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c14070df0 con 0x7f9c14071db0 2023-12-19T16:15:31.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c193f3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1415aab0 con 0x7f9c140ca410 2023-12-19T16:15:31.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c193f3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1415a4f0 con 0x7f9c14159fb0 2023-12-19T16:15:31.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c137fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9c14071db0 0x7f9c140cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60974/0 (socket says 172.21.15.119:60974) 2023-12-19T16:15:31.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c137fe640 1 -- 172.21.15.119:0/2113137300 learned_addr learned my addr 172.21.15.119:0/2113137300 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:31.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c12ffd640 1 --2- 172.21.15.119:0/2113137300 >> v2:172.21.15.119:3300/0 conn(0x7f9c140ca410 0x7f9c14159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c0bfff640 1 --2- 172.21.15.119:0/2113137300 >> v2:172.21.15.143:3300/0 conn(0x7f9c14159fb0 0x7f9c14071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c127fc640 1 -- 172.21.15.119:0/2113137300 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001885168 0 0) 0x7f9c14070df0 con 0x7f9c14071db0 2023-12-19T16:15:31.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c12ffd640 1 -- 172.21.15.119:0/2113137300 >> v2:172.21.15.143:3300/0 conn(0x7f9c14159fb0 msgr2=0x7f9c14071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:31.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c12ffd640 1 --2- 172.21.15.119:0/2113137300 >> v2:172.21.15.143:3300/0 conn(0x7f9c14159fb0 0x7f9c14071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c12ffd640 1 -- 172.21.15.119:0/2113137300 >> v1:172.21.15.119:6789/0 conn(0x7f9c14071db0 legacy=0x7f9c140cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.651+0000 7f9c12ffd640 1 -- 172.21.15.119:0/2113137300 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1415a7d0 con 0x7f9c140ca410 2023-12-19T16:15:31.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c12ffd640 1 --2- 172.21.15.119:0/2113137300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c140ca410 0x7f9c14159a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c140cbeb0 tx=0x7f9c0401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9db210c5b44c58a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c127fc640 1 -- 172.21.15.119:0/2113137300 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c040ab600 con 0x7f9c140ca410 2023-12-19T16:15:31.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c127fc640 1 -- 172.21.15.119:0/2113137300 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c040a7050 con 0x7f9c140ca410 2023-12-19T16:15:31.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c127fc640 1 -- 172.21.15.119:0/2113137300 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c040ab980 con 0x7f9c140ca410 2023-12-19T16:15:31.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 -- 172.21.15.119:0/2113137300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c140ca410 msgr2=0x7f9c14159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 --2- 172.21.15.119:0/2113137300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c140ca410 0x7f9c14159a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c140cbeb0 tx=0x7f9c0401c430 comp rx=0 tx=0).stop 2023-12-19T16:15:31.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 -- 172.21.15.119:0/2113137300 shutdown_connections 2023-12-19T16:15:31.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 --2- 172.21.15.119:0/2113137300 >> v2:172.21.15.143:3300/0 conn(0x7f9c14159fb0 0x7f9c14071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 --2- 172.21.15.119:0/2113137300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c140ca410 0x7f9c14159a70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 -- 172.21.15.119:0/2113137300 >> 172.21.15.119:0/2113137300 conn(0x7f9c1406a2a0 msgr2=0x7f9c140aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:31.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 -- 172.21.15.119:0/2113137300 shutdown_connections 2023-12-19T16:15:31.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 -- 172.21.15.119:0/2113137300 wait complete. 2023-12-19T16:15:31.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 Processor -- start 2023-12-19T16:15:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.655+0000 7f9c193f3640 1 -- start start 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c14071db0 0x7f9c141546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c140ca410 0x7f9c14154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 0x7f9c14141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141434b0 con 0x7f9c14159fb0 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140c1250 con 0x7f9c14071db0 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141425e0 con 0x7f9c140ca410 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 0x7f9c14141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 0x7f9c14141520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55236/0 (socket says 172.21.15.119:55236) 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 -- 172.21.15.119:0/4003424049 learned_addr learned my addr 172.21.15.119:0/4003424049 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c12ffd640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c14071db0 0x7f9c141546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 -- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c140ca410 msgr2=0x7f9c14154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c140ca410 0x7f9c14154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 -- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c14071db0 msgr2=0x7f9c141546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c14071db0 0x7f9c141546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 -- 172.21.15.119:0/4003424049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009420 con 0x7f9c14159fb0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c137fe640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 0x7f9c14141520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00c780 tx=0x7f9c0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00ce90 con 0x7f9c14159fb0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00a640 con 0x7f9c14159fb0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c14142830 con 0x7f9c14159fb0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00a9d0 con 0x7f9c14159fb0 2023-12-19T16:15:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c14142df0 con 0x7f9c14159fb0 2023-12-19T16:15:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c141435f0 con 0x7f9c14159fb0 2023-12-19T16:15:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.659+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c0c00ab30 con 0x7f9c14159fb0 2023-12-19T16:15:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.663+0000 7f9c0b7fe640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9bf4065a60 0x7f9bf4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.663+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c0c082bb0 con 0x7f9c14159fb0 2023-12-19T16:15:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.663+0000 7f9c12ffd640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9bf4065a60 0x7f9bf4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.663+0000 7f9c12ffd640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9bf4065a60 0x7f9bf4067f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c140c1ef0 tx=0x7f9c04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.667+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9c141435f0 con 0x7f9c14159fb0 2023-12-19T16:15:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.811+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c141435f0 con 0x7f9c14159fb0 2023-12-19T16:15:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.811+0000 7f9c0b7fe640 1 -- 172.21.15.119:0/4003424049 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c0c018020 con 0x7f9c14159fb0 2023-12-19T16:15:31.816 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9bf4065a60 msgr2=0x7f9bf4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9bf4065a60 0x7f9bf4067f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c140c1ef0 tx=0x7f9c04008040 comp rx=0 tx=0).stop 2023-12-19T16:15:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 msgr2=0x7f9c14141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 0x7f9c14141520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00c780 tx=0x7f9c0c00cc40 comp rx=0 tx=0).stop 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 shutdown_connections 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9bf4065a60 0x7f9bf4067f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c14159fb0 0x7f9c14141520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c140ca410 0x7f9c14154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 --2- 172.21.15.119:0/4003424049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c14071db0 0x7f9c141546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 >> 172.21.15.119:0/4003424049 conn(0x7f9c1406a2a0 msgr2=0x7f9c14157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 shutdown_connections 2023-12-19T16:15:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.815+0000 7f9c193f3640 1 -- 172.21.15.119:0/4003424049 wait complete. 2023-12-19T16:15:31.837 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:15:31.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 Processor -- start 2023-12-19T16:15:31.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 -- start start 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd3c0ce3b0 0x7fcd3c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c0c9390 con 0x7fcd3c1582d0 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c0ced80 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.975+0000 7fcd42318640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c15aee0 con 0x7fcd3c070820 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd3c0ce3b0 0x7fcd3c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd3c0ce3b0 0x7fcd3c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55250/0 (socket says 172.21.15.119:55250) 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 -- 172.21.15.119:0/4141431682 learned_addr learned my addr 172.21.15.119:0/4141431682 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd3b7fe640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 -- 172.21.15.119:0/4141431682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 msgr2=0x7fcd3c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 -- 172.21.15.119:0/4141431682 >> v1:172.21.15.143:6789/0 conn(0x7fcd3c1582d0 legacy=0x7fcd3c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 -- 172.21.15.119:0/4141431682 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c15b1c0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd3b7fe640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd408b5640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c0ce840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009e50 tx=0x7fcd3401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd9ed0d914f1b75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd3affd640 1 -- 172.21.15.119:0/4141431682 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340a58a0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd3affd640 1 -- 172.21.15.119:0/4141431682 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd340a5a00 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.979+0000 7fcd3affd640 1 -- 172.21.15.119:0/4141431682 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340a5d90 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- 172.21.15.119:0/4141431682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 msgr2=0x7fcd3c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c0ce840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009e50 tx=0x7fcd3401c9e0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- 172.21.15.119:0/4141431682 shutdown_connections 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c0ce840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 --2- 172.21.15.119:0/4141431682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- 172.21.15.119:0/4141431682 >> 172.21.15.119:0/4141431682 conn(0x7fcd3c06a2a0 msgr2=0x7fcd3c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- 172.21.15.119:0/4141431682 shutdown_connections 2023-12-19T16:15:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- 172.21.15.119:0/4141431682 wait complete. 2023-12-19T16:15:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 Processor -- start 2023-12-19T16:15:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- start start 2023-12-19T16:15:31.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd3c1582d0 0x7fcd3c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c151aa0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c154390 con 0x7fcd3c1582d0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd42318640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c151510 con 0x7fcd3c070820 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55266/0 (socket says 172.21.15.119:55266) 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 -- 172.21.15.119:0/356705907 learned_addr learned my addr 172.21.15.119:0/356705907 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd408b5640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd3c1582d0 0x7fcd3c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3bfff640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 -- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 msgr2=0x7fcd3c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c15ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 -- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd3c1582d0 msgr2=0x7fcd3c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd3c1582d0 0x7fcd3c150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 -- 172.21.15.119:0/356705907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34009b30 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.983+0000 7fcd3b7fe640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c150a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000e810 tx=0x7fcd3000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000c8d0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000ca30 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000cde0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c15efd0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c153dd0 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c04e000 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcd30013410 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd38ff9640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcd28065a60 0x7fcd28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:31.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd30083300 con 0x7fcd3c0ce3b0 2023-12-19T16:15:31.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.987+0000 7fcd3bfff640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcd28065a60 0x7fcd28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:31.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.991+0000 7fcd3bfff640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcd28065a60 0x7fcd28067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c000f70 tx=0x7fcd2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:31.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:31.991+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcd30050930 con 0x7fcd3c0ce3b0 2023-12-19T16:15:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.139+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd3c0b0c00 con 0x7fcd3c0ce3b0 2023-12-19T16:15:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.139+0000 7fcd38ff9640 1 -- 172.21.15.119:0/356705907 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd30053f50 con 0x7fcd3c0ce3b0 2023-12-19T16:15:32.144 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:15:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcd28065a60 msgr2=0x7fcd28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcd28065a60 0x7fcd28067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c000f70 tx=0x7fcd2c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 msgr2=0x7fcd3c150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c150a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000e810 tx=0x7fcd3000ecd0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 shutdown_connections 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcd28065a60 0x7fcd28067f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd3c1582d0 0x7fcd3c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd3c0ce3b0 0x7fcd3c150a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 --2- 172.21.15.119:0/356705907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3c070820 0x7fcd3c15ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 >> 172.21.15.119:0/356705907 conn(0x7fcd3c06a2a0 msgr2=0x7fcd3c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 shutdown_connections 2023-12-19T16:15:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.143+0000 7fcd42318640 1 -- 172.21.15.119:0/356705907 wait complete. 2023-12-19T16:15:32.166 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:15:32.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 Processor -- start 2023-12-19T16:15:32.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 -- start start 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8258160a60 0x7f82580ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82580ce8f0 0x7f8258164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8258164e60 0x7f82580cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580ced50 con 0x7f8258164e60 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580cc980 con 0x7f8258160a60 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825fc66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580cc090 con 0x7f82580ce8f0 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8258164e60 0x7f82580cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8258164e60 0x7f82580cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55270/0 (socket says 172.21.15.119:55270) 2023-12-19T16:15:32.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 -- 172.21.15.119:0/2335826467 learned_addr learned my addr 172.21.15.119:0/2335826467 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825d201640 1 --2- 172.21.15.119:0/2335826467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82580ce8f0 0x7f8258164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825da02640 1 --2- 172.21.15.119:0/2335826467 >> v2:172.21.15.143:3300/0 conn(0x7f8258160a60 0x7f82580ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 -- 172.21.15.119:0/2335826467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82580ce8f0 msgr2=0x7f8258164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 --2- 172.21.15.119:0/2335826467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82580ce8f0 0x7f8258164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 -- 172.21.15.119:0/2335826467 >> v2:172.21.15.143:3300/0 conn(0x7f8258160a60 msgr2=0x7f82580ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 --2- 172.21.15.119:0/2335826467 >> v2:172.21.15.143:3300/0 conn(0x7f8258160a60 0x7f82580ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825e203640 1 -- 172.21.15.119:0/2335826467 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580cc330 con 0x7f8258164e60 2023-12-19T16:15:32.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.303+0000 7f825da02640 1 --2- 172.21.15.119:0/2335826467 >> v2:172.21.15.143:3300/0 conn(0x7f8258160a60 0x7f82580ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:32.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825e203640 1 --2- 172.21.15.119:0/2335826467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258164e60 0x7f82580cad30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f82580b07c0 tx=0x7f825001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f0d52848b4d59c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:32.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825ca00640 1 -- 172.21.15.119:0/2335826467 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500a5840 con 0x7f8258164e60 2023-12-19T16:15:32.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825ca00640 1 -- 172.21.15.119:0/2335826467 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500a59a0 con 0x7f8258164e60 2023-12-19T16:15:32.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825ca00640 1 -- 172.21.15.119:0/2335826467 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500a5d30 con 0x7f8258164e60 2023-12-19T16:15:32.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 -- 172.21.15.119:0/2335826467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258164e60 msgr2=0x7f82580cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 --2- 172.21.15.119:0/2335826467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258164e60 0x7f82580cad30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f82580b07c0 tx=0x7f825001c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 -- 172.21.15.119:0/2335826467 shutdown_connections 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 --2- 172.21.15.119:0/2335826467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258164e60 0x7f82580cad30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 --2- 172.21.15.119:0/2335826467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82580ce8f0 0x7f8258164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 --2- 172.21.15.119:0/2335826467 >> v2:172.21.15.143:3300/0 conn(0x7f8258160a60 0x7f82580ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 -- 172.21.15.119:0/2335826467 >> 172.21.15.119:0/2335826467 conn(0x7f825806a2a0 msgr2=0x7f82580aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 -- 172.21.15.119:0/2335826467 shutdown_connections 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.307+0000 7f825fc66640 1 -- 172.21.15.119:0/2335826467 wait complete. 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 Processor -- start 2023-12-19T16:15:32.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 -- start start 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82580ce8f0 0x7f8258158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 0x7f82581594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8258164e60 0x7f825815b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825815a930 con 0x7f8258160a60 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82581639c0 con 0x7f82580ce8f0 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8258159a10 con 0x7f8258164e60 2023-12-19T16:15:32.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 0x7f82581594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 0x7f82581594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55280/0 (socket says 172.21.15.119:55280) 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 -- 172.21.15.119:0/1407867128 learned_addr learned my addr 172.21.15.119:0/1407867128 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825da02640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82580ce8f0 0x7f8258158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825e203640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8258164e60 0x7f825815b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 -- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8258164e60 msgr2=0x7f825815b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8258164e60 0x7f825815b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 -- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82580ce8f0 msgr2=0x7f8258158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82580ce8f0 0x7f8258158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 -- 172.21.15.119:0/1407867128 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009b30 con 0x7f8258160a60 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825d201640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 0x7f82581594d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f824800d5f0 tx=0x7f824800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480125f0 con 0x7f8258160a60 2023-12-19T16:15:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248012750 con 0x7f8258160a60 2023-12-19T16:15:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8258159cb0 con 0x7f8258160a60 2023-12-19T16:15:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248012ae0 con 0x7f8258160a60 2023-12-19T16:15:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.311+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825815a270 con 0x7f8258160a60 2023-12-19T16:15:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.315+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825815aa70 con 0x7f8258160a60 2023-12-19T16:15:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.315+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8248012c40 con 0x7f8258160a60 2023-12-19T16:15:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.315+0000 7f824e7fc640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f823c065a90 0x7f823c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.315+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8248083a00 con 0x7f8258160a60 2023-12-19T16:15:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.315+0000 7f825da02640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f823c065a90 0x7f823c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.315+0000 7f825da02640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f823c065a90 0x7f823c067f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f825400d8d0 tx=0x7f8254008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:32.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.319+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f825815aa70 con 0x7f8258160a60 2023-12-19T16:15:32.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.467+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f825815aa70 con 0x7f8258160a60 2023-12-19T16:15:32.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.467+0000 7f824e7fc640 1 -- 172.21.15.119:0/1407867128 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f825815aa70 con 0x7f8258160a60 2023-12-19T16:15:32.472 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f823c065a90 msgr2=0x7f823c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f823c065a90 0x7f823c067f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f825400d8d0 tx=0x7f8254008040 comp rx=0 tx=0).stop 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 msgr2=0x7f82581594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 0x7f82581594d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f824800d5f0 tx=0x7f824800dab0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 shutdown_connections 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f823c065a90 0x7f823c067f50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8258164e60 0x7f825815b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8258160a60 0x7f82581594d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 --2- 172.21.15.119:0/1407867128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82580ce8f0 0x7f8258158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 >> 172.21.15.119:0/1407867128 conn(0x7f825806a2a0 msgr2=0x7f82580c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 shutdown_connections 2023-12-19T16:15:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.471+0000 7f825fc66640 1 -- 172.21.15.119:0/1407867128 wait complete. 2023-12-19T16:15:32.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:15:32.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98552f9640 1 Processor -- start 2023-12-19T16:15:32.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98552f9640 1 -- start start 2023-12-19T16:15:32.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98552f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9850157080 0x7f98500ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98552f9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98500d1320 con 0x7f98500cd730 2023-12-19T16:15:32.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98552f9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98500cc970 con 0x7f98500d0cc0 2023-12-19T16:15:32.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98552f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9850157460 con 0x7f9850157080 2023-12-19T16:15:32.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98467fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f98500cd730 0x7f98500d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51946/0 (socket says 172.21.15.119:51946) 2023-12-19T16:15:32.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f98467fc640 1 -- 172.21.15.119:0/141868690 learned_addr learned my addr 172.21.15.119:0/141868690 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:32.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984effd640 1 --2- 172.21.15.119:0/141868690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9850157080 0x7f98500ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322479275 0 0) 0x7f98500d1320 con 0x7f98500cd730 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f983c003530 con 0x7f98500cd730 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284241402 0 0) 0x7f98500cc970 con 0x7f98500d0cc0 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98500d1320 con 0x7f98500d0cc0 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984effd640 1 -- 172.21.15.119:0/141868690 >> v1:172.21.15.143:6789/0 conn(0x7f98500d0cc0 legacy=0x7f98500cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984effd640 1 -- 172.21.15.119:0/141868690 >> v1:172.21.15.119:6789/0 conn(0x7f98500cd730 legacy=0x7f98500d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.635+0000 7f984effd640 1 -- 172.21.15.119:0/141868690 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500ccc50 con 0x7f9850157080 2023-12-19T16:15:32.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f984effd640 1 --2- 172.21.15.119:0/141868690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9850157080 0x7f98500ce210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98400097f0 tx=0x7f984001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1deeb856cf562e81 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400ab600 con 0x7f9850157080 2023-12-19T16:15:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98400a7050 con 0x7f9850157080 2023-12-19T16:15:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f984e7fc640 1 -- 172.21.15.119:0/141868690 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400ab960 con 0x7f9850157080 2023-12-19T16:15:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 -- 172.21.15.119:0/141868690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9850157080 msgr2=0x7f98500ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 --2- 172.21.15.119:0/141868690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9850157080 0x7f98500ce210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98400097f0 tx=0x7f984001c4c0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 -- 172.21.15.119:0/141868690 shutdown_connections 2023-12-19T16:15:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 --2- 172.21.15.119:0/141868690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9850157080 0x7f98500ce210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 -- 172.21.15.119:0/141868690 >> 172.21.15.119:0/141868690 conn(0x7f9850069ca0 msgr2=0x7f985006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 -- 172.21.15.119:0/141868690 shutdown_connections 2023-12-19T16:15:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.639+0000 7f98552f9640 1 -- 172.21.15.119:0/141868690 wait complete. 2023-12-19T16:15:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 Processor -- start 2023-12-19T16:15:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 -- start start 2023-12-19T16:15:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98500cd730 0x7f98500ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98500d0cc0 0x7f98500c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 0x7f98500c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98500ca6c0 con 0x7f9850157080 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98500c9140 con 0x7f98500d0cc0 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98500c93c0 con 0x7f98500cd730 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 0x7f98500c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 0x7f98500c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38300/0 (socket says 172.21.15.119:38300) 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 -- 172.21.15.119:0/3137971766 learned_addr learned my addr 172.21.15.119:0/3137971766 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984effd640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98500cd730 0x7f98500ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98467fc640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98500d0cc0 0x7f98500c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 -- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98500cd730 msgr2=0x7f98500ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98500cd730 0x7f98500ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 -- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98500d0cc0 msgr2=0x7f98500c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98500d0cc0 0x7f98500c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 -- 172.21.15.119:0/3137971766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009420 con 0x7f9850157080 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f984f7fe640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 0x7f98500c6110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f984800c790 tx=0x7f984800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984800cea0 con 0x7f9850157080 2023-12-19T16:15:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9848003b80 con 0x7f9850157080 2023-12-19T16:15:32.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984800a850 con 0x7f9850157080 2023-12-19T16:15:32.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98500c96a0 con 0x7f9850157080 2023-12-19T16:15:32.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.643+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98500c9c60 con 0x7f9850157080 2023-12-19T16:15:32.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.647+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985004e000 con 0x7f9850157080 2023-12-19T16:15:32.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.647+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f984800a9b0 con 0x7f9850157080 2023-12-19T16:15:32.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.647+0000 7f9847fff640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9830065a60 0x7f9830067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:32.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.647+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9848083450 con 0x7f9850157080 2023-12-19T16:15:32.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.647+0000 7f984effd640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9830065a60 0x7f9830067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:32.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.647+0000 7f984effd640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9830065a60 0x7f9830067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98400ad000 tx=0x7f98400a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:32.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.651+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9848050a00 con 0x7f9850157080 2023-12-19T16:15:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.811+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f98500c9e20 con 0x7f9850157080 2023-12-19T16:15:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.811+0000 7f9847fff640 1 -- 172.21.15.119:0/3137971766 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9848054020 con 0x7f9850157080 2023-12-19T16:15:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:15:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9830065a60 msgr2=0x7f9830067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9830065a60 0x7f9830067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98400ad000 tx=0x7f98400a6000 comp rx=0 tx=0).stop 2023-12-19T16:15:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 msgr2=0x7f98500c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 0x7f98500c6110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f984800c790 tx=0x7f984800cc50 comp rx=0 tx=0).stop 2023-12-19T16:15:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 shutdown_connections 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9830065a60 0x7f9830067f20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98500d0cc0 0x7f98500c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9850157080 0x7f98500c6110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 --2- 172.21.15.119:0/3137971766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98500cd730 0x7f98500ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 >> 172.21.15.119:0/3137971766 conn(0x7f9850069ca0 msgr2=0x7f98500cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 shutdown_connections 2023-12-19T16:15:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:32.815+0000 7f98552f9640 1 -- 172.21.15.119:0/3137971766 wait complete. 2023-12-19T16:15:32.837 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:15:32.837 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:15:32.846 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:33.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 Processor -- start 2023-12-19T16:15:33.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 -- start start 2023-12-19T16:15:33.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f342415a680 0x7f342415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f342406fdb0 0x7f3424070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342415f100 con 0x7f34240cac10 2023-12-19T16:15:33.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3424070780 con 0x7f342406fdb0 2023-12-19T16:15:33.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f342a4e5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240ca7d0 con 0x7f342415a680 2023-12-19T16:15:33.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f34237fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f34240cac10 0x7f342415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51950/0 (socket says 172.21.15.119:51950) 2023-12-19T16:15:33.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3428a82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f342406fdb0 0x7f3424070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f34237fe640 1 -- 172.21.15.119:0/1771581068 learned_addr learned my addr 172.21.15.119:0/1771581068 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3423fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f342415a680 0x7f342415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3428a82640 1 -- 172.21.15.119:0/1771581068 >> v2:172.21.15.143:3300/0 conn(0x7f342415a680 msgr2=0x7f342415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3428a82640 1 --2- 172.21.15.119:0/1771581068 >> v2:172.21.15.143:3300/0 conn(0x7f342415a680 0x7f342415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3428a82640 1 -- 172.21.15.119:0/1771581068 >> v1:172.21.15.119:6789/0 conn(0x7f34240cac10 legacy=0x7f342415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3428a82640 1 -- 172.21.15.119:0/1771581068 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342415e860 con 0x7f342406fdb0 2023-12-19T16:15:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.027+0000 7f3422ffd640 1 -- 172.21.15.119:0/1771581068 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542516347 0 0) 0x7f342415f100 con 0x7f34240cac10 2023-12-19T16:15:33.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f3428a82640 1 --2- 172.21.15.119:0/1771581068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342406fdb0 0x7f3424070240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f341c009d90 tx=0x7f341c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a4cfa9f7e9532d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f3422ffd640 1 -- 172.21.15.119:0/1771581068 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0a5940 con 0x7f342406fdb0 2023-12-19T16:15:33.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f3422ffd640 1 -- 172.21.15.119:0/1771581068 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c0a5aa0 con 0x7f342406fdb0 2023-12-19T16:15:33.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f3422ffd640 1 -- 172.21.15.119:0/1771581068 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0a5e30 con 0x7f342406fdb0 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 -- 172.21.15.119:0/1771581068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342406fdb0 msgr2=0x7f3424070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 --2- 172.21.15.119:0/1771581068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342406fdb0 0x7f3424070240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f341c009d90 tx=0x7f341c01c880 comp rx=0 tx=0).stop 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 -- 172.21.15.119:0/1771581068 shutdown_connections 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 --2- 172.21.15.119:0/1771581068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342406fdb0 0x7f3424070240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 --2- 172.21.15.119:0/1771581068 >> v2:172.21.15.143:3300/0 conn(0x7f342415a680 0x7f342415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 -- 172.21.15.119:0/1771581068 >> 172.21.15.119:0/1771581068 conn(0x7f342406a3e0 msgr2=0x7f34240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 -- 172.21.15.119:0/1771581068 shutdown_connections 2023-12-19T16:15:33.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.031+0000 7f342a4e5640 1 -- 172.21.15.119:0/1771581068 wait complete. 2023-12-19T16:15:33.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 Processor -- start 2023-12-19T16:15:33.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- start start 2023-12-19T16:15:33.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f342406fdb0 0x7f3424151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34240cac10 0x7f34241524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 0x7f34241583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424152a10 con 0x7f342415a680 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424164070 con 0x7f342406fdb0 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240cdbf0 con 0x7f34240cac10 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 0x7f34241583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 0x7f34241583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38322/0 (socket says 172.21.15.119:38322) 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 -- 172.21.15.119:0/744492294 learned_addr learned my addr 172.21.15.119:0/744492294 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f34237fe640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34240cac10 0x7f34241524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3423fff640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f342406fdb0 0x7f3424151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 -- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34240cac10 msgr2=0x7f34241524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34240cac10 0x7f34241524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 -- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f342406fdb0 msgr2=0x7f3424151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f342406fdb0 0x7f3424151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 -- 172.21.15.119:0/744492294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c009a70 con 0x7f342415a680 2023-12-19T16:15:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f34237fe640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34240cac10 0x7f34241524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3423fff640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f342406fdb0 0x7f3424151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3428a82640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 0x7f34241583c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f341c01a4b0 tx=0x7f341c019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0add10 con 0x7f342415a680 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c0ade70 con 0x7f342415a680 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3424164320 con 0x7f342415a680 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0b9650 con 0x7f342415a680 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34241648e0 con 0x7f342415a680 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.035+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34240735b0 con 0x7f342415a680 2023-12-19T16:15:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.039+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f341c0b97b0 con 0x7f342415a680 2023-12-19T16:15:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.039+0000 7f3420ff9640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3410065a60 0x7f3410067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.039+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f341c11ebc0 con 0x7f342415a680 2023-12-19T16:15:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.039+0000 7f3423fff640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3410065a60 0x7f3410067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.039+0000 7f3423fff640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3410065a60 0x7f3410067f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3424165360 tx=0x7f3414008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.043+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f341c0ec1f0 con 0x7f342415a680 2023-12-19T16:15:33.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.195+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f342404e000 con 0x7f342415a680 2023-12-19T16:15:33.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.195+0000 7f3420ff9640 1 -- 172.21.15.119:0/744492294 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f341c009450 con 0x7f342415a680 2023-12-19T16:15:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:33.200 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3410065a60 msgr2=0x7f3410067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3410065a60 0x7f3410067f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3424165360 tx=0x7f3414008040 comp rx=0 tx=0).stop 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 msgr2=0x7f34241583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 0x7f34241583c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f341c01a4b0 tx=0x7f341c019620 comp rx=0 tx=0).stop 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 shutdown_connections 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3410065a60 0x7f3410067f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f342415a680 0x7f34241583c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34240cac10 0x7f34241524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 --2- 172.21.15.119:0/744492294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f342406fdb0 0x7f3424151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 >> 172.21.15.119:0/744492294 conn(0x7f342406a3e0 msgr2=0x7f342415dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 shutdown_connections 2023-12-19T16:15:33.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.199+0000 7f342a4e5640 1 -- 172.21.15.119:0/744492294 wait complete. 2023-12-19T16:15:33.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:15:33.222 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 Processor -- start 2023-12-19T16:15:33.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 -- start start 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c0c070820 0x7f8c0c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0c9390 con 0x7f8c0c1582d0 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0ced80 con 0x7f8c0c070820 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c10d39640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c15aee0 con 0x7f8c0c0ce3b0 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c0c070820 0x7f8c0c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c0c070820 0x7f8c0c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38338/0 (socket says 172.21.15.119:38338) 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 -- 172.21.15.119:0/3733459352 learned_addr learned my addr 172.21.15.119:0/3733459352 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c0ad9d640 1 --2- 172.21.15.119:0/3733459352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 -- 172.21.15.119:0/3733459352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 msgr2=0x7f8c0c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 --2- 172.21.15.119:0/3733459352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 -- 172.21.15.119:0/3733459352 >> v1:172.21.15.143:6789/0 conn(0x7f8c0c1582d0 legacy=0x7f8c0c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.359+0000 7f8c09d9b640 1 -- 172.21.15.119:0/3733459352 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c15b1c0 con 0x7f8c0c070820 2023-12-19T16:15:33.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c09d9b640 1 --2- 172.21.15.119:0/3733459352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c0c8e50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009870 tx=0x7f8c0001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0234d4d7ae0f18 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c0959a640 1 -- 172.21.15.119:0/3733459352 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c000aa670 con 0x7f8c0c070820 2023-12-19T16:15:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c0959a640 1 -- 172.21.15.119:0/3733459352 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c000aa7d0 con 0x7f8c0c070820 2023-12-19T16:15:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c0959a640 1 -- 172.21.15.119:0/3733459352 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c000aab60 con 0x7f8c0c070820 2023-12-19T16:15:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 -- 172.21.15.119:0/3733459352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 msgr2=0x7f8c0c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 --2- 172.21.15.119:0/3733459352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c0c8e50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009870 tx=0x7f8c0001c510 comp rx=0 tx=0).stop 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 -- 172.21.15.119:0/3733459352 shutdown_connections 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 --2- 172.21.15.119:0/3733459352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 --2- 172.21.15.119:0/3733459352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c0c8e50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 -- 172.21.15.119:0/3733459352 >> 172.21.15.119:0/3733459352 conn(0x7f8c0c06a2a0 msgr2=0x7f8c0c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 -- 172.21.15.119:0/3733459352 shutdown_connections 2023-12-19T16:15:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.363+0000 7f8c10d39640 1 -- 172.21.15.119:0/3733459352 wait complete. 2023-12-19T16:15:33.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 Processor -- start 2023-12-19T16:15:33.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- start start 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c0c1582d0 0x7f8c0c164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c152260 con 0x7f8c0c070820 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0cbff0 con 0x7f8c0c1582d0 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0cc290 con 0x7f8c0c0ce3b0 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38344/0 (socket says 172.21.15.119:38344) 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 -- 172.21.15.119:0/1207874968 learned_addr learned my addr 172.21.15.119:0/1207874968 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c09d9b640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0ad9d640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c0c1582d0 0x7f8c0c164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 -- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 msgr2=0x7f8c0c153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 -- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c0c1582d0 msgr2=0x7f8c0c164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c0c1582d0 0x7f8c0c164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 -- 172.21.15.119:0/1207874968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000094d0 con 0x7f8c0c070820 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c0a59c640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c146df0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c3c0 tx=0x7f8bfc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0052d0 con 0x7f8c0c070820 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc005430 con 0x7f8c0c070820 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c0cc570 con 0x7f8c0c070820 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc003840 con 0x7f8c0c070820 2023-12-19T16:15:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c0ccb30 con 0x7f8c0c070820 2023-12-19T16:15:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.367+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c04e000 con 0x7f8c0c070820 2023-12-19T16:15:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.371+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8bfc0039a0 con 0x7f8c0c070820 2023-12-19T16:15:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.371+0000 7f8bfaffd640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8bec065a60 0x7f8bec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.371+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8bfc0829e0 con 0x7f8c0c070820 2023-12-19T16:15:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.371+0000 7f8c09d9b640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8bec065a60 0x7f8bec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.371+0000 7f8c09d9b640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8bec065a60 0x7f8bec067f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c000ae000 tx=0x7f8c000a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.375+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8bfc0500a0 con 0x7f8c0c070820 2023-12-19T16:15:33.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c0c1590a0 con 0x7f8c0c070820 2023-12-19T16:15:33.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8bfaffd640 1 -- 172.21.15.119:0/1207874968 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bfc017020 con 0x7f8c0c070820 2023-12-19T16:15:33.529 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:15:33.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8bec065a60 msgr2=0x7f8bec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8bec065a60 0x7f8bec067f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c000ae000 tx=0x7f8c000a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:33.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 msgr2=0x7f8c0c146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c146df0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c3c0 tx=0x7f8bfc00c880 comp rx=0 tx=0).stop 2023-12-19T16:15:33.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 shutdown_connections 2023-12-19T16:15:33.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8bec065a60 0x7f8bec067f20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c0c1582d0 0x7f8c0c164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c0c0ce3b0 0x7f8c0c153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 --2- 172.21.15.119:0/1207874968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c0c070820 0x7f8c0c146df0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 >> 172.21.15.119:0/1207874968 conn(0x7f8c0c06a2a0 msgr2=0x7f8c0c159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 shutdown_connections 2023-12-19T16:15:33.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.527+0000 7f8c10d39640 1 -- 172.21.15.119:0/1207874968 wait complete. 2023-12-19T16:15:33.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:15:33.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6791ca8640 1 Processor -- start 2023-12-19T16:15:33.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6791ca8640 1 -- start start 2023-12-19T16:15:33.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6791ca8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 0x7f678c0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6791ca8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c15d5f0 con 0x7f678c158a30 2023-12-19T16:15:33.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6791ca8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c0715d0 con 0x7f678c0c87e0 2023-12-19T16:15:33.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6791ca8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c15d310 con 0x7f678c0b0320 2023-12-19T16:15:33.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6790ca6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f678c158a30 0x7f678c070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51952/0 (socket says 172.21.15.119:51952) 2023-12-19T16:15:33.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.687+0000 7f6790ca6640 1 -- 172.21.15.119:0/2917821869 learned_addr learned my addr 172.21.15.119:0/2917821869 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:33.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380084204 0 0) 0x7f678c15d5f0 con 0x7f678c158a30 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f677c003450 con 0x7f678c158a30 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f67914a7640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 0x7f678c0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2748665222 0 0) 0x7f677c003450 con 0x7f678c158a30 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 msgr2=0x7f678c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 0x7f678c0c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 >> v1:172.21.15.143:6789/0 conn(0x7f678c0c87e0 legacy=0x7f678c0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c0703e0 con 0x7f678c158a30 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f6780001680 con 0x7f678c158a30 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 >> v1:172.21.15.119:6789/0 conn(0x7f678c158a30 legacy=0x7f678c070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 0x7f677c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f677c0040d0 0x7f677c00a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c00b070 0x7f677c00d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c15d310 con 0x7f677c0040d0 2023-12-19T16:15:33.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c00dd40 con 0x7f677c00b070 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c00df00 con 0x7f678c0b0320 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678bfff640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f677c0040d0 0x7f677c00a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f6790ca6640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 0x7f677c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f67914a7640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c00b070 0x7f677c00d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678bfff640 1 -- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 msgr2=0x7f677c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678bfff640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0b0320 0x7f677c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678bfff640 1 -- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c00b070 msgr2=0x7f677c00d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678bfff640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c00b070 0x7f677c00d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.691+0000 7f678bfff640 1 -- 172.21.15.119:0/2917821869 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c003450 con 0x7f677c0040d0 2023-12-19T16:15:33.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f678bfff640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f677c0040d0 0x7f677c00a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6778001780 tx=0x7f677801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e222e6aaba23a6e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780052d0 con 0x7f677c0040d0 2023-12-19T16:15:33.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67780a7050 con 0x7f677c0040d0 2023-12-19T16:15:33.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f678b7fe640 1 -- 172.21.15.119:0/2917821869 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778003600 con 0x7f677c0040d0 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 -- 172.21.15.119:0/2917821869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f677c0040d0 msgr2=0x7f677c00a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 --2- 172.21.15.119:0/2917821869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f677c0040d0 0x7f677c00a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6778001780 tx=0x7f677801c400 comp rx=0 tx=0).stop 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f67914a7640 1 -- 172.21.15.119:0/2917821869 reap_dead start 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 -- 172.21.15.119:0/2917821869 shutdown_connections 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 -- 172.21.15.119:0/2917821869 >> 172.21.15.119:0/2917821869 conn(0x7f678c06a2a0 msgr2=0x7f678c0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 -- 172.21.15.119:0/2917821869 shutdown_connections 2023-12-19T16:15:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 -- 172.21.15.119:0/2917821869 wait complete. 2023-12-19T16:15:33.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 Processor -- start 2023-12-19T16:15:33.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.695+0000 7f6791ca8640 1 -- start start 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0040d0 0x7f678c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 0x7f678c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c1568b0 0x7f678c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c0b0c30 con 0x7f678c151120 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c151580 con 0x7f677c0040d0 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c157270 con 0x7f678c1568b0 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 0x7f678c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 0x7f678c1f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38368/0 (socket says 172.21.15.119:38368) 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 -- 172.21.15.119:0/357863276 learned_addr learned my addr 172.21.15.119:0/357863276 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6790ca6640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0040d0 0x7f678c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f67914a7640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c1568b0 0x7f678c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 -- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c1568b0 msgr2=0x7f678c156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c1568b0 0x7f678c156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 -- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0040d0 msgr2=0x7f678c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0040d0 0x7f678c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 -- 172.21.15.119:0/357863276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c0b1a50 con 0x7f678c151120 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6790ca6640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0040d0 0x7f678c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f678bfff640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 0x7f678c1f15c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6778005040 tx=0x7f677c003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778007310 con 0x7f678c151120 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778007470 con 0x7f678c151120 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780067e0 con 0x7f678c151120 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c0b0e40 con 0x7f678c151120 2023-12-19T16:15:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c0b1400 con 0x7f678c151120 2023-12-19T16:15:33.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c04e850 con 0x7f678c151120 2023-12-19T16:15:33.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.699+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6778006940 con 0x7f678c151120 2023-12-19T16:15:33.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.703+0000 7f67897fa640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6770065a60 0x7f6770067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.703+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f677811d8c0 con 0x7f678c151120 2023-12-19T16:15:33.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.703+0000 7f6790ca6640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6770065a60 0x7f6770067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.703+0000 7f6790ca6640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6770065a60 0x7f6770067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6780001060 tx=0x7f6780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.707+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f67780eaf00 con 0x7f678c151120 2023-12-19T16:15:33.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f678c0b4110 con 0x7f678c151120 2023-12-19T16:15:33.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f67897fa640 1 -- 172.21.15.119:0/357863276 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67780ee520 con 0x7f678c151120 2023-12-19T16:15:33.858 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6770065a60 msgr2=0x7f6770067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6770065a60 0x7f6770067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6780001060 tx=0x7f6780009040 comp rx=0 tx=0).stop 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 msgr2=0x7f678c1f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 0x7f678c1f15c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6778005040 tx=0x7f677c003700 comp rx=0 tx=0).stop 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 shutdown_connections 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6770065a60 0x7f6770067f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c1568b0 0x7f678c156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c151120 0x7f678c1f15c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 --2- 172.21.15.119:0/357863276 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f677c0040d0 0x7f678c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 >> 172.21.15.119:0/357863276 conn(0x7f678c06a2a0 msgr2=0x7f678c0caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 shutdown_connections 2023-12-19T16:15:33.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:33.855+0000 7f6791ca8640 1 -- 172.21.15.119:0/357863276 wait complete. 2023-12-19T16:15:33.879 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:15:34.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31ae16d640 1 Processor -- start 2023-12-19T16:15:34.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31ae16d640 1 -- start start 2023-12-19T16:15:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31ae16d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f31a81582d0 0x7f31a80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31ae16d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a80c9390 con 0x7f31a80ce3b0 2023-12-19T16:15:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31ae16d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a815aee0 con 0x7f31a8070820 2023-12-19T16:15:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31ae16d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a815b1c0 con 0x7f31a81582d0 2023-12-19T16:15:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f31a81582d0 0x7f31a80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a7fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f31a80ce3b0 0x7f31a80cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51954/0 (socket says 172.21.15.119:51954) 2023-12-19T16:15:34.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a7fff640 1 -- 172.21.15.119:0/1983272877 learned_addr learned my addr 172.21.15.119:0/1983272877 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:34.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a77fe640 1 -- 172.21.15.119:0/1983272877 >> v1:172.21.15.143:6789/0 conn(0x7f31a8070820 legacy=0x7f31a80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a77fe640 1 -- 172.21.15.119:0/1983272877 >> v1:172.21.15.119:6789/0 conn(0x7f31a80ce3b0 legacy=0x7f31a80cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a77fe640 1 -- 172.21.15.119:0/1983272877 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a815b4a0 con 0x7f31a81582d0 2023-12-19T16:15:34.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.019+0000 7f31a67fc640 1 -- 172.21.15.119:0/1983272877 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594596585 0 0) 0x7f31a80c9390 con 0x7f31a80ce3b0 2023-12-19T16:15:34.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31a77fe640 1 --2- 172.21.15.119:0/1983272877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a81582d0 0x7f31a80c8e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31980097c0 tx=0x7f319801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55e852c2b7bc021 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31a67fc640 1 -- 172.21.15.119:0/1983272877 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980a7070 con 0x7f31a81582d0 2023-12-19T16:15:34.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31a67fc640 1 -- 172.21.15.119:0/1983272877 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31980ab430 con 0x7f31a81582d0 2023-12-19T16:15:34.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31a67fc640 1 -- 172.21.15.119:0/1983272877 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980ab7c0 con 0x7f31a81582d0 2023-12-19T16:15:34.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 -- 172.21.15.119:0/1983272877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a81582d0 msgr2=0x7f31a80c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 --2- 172.21.15.119:0/1983272877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a81582d0 0x7f31a80c8e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31980097c0 tx=0x7f319801c410 comp rx=0 tx=0).stop 2023-12-19T16:15:34.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 -- 172.21.15.119:0/1983272877 shutdown_connections 2023-12-19T16:15:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 --2- 172.21.15.119:0/1983272877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a81582d0 0x7f31a80c8e50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 -- 172.21.15.119:0/1983272877 >> 172.21.15.119:0/1983272877 conn(0x7f31a806a2a0 msgr2=0x7f31a80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 -- 172.21.15.119:0/1983272877 shutdown_connections 2023-12-19T16:15:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 -- 172.21.15.119:0/1983272877 wait complete. 2023-12-19T16:15:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.023+0000 7f31ae16d640 1 Processor -- start 2023-12-19T16:15:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- start start 2023-12-19T16:15:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 0x7f31a815dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a80ce3b0 0x7f31a814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31a81582d0 0x7f31a8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8150900 con 0x7f31a8070820 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8152020 con 0x7f31a80ce3b0 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8152300 con 0x7f31a81582d0 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 0x7f31a815dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 0x7f31a815dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38378/0 (socket says 172.21.15.119:38378) 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 -- 172.21.15.119:0/4111565669 learned_addr learned my addr 172.21.15.119:0/4111565669 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a6ffd640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a80ce3b0 0x7f31a814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a7fff640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31a81582d0 0x7f31a8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 -- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31a81582d0 msgr2=0x7f31a8155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31a81582d0 0x7f31a8155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 -- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a80ce3b0 msgr2=0x7f31a814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a80ce3b0 0x7f31a814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 -- 172.21.15.119:0/4111565669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198009420 con 0x7f31a8070820 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a6ffd640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a80ce3b0 0x7f31a814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31a77fe640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 0x7f31a815dc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31980ad040 tx=0x7f31980191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980b4800 con 0x7f31a8070820 2023-12-19T16:15:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31980b4960 con 0x7f31a8070820 2023-12-19T16:15:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a81525e0 con 0x7f31a8070820 2023-12-19T16:15:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980b4cf0 con 0x7f31a8070820 2023-12-19T16:15:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a8152ba0 con 0x7f31a8070820 2023-12-19T16:15:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.027+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a804e000 con 0x7f31a8070820 2023-12-19T16:15:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.031+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31980c2460 con 0x7f31a8070820 2023-12-19T16:15:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.031+0000 7f318ffff640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3194065a60 0x7f3194067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.031+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f319811d920 con 0x7f31a8070820 2023-12-19T16:15:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.031+0000 7f31a6ffd640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3194065a60 0x7f3194067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.031+0000 7f31a6ffd640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3194065a60 0x7f3194067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31a80c1c90 tx=0x7f319c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.035+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31980eafd0 con 0x7f31a8070820 2023-12-19T16:15:34.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.183+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31a815e2c0 con 0x7f31a8070820 2023-12-19T16:15:34.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.183+0000 7f318ffff640 1 -- 172.21.15.119:0/4111565669 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31980ee5f0 con 0x7f31a8070820 2023-12-19T16:15:34.187 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:15:34.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3194065a60 msgr2=0x7f3194067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3194065a60 0x7f3194067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31a80c1c90 tx=0x7f319c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:34.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 msgr2=0x7f31a815dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 0x7f31a815dc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31980ad040 tx=0x7f31980191b0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 shutdown_connections 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3194065a60 0x7f3194067f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a80ce3b0 0x7f31a814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31a81582d0 0x7f31a8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 --2- 172.21.15.119:0/4111565669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31a8070820 0x7f31a815dc10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 >> 172.21.15.119:0/4111565669 conn(0x7f31a806a2a0 msgr2=0x7f31a815e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 shutdown_connections 2023-12-19T16:15:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.187+0000 7f31ae16d640 1 -- 172.21.15.119:0/4111565669 wait complete. 2023-12-19T16:15:34.208 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:15:34.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 Processor -- start 2023-12-19T16:15:34.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 -- start start 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45fc1598d0 0x7f45fc0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f45fc0ce390 0x7f45fc0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc0ced20 con 0x7f45fc153020 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0c9730 con 0x7f45fc0ce390 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4602db3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0cbc80 con 0x7f45fc1598d0 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f45fc0ce390 0x7f45fc0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f45fc0ce390 0x7f45fc0ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38388/0 (socket says 172.21.15.119:38388) 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 -- 172.21.15.119:0/1394842388 learned_addr learned my addr 172.21.15.119:0/1394842388 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f45f3fff640 1 --2- 172.21.15.119:0/1394842388 >> v2:172.21.15.143:3300/0 conn(0x7f45fc1598d0 0x7f45fc0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 -- 172.21.15.119:0/1394842388 >> v2:172.21.15.143:3300/0 conn(0x7f45fc1598d0 msgr2=0x7f45fc0b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 --2- 172.21.15.119:0/1394842388 >> v2:172.21.15.143:3300/0 conn(0x7f45fc1598d0 0x7f45fc0b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 -- 172.21.15.119:0/1394842388 >> v1:172.21.15.143:6789/0 conn(0x7f45fc153020 legacy=0x7f45fc0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.347+0000 7f4601350640 1 -- 172.21.15.119:0/1394842388 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0c8e00 con 0x7f45fc0ce390 2023-12-19T16:15:34.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4601350640 1 --2- 172.21.15.119:0/1394842388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc0ce390 0x7f45fc0ce7e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0ce340 tx=0x7f45f401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cff293793e4025 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f45f37fe640 1 -- 172.21.15.119:0/1394842388 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40a5740 con 0x7f45fc0ce390 2023-12-19T16:15:34.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f45f37fe640 1 -- 172.21.15.119:0/1394842388 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f40a58a0 con 0x7f45fc0ce390 2023-12-19T16:15:34.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f45f37fe640 1 -- 172.21.15.119:0/1394842388 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40a5c30 con 0x7f45fc0ce390 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 -- 172.21.15.119:0/1394842388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc0ce390 msgr2=0x7f45fc0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 --2- 172.21.15.119:0/1394842388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc0ce390 0x7f45fc0ce7e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0ce340 tx=0x7f45f401c880 comp rx=0 tx=0).stop 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 -- 172.21.15.119:0/1394842388 shutdown_connections 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 --2- 172.21.15.119:0/1394842388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc0ce390 0x7f45fc0ce7e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 --2- 172.21.15.119:0/1394842388 >> v2:172.21.15.143:3300/0 conn(0x7f45fc1598d0 0x7f45fc0b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 -- 172.21.15.119:0/1394842388 >> 172.21.15.119:0/1394842388 conn(0x7f45fc06a2a0 msgr2=0x7f45fc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 -- 172.21.15.119:0/1394842388 shutdown_connections 2023-12-19T16:15:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 -- 172.21.15.119:0/1394842388 wait complete. 2023-12-19T16:15:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 Processor -- start 2023-12-19T16:15:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.351+0000 7f4602db3640 1 -- start start 2023-12-19T16:15:34.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45fc0ce390 0x7f45fc151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 0x7f45fc0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45fc1598d0 0x7f45fc0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc154580 con 0x7f45fc153020 2023-12-19T16:15:34.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0adfa0 con 0x7f45fc1598d0 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0ae280 con 0x7f45fc0ce390 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 0x7f45fc0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 0x7f45fc0cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38392/0 (socket says 172.21.15.119:38392) 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 -- 172.21.15.119:0/1041140670 learned_addr learned my addr 172.21.15.119:0/1041140670 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4600b4f640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45fc0ce390 0x7f45fc151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4601350640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45fc1598d0 0x7f45fc0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 -- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45fc0ce390 msgr2=0x7f45fc151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45fc0ce390 0x7f45fc151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 -- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45fc1598d0 msgr2=0x7f45fc0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45fc1598d0 0x7f45fc0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 -- 172.21.15.119:0/1041140670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4009b30 con 0x7f45fc153020 2023-12-19T16:15:34.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4601350640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45fc1598d0 0x7f45fc0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:34.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f3fff640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 0x7f45fc0cab70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00d5f0 tx=0x7f45ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0125f0 con 0x7f45fc153020 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec012750 con 0x7f45fc153020 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec012b00 con 0x7f45fc153020 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0ae560 con 0x7f45fc153020 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc1519d0 con 0x7f45fc153020 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.355+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0aea80 con 0x7f45fc153020 2023-12-19T16:15:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.359+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45ec012c60 con 0x7f45fc153020 2023-12-19T16:15:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.359+0000 7f45f17fa640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e8065a60 0x7f45e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.359+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45ec083960 con 0x7f45fc153020 2023-12-19T16:15:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.359+0000 7f4600b4f640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e8065a60 0x7f45e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.359+0000 7f4600b4f640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e8065a60 0x7f45e8067f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f45f8007fd0 tx=0x7f45f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.363+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45ec051030 con 0x7f45fc153020 2023-12-19T16:15:34.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45fc04e000 con 0x7f45fc153020 2023-12-19T16:15:34.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f45f17fa640 1 -- 172.21.15.119:0/1041140670 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45ec054650 con 0x7f45fc153020 2023-12-19T16:15:34.518 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:34.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e8065a60 msgr2=0x7f45e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e8065a60 0x7f45e8067f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f45f8007fd0 tx=0x7f45f8009040 comp rx=0 tx=0).stop 2023-12-19T16:15:34.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 msgr2=0x7f45fc0cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 0x7f45fc0cab70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00d5f0 tx=0x7f45ec00dab0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 shutdown_connections 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e8065a60 0x7f45e8067f20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45fc1598d0 0x7f45fc0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45fc153020 0x7f45fc0cab70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 --2- 172.21.15.119:0/1041140670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45fc0ce390 0x7f45fc151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.515+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 >> 172.21.15.119:0/1041140670 conn(0x7f45fc06a2a0 msgr2=0x7f45fc0c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.519+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 shutdown_connections 2023-12-19T16:15:34.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.519+0000 7f4602db3640 1 -- 172.21.15.119:0/1041140670 wait complete. 2023-12-19T16:15:34.540 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:15:34.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 Processor -- start 2023-12-19T16:15:34.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 -- start start 2023-12-19T16:15:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffbec06d170 0x7ffbec0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffbec0ce290 0x7ffbec0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbec0ce720 con 0x7ffbec0ce290 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbec0cccf0 con 0x7ffbec06d170 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbf10d8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0ae420 con 0x7ffbec0ae040 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffbec0ce290 0x7ffbec0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffbec0ce290 0x7ffbec0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38408/0 (socket says 172.21.15.119:38408) 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 -- 172.21.15.119:0/4048714933 learned_addr learned my addr 172.21.15.119:0/4048714933 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbe3fff640 1 --2- 172.21.15.119:0/4048714933 >> v2:172.21.15.143:3300/0 conn(0x7ffbec06d170 0x7ffbec0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbead9d640 1 --2- 172.21.15.119:0/4048714933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 -- 172.21.15.119:0/4048714933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 msgr2=0x7ffbec06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 --2- 172.21.15.119:0/4048714933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec06cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 -- 172.21.15.119:0/4048714933 >> v2:172.21.15.143:3300/0 conn(0x7ffbec06d170 msgr2=0x7ffbec0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 --2- 172.21.15.119:0/4048714933 >> v2:172.21.15.143:3300/0 conn(0x7ffbec06d170 0x7ffbec0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.675+0000 7ffbeb59e640 1 -- 172.21.15.119:0/4048714933 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec0ccf90 con 0x7ffbec0ce290 2023-12-19T16:15:34.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbeb59e640 1 --2- 172.21.15.119:0/4048714933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec0ce290 0x7ffbec0c9920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffbec070250 tx=0x7ffbe401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46169a71d39456b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbea59c640 1 -- 172.21.15.119:0/4048714933 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40a5730 con 0x7ffbec0ce290 2023-12-19T16:15:34.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbea59c640 1 -- 172.21.15.119:0/4048714933 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe40a5890 con 0x7ffbec0ce290 2023-12-19T16:15:34.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbea59c640 1 -- 172.21.15.119:0/4048714933 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40a5c20 con 0x7ffbec0ce290 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 -- 172.21.15.119:0/4048714933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec0ce290 msgr2=0x7ffbec0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/4048714933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec0ce290 0x7ffbec0c9920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffbec070250 tx=0x7ffbe401c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 -- 172.21.15.119:0/4048714933 shutdown_connections 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/4048714933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec0ce290 0x7ffbec0c9920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/4048714933 >> v2:172.21.15.143:3300/0 conn(0x7ffbec06d170 0x7ffbec0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/4048714933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec06cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 -- 172.21.15.119:0/4048714933 >> 172.21.15.119:0/4048714933 conn(0x7ffbec0cb610 msgr2=0x7ffbec0cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 -- 172.21.15.119:0/4048714933 shutdown_connections 2023-12-19T16:15:34.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.679+0000 7ffbf10d8640 1 -- 172.21.15.119:0/4048714933 wait complete. 2023-12-19T16:15:34.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 Processor -- start 2023-12-19T16:15:34.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 -- start start 2023-12-19T16:15:34.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 0x7ffbec153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbec0ce290 0x7ffbec0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0acb10 con 0x7ffbec06d170 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0ad0d0 con 0x7ffbec0ce290 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec15c230 con 0x7ffbec0ae040 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 0x7ffbec153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 0x7ffbec153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38418/0 (socket says 172.21.15.119:38418) 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 -- 172.21.15.119:0/3849873079 learned_addr learned my addr 172.21.15.119:0/3849873079 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 -- 172.21.15.119:0/3849873079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 msgr2=0x7ffbec154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 -- 172.21.15.119:0/3849873079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbec0ce290 msgr2=0x7ffbec0b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbec0ce290 0x7ffbec0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 -- 172.21.15.119:0/3849873079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4009b30 con 0x7ffbec06d170 2023-12-19T16:15:34.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbead9d640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 0x7ffbec153040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00d800 tx=0x7ffbdc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00b6c0 con 0x7ffbec06d170 2023-12-19T16:15:34.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00b820 con 0x7ffbec06d170 2023-12-19T16:15:34.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00bb90 con 0x7ffbec06d170 2023-12-19T16:15:34.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbec154ce0 con 0x7ffbec06d170 2023-12-19T16:15:34.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.683+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbec154770 con 0x7ffbec06d170 2023-12-19T16:15:34.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.687+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbec04e000 con 0x7ffbec06d170 2023-12-19T16:15:34.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.687+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffbdc00bcf0 con 0x7ffbec06d170 2023-12-19T16:15:34.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.687+0000 7ffbe37fe640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffbcc065a60 0x7ffbcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.687+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffbdc083960 con 0x7ffbec06d170 2023-12-19T16:15:34.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.687+0000 7ffbe3fff640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffbcc065a60 0x7ffbcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.687+0000 7ffbe3fff640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffbcc065a60 0x7ffbcc067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0c8d60 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.691+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffbdc051020 con 0x7ffbec06d170 2023-12-19T16:15:34.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffbec0cca30 con 0x7ffbec06d170 2023-12-19T16:15:34.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbe37fe640 1 -- 172.21.15.119:0/3849873079 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffbdc054640 con 0x7ffbec06d170 2023-12-19T16:15:34.858 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:15:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffbcc065a60 msgr2=0x7ffbcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffbcc065a60 0x7ffbcc067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0c8d60 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2023-12-19T16:15:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 msgr2=0x7ffbec153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 0x7ffbec153040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00d800 tx=0x7ffbdc00dcc0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 shutdown_connections 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffbcc065a60 0x7ffbcc067f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbec0ce290 0x7ffbec0b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffbec0ae040 0x7ffbec154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 --2- 172.21.15.119:0/3849873079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbec06d170 0x7ffbec153040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 >> 172.21.15.119:0/3849873079 conn(0x7ffbec0cb610 msgr2=0x7ffbec0afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 shutdown_connections 2023-12-19T16:15:34.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:34.855+0000 7ffbf10d8640 1 -- 172.21.15.119:0/3849873079 wait complete. 2023-12-19T16:15:34.878 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:15:34.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:34.878 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-19T16:15:34.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[44401]: fuse finished with error 0 and tester_r 0 2023-12-19T16:15:34.919 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:15:41.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:15:41.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:41.021 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-19T16:15:41.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:41.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.239+0000 7fc241b6d640 1 Processor -- start 2023-12-19T16:15:41.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.239+0000 7fc241b6d640 1 -- start start 2023-12-19T16:15:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc241b6d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c15a680 0x7fc23c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc241b6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc23c06fdb0 0x7fc23c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc241b6d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c15f100 con 0x7fc23c0cac10 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc241b6d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c070780 con 0x7fc23c06fdb0 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc241b6d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0ca7d0 con 0x7fc23c15a680 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc23c06fdb0 0x7fc23c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc23c06fdb0 0x7fc23c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38428/0 (socket says 172.21.15.119:38428) 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 -- 172.21.15.119:0/2960872182 learned_addr learned my addr 172.21.15.119:0/2960872182 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 -- 172.21.15.119:0/2960872182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c15a680 msgr2=0x7fc23c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23b7fe640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c15a680 0x7fc23c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c15a680 0x7fc23c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 -- 172.21.15.119:0/2960872182 >> v1:172.21.15.143:6789/0 conn(0x7fc23c0cac10 legacy=0x7fc23c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 -- 172.21.15.119:0/2960872182 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c15e860 con 0x7fc23c06fdb0 2023-12-19T16:15:41.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23b7fe640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c15a680 0x7fc23c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:41.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.243+0000 7fc23bfff640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c06fdb0 0x7fc23c070240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc234009e50 tx=0x7fc23401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d8bc1382e5b7d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc23a7fc640 1 -- 172.21.15.119:0/2960872182 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a57c0 con 0x7fc23c06fdb0 2023-12-19T16:15:41.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc23a7fc640 1 -- 172.21.15.119:0/2960872182 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340a5920 con 0x7fc23c06fdb0 2023-12-19T16:15:41.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc23a7fc640 1 -- 172.21.15.119:0/2960872182 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a5cb0 con 0x7fc23c06fdb0 2023-12-19T16:15:41.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- 172.21.15.119:0/2960872182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c06fdb0 msgr2=0x7fc23c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c06fdb0 0x7fc23c070240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc234009e50 tx=0x7fc23401c940 comp rx=0 tx=0).stop 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- 172.21.15.119:0/2960872182 shutdown_connections 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c06fdb0 0x7fc23c070240 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 --2- 172.21.15.119:0/2960872182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c15a680 0x7fc23c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- 172.21.15.119:0/2960872182 >> 172.21.15.119:0/2960872182 conn(0x7fc23c06a3e0 msgr2=0x7fc23c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- 172.21.15.119:0/2960872182 shutdown_connections 2023-12-19T16:15:41.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- 172.21.15.119:0/2960872182 wait complete. 2023-12-19T16:15:41.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 Processor -- start 2023-12-19T16:15:41.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- start start 2023-12-19T16:15:41.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c06fdb0 0x7fc23c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 0x7fc23c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc23c15a680 0x7fc23c1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0b0d60 con 0x7fc23c0cac10 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0cbfd0 con 0x7fc23c15a680 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.247+0000 7fc241b6d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0cc2b0 con 0x7fc23c06fdb0 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 0x7fc23c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 0x7fc23c1521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38436/0 (socket says 172.21.15.119:38436) 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 -- 172.21.15.119:0/1699959010 learned_addr learned my addr 172.21.15.119:0/1699959010 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23bfff640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc23c15a680 0x7fc23c1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23b7fe640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c06fdb0 0x7fc23c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 -- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c06fdb0 msgr2=0x7fc23c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c06fdb0 0x7fc23c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 -- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc23c15a680 msgr2=0x7fc23c1513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc23c15a680 0x7fc23c1513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 -- 172.21.15.119:0/1699959010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009b30 con 0x7fc23c0cac10 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc23affd640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 0x7fc23c1521e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc23000b410 tx=0x7fc23000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230004020 con 0x7fc23c0cac10 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230004180 con 0x7fc23c0cac10 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230011630 con 0x7fc23c0cac10 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c0cc590 con 0x7fc23c0cac10 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c0cddf0 con 0x7fc23c0cac10 2023-12-19T16:15:41.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c0735b0 con 0x7fc23c0cac10 2023-12-19T16:15:41.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc230011790 con 0x7fc23c0cac10 2023-12-19T16:15:41.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc223fff640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc228065a60 0x7fc228067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.251+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc230083190 con 0x7fc23c0cac10 2023-12-19T16:15:41.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.255+0000 7fc23b7fe640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc228065a60 0x7fc228067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.255+0000 7fc23b7fe640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc228065a60 0x7fc228067f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc23c152190 tx=0x7fc22c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.255+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc230050870 con 0x7fc23c0cac10 2023-12-19T16:15:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.407+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc23c04e000 con 0x7fc23c0cac10 2023-12-19T16:15:41.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc223fff640 1 -- 172.21.15.119:0/1699959010 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc230053e90 con 0x7fc23c0cac10 2023-12-19T16:15:41.413 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:41.413 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc228065a60 msgr2=0x7fc228067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc228065a60 0x7fc228067f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc23c152190 tx=0x7fc22c008040 comp rx=0 tx=0).stop 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 msgr2=0x7fc23c1521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 0x7fc23c1521e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc23000b410 tx=0x7fc23000b8d0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 shutdown_connections 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc228065a60 0x7fc228067f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc23c15a680 0x7fc23c1513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cac10 0x7fc23c1521e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 --2- 172.21.15.119:0/1699959010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc23c06fdb0 0x7fc23c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 >> 172.21.15.119:0/1699959010 conn(0x7fc23c06a3e0 msgr2=0x7fc23c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 shutdown_connections 2023-12-19T16:15:41.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.411+0000 7fc241b6d640 1 -- 172.21.15.119:0/1699959010 wait complete. 2023-12-19T16:15:41.434 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.567+0000 7f57ae325640 1 Processor -- start 2023-12-19T16:15:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.567+0000 7f57ae325640 1 -- start start 2023-12-19T16:15:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ae325640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f57a80cac10 0x7f57a815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ae325640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a806fdb0 0x7f57a8070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ae325640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a815f100 con 0x7f57a815a680 2023-12-19T16:15:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ae325640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a8070780 con 0x7f57a80cac10 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ae325640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80ca7d0 con 0x7f57a806fdb0 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f57a80cac10 0x7f57a815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ac8c2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a806fdb0 0x7f57a8070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f57a80cac10 0x7f57a815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:60230/0 (socket says 172.21.15.119:60230) 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 -- 172.21.15.119:0/1904274931 learned_addr learned my addr 172.21.15.119:0/1904274931 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57ac8c2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a806fdb0 0x7f57a8070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:55700/0 (socket says 172.21.15.119:55700) 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 -- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a806fdb0 msgr2=0x7f57a8070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 --2- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a806fdb0 0x7f57a8070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 -- 172.21.15.119:0/1904274931 >> v1:172.21.15.143:6789/0 conn(0x7f57a815a680 legacy=0x7f57a815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.571+0000 7f57a77fe640 1 -- 172.21.15.119:0/1904274931 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a815e860 con 0x7f57a80cac10 2023-12-19T16:15:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57a77fe640 1 --2- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a80cac10 0x7f57a815e160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f579c009870 tx=0x7f579c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516f2bfc6da6469e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57a6ffd640 1 -- 172.21.15.119:0/1904274931 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0aa610 con 0x7f57a80cac10 2023-12-19T16:15:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57a6ffd640 1 -- 172.21.15.119:0/1904274931 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c0a6040 con 0x7f57a80cac10 2023-12-19T16:15:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57a6ffd640 1 -- 172.21.15.119:0/1904274931 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0aa990 con 0x7f57a80cac10 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 -- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a80cac10 msgr2=0x7f57a815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 --2- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a80cac10 0x7f57a815e160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f579c009870 tx=0x7f579c01c4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 -- 172.21.15.119:0/1904274931 shutdown_connections 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 --2- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a806fdb0 0x7f57a8070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 --2- 172.21.15.119:0/1904274931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a80cac10 0x7f57a815e160 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 -- 172.21.15.119:0/1904274931 >> 172.21.15.119:0/1904274931 conn(0x7f57a806a3e0 msgr2=0x7f57a80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 -- 172.21.15.119:0/1904274931 shutdown_connections 2023-12-19T16:15:41.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 -- 172.21.15.119:0/1904274931 wait complete. 2023-12-19T16:15:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 Processor -- start 2023-12-19T16:15:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.575+0000 7f57ae325640 1 -- start start 2023-12-19T16:15:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a806fdb0 0x7f57a8156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 0x7f57a80c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a815a680 0x7f57a81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80c7340 con 0x7f57a80cac10 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8154c20 con 0x7f57a806fdb0 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8155740 con 0x7f57a815a680 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 0x7f57a80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 0x7f57a80c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38450/0 (socket says 172.21.15.119:38450) 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 -- 172.21.15.119:0/2641676437 learned_addr learned my addr 172.21.15.119:0/2641676437 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a7fff640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a806fdb0 0x7f57a8156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ac8c2640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a815a680 0x7f57a81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 -- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a815a680 msgr2=0x7f57a81546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a815a680 0x7f57a81546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 -- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a806fdb0 msgr2=0x7f57a8156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a806fdb0 0x7f57a8156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 -- 172.21.15.119:0/2641676437 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0094d0 con 0x7f57a80cac10 2023-12-19T16:15:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a77fe640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 0x7f57a80c6e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f579c0ac040 tx=0x7f579c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0bd5f0 con 0x7f57a80cac10 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c0bd750 con 0x7f57a80cac10 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0bdb00 con 0x7f57a80cac10 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a8154ea0 con 0x7f57a80cac10 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a8155460 con 0x7f57a80cac10 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a80735b0 con 0x7f57a80cac10 2023-12-19T16:15:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.579+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f579c0b33f0 con 0x7f57a80cac10 2023-12-19T16:15:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.583+0000 7f57a4ff9640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5794065a60 0x7f5794067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.583+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f579c11df20 con 0x7f57a80cac10 2023-12-19T16:15:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.583+0000 7f57a7fff640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5794065a60 0x7f5794067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.583+0000 7f57a7fff640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5794065a60 0x7f5794067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5798007fd0 tx=0x7f5798009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.587+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f579c0eb720 con 0x7f57a80cac10 2023-12-19T16:15:41.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.739+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57a804e000 con 0x7f57a80cac10 2023-12-19T16:15:41.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.739+0000 7f57a4ff9640 1 -- 172.21.15.119:0/2641676437 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f579c0aae60 con 0x7f57a80cac10 2023-12-19T16:15:41.743 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:41.743 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5794065a60 msgr2=0x7f5794067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5794065a60 0x7f5794067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5798007fd0 tx=0x7f5798009040 comp rx=0 tx=0).stop 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 msgr2=0x7f57a80c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 0x7f57a80c6e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f579c0ac040 tx=0x7f579c01acf0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 shutdown_connections 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5794065a60 0x7f5794067f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57a815a680 0x7f57a81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a80cac10 0x7f57a80c6e00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 --2- 172.21.15.119:0/2641676437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57a806fdb0 0x7f57a8156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 >> 172.21.15.119:0/2641676437 conn(0x7f57a806a3e0 msgr2=0x7f57a815aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 shutdown_connections 2023-12-19T16:15:41.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.743+0000 7f57ae325640 1 -- 172.21.15.119:0/2641676437 wait complete. 2023-12-19T16:15:41.765 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:15:41.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 Processor -- start 2023-12-19T16:15:41.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 -- start start 2023-12-19T16:15:41.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff724070820 0x7ff7240c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff7240ce3b0 0x7ff7240ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7240c9390 con 0x7ff7241582d0 2023-12-19T16:15:41.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240ced60 con 0x7ff7240ce3b0 2023-12-19T16:15:41.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff72ac2d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72415aee0 con 0x7ff724070820 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff7240ce3b0 0x7ff7240ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff7240ce3b0 0x7ff7240ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38464/0 (socket says 172.21.15.119:38464) 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 -- 172.21.15.119:0/1231088393 learned_addr learned my addr 172.21.15.119:0/1231088393 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff71bfff640 1 --2- 172.21.15.119:0/1231088393 >> v2:172.21.15.143:3300/0 conn(0x7ff724070820 0x7ff7240c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 -- 172.21.15.119:0/1231088393 >> v2:172.21.15.143:3300/0 conn(0x7ff724070820 msgr2=0x7ff7240c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 --2- 172.21.15.119:0/1231088393 >> v2:172.21.15.143:3300/0 conn(0x7ff724070820 0x7ff7240c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 -- 172.21.15.119:0/1231088393 >> v1:172.21.15.143:6789/0 conn(0x7ff7241582d0 legacy=0x7ff7240ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.903+0000 7ff7291ca640 1 -- 172.21.15.119:0/1231088393 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72415b1c0 con 0x7ff7240ce3b0 2023-12-19T16:15:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff7291ca640 1 --2- 172.21.15.119:0/1231088393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7240ce3b0 0x7ff7240ce820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff72406dfa0 tx=0x7ff71c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b2e5b7a744fd14 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff71b7fe640 1 -- 172.21.15.119:0/1231088393 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0a5860 con 0x7ff7240ce3b0 2023-12-19T16:15:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff71b7fe640 1 -- 172.21.15.119:0/1231088393 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0a59c0 con 0x7ff7240ce3b0 2023-12-19T16:15:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff71b7fe640 1 -- 172.21.15.119:0/1231088393 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0a5d50 con 0x7ff7240ce3b0 2023-12-19T16:15:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1231088393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7240ce3b0 msgr2=0x7ff7240ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1231088393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7240ce3b0 0x7ff7240ce820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff72406dfa0 tx=0x7ff71c01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1231088393 shutdown_connections 2023-12-19T16:15:41.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1231088393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7240ce3b0 0x7ff7240ce820 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1231088393 >> v2:172.21.15.143:3300/0 conn(0x7ff724070820 0x7ff7240c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1231088393 >> 172.21.15.119:0/1231088393 conn(0x7ff72406a2a0 msgr2=0x7ff7240aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1231088393 shutdown_connections 2023-12-19T16:15:41.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1231088393 wait complete. 2023-12-19T16:15:41.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 Processor -- start 2023-12-19T16:15:41.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.907+0000 7ff72ac2d640 1 -- start start 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 0x7ff7241552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7240ce3b0 0x7ff7241f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7241582d0 0x7ff7241f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724150a30 con 0x7ff724070820 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724157690 con 0x7ff7241582d0 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff724157c50 con 0x7ff7240ce3b0 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 0x7ff7241552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 0x7ff7241552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38466/0 (socket says 172.21.15.119:38466) 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 -- 172.21.15.119:0/1194628556 learned_addr learned my addr 172.21.15.119:0/1194628556 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff71bfff640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7240ce3b0 0x7ff7241f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7291ca640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7241582d0 0x7ff7241f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 -- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7240ce3b0 msgr2=0x7ff7241f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7240ce3b0 0x7ff7241f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 -- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7241582d0 msgr2=0x7ff7241f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7241582d0 0x7ff7241f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 -- 172.21.15.119:0/1194628556 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009b30 con 0x7ff724070820 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7291ca640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7241582d0 0x7ff7241f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7289c9640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 0x7ff7241552b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c3f0 tx=0x7ff72000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7200052d0 con 0x7ff724070820 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720005430 con 0x7ff724070820 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720003840 con 0x7ff724070820 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7240cdba0 con 0x7ff724070820 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7241578e0 con 0x7ff724070820 2023-12-19T16:15:41.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.911+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72404e000 con 0x7ff724070820 2023-12-19T16:15:41.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.915+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7200039a0 con 0x7ff724070820 2023-12-19T16:15:41.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.915+0000 7ff7197fa640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff710065a60 0x7ff710067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.915+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff720082940 con 0x7ff724070820 2023-12-19T16:15:41.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.915+0000 7ff71bfff640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff710065a60 0x7ff710067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.915+0000 7ff71bfff640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff710065a60 0x7ff710067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7240c1ae0 tx=0x7ff714009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:41.919+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff7200500b0 con 0x7ff724070820 2023-12-19T16:15:42.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.099+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff724157a70 con 0x7ff724070820 2023-12-19T16:15:42.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.191+0000 7ff7197fa640 1 -- 172.21.15.119:0/1194628556 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff724157a70 con 0x7ff724070820 2023-12-19T16:15:42.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff710065a60 msgr2=0x7ff710067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff710065a60 0x7ff710067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7240c1ae0 tx=0x7ff714009190 comp rx=0 tx=0).stop 2023-12-19T16:15:42.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 msgr2=0x7ff7241552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 0x7ff7241552b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c3f0 tx=0x7ff72000c8b0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 shutdown_connections 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff710065a60 0x7ff710067f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7241582d0 0x7ff7241f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7240ce3b0 0x7ff7241f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 --2- 172.21.15.119:0/1194628556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff724070820 0x7ff7241552b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 >> 172.21.15.119:0/1194628556 conn(0x7ff72406a2a0 msgr2=0x7ff7241586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 shutdown_connections 2023-12-19T16:15:42.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.195+0000 7ff72ac2d640 1 -- 172.21.15.119:0/1194628556 wait complete. 2023-12-19T16:15:42.216 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-19T16:15:42.216 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:15:42.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11cd1f3640 1 Processor -- start 2023-12-19T16:15:42.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11cd1f3640 1 -- start start 2023-12-19T16:15:42.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11cd1f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f11c8071870 0x7f11c8071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11cd1f3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c8070df0 con 0x7f11c80ca410 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11cd1f3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c815a4f0 con 0x7f11c80cbff0 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11cd1f3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c815aab0 con 0x7f11c8071870 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11be59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f11c8071870 0x7f11c8071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11c6d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f11c80ca410 0x7f11c8159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51960/0 (socket says 172.21.15.119:51960) 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11c6d9d640 1 -- 172.21.15.119:0/3880163308 learned_addr learned my addr 172.21.15.119:0/3880163308 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11be59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f11c8071870 0x7f11c8071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38476/0 (socket says 172.21.15.119:38476) 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11c659c640 1 -- 172.21.15.119:0/3880163308 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024612377 0 0) 0x7f11c8070df0 con 0x7f11c80ca410 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11c659c640 1 -- 172.21.15.119:0/3880163308 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b4005740 con 0x7f11c80ca410 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11be59c640 1 -- 172.21.15.119:0/3880163308 >> v1:172.21.15.143:6789/0 conn(0x7f11c80cbff0 legacy=0x7f11c80ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11be59c640 1 -- 172.21.15.119:0/3880163308 >> v1:172.21.15.119:6789/0 conn(0x7f11c80ca410 legacy=0x7f11c8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.355+0000 7f11be59c640 1 -- 172.21.15.119:0/3880163308 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c815a7d0 con 0x7f11c8071870 2023-12-19T16:15:42.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11be59c640 1 --2- 172.21.15.119:0/3880163308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c8071d00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097c0 tx=0x7f11b001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a49a50688bdcd0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:42.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11c659c640 1 -- 172.21.15.119:0/3880163308 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00ac640 con 0x7f11c8071870 2023-12-19T16:15:42.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11c659c640 1 -- 172.21.15.119:0/3880163308 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b00ac7a0 con 0x7f11c8071870 2023-12-19T16:15:42.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11c659c640 1 -- 172.21.15.119:0/3880163308 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00acb30 con 0x7f11c8071870 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3880163308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 msgr2=0x7f11c8071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3880163308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c8071d00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097c0 tx=0x7f11b001c410 comp rx=0 tx=0).stop 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3880163308 shutdown_connections 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3880163308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c8071d00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3880163308 >> 172.21.15.119:0/3880163308 conn(0x7f11c806a2a0 msgr2=0x7f11c80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3880163308 shutdown_connections 2023-12-19T16:15:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.359+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3880163308 wait complete. 2023-12-19T16:15:42.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 Processor -- start 2023-12-19T16:15:42.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 -- start start 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c81473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11c80ca410 0x7f11c80ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11c80cbff0 0x7f11c80ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80af280 con 0x7f11c8071870 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8155110 con 0x7f11c80ca410 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81553f0 con 0x7f11c80cbff0 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c81473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c81473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38492/0 (socket says 172.21.15.119:38492) 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 -- 172.21.15.119:0/3147874679 learned_addr learned my addr 172.21.15.119:0/3147874679 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11be59c640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11c80ca410 0x7f11c80ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c759e640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11c80cbff0 0x7f11c80ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 -- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11c80cbff0 msgr2=0x7f11c80ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11c80cbff0 0x7f11c80ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 -- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11c80ca410 msgr2=0x7f11c80ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11c80ca410 0x7f11c80ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 -- 172.21.15.119:0/3147874679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009420 con 0x7f11c8071870 2023-12-19T16:15:42.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11c6d9d640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c81473f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11b800cbc0 tx=0x7f11b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800ad40 con 0x7f11c8071870 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8012400 con 0x7f11c8071870 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c81556d0 con 0x7f11c8071870 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800aea0 con 0x7f11c8071870 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.363+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c8147930 con 0x7f11c8071870 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.367+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c804e000 con 0x7f11c8071870 2023-12-19T16:15:42.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.367+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11b8007070 con 0x7f11c8071870 2023-12-19T16:15:42.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.367+0000 7f11bffff640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f11a8065a60 0x7f11a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.367+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11b80833e0 con 0x7f11c8071870 2023-12-19T16:15:42.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.367+0000 7f11be59c640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f11a8065a60 0x7f11a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.367+0000 7f11be59c640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f11a8065a60 0x7f11a8067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ae000 tx=0x7f11b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:42.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.371+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11b8050b50 con 0x7f11c8071870 2023-12-19T16:15:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:42.551+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f11c80706f0 con 0x7f11c8071870 2023-12-19T16:15:43.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.199+0000 7f11bffff640 1 -- 172.21.15.119:0/3147874679 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11b8054170 con 0x7f11c8071870 2023-12-19T16:15:43.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f11a8065a60 msgr2=0x7f11a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f11a8065a60 0x7f11a8067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ae000 tx=0x7f11b0008040 comp rx=0 tx=0).stop 2023-12-19T16:15:43.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 msgr2=0x7f11c81473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c81473f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11b800cbc0 tx=0x7f11b800a430 comp rx=0 tx=0).stop 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 shutdown_connections 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f11a8065a60 0x7f11a8067f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11c80ca410 0x7f11c80ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11c80cbff0 0x7f11c80ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 --2- 172.21.15.119:0/3147874679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11c8071870 0x7f11c81473f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 >> 172.21.15.119:0/3147874679 conn(0x7f11c806a2a0 msgr2=0x7f11c80acd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 shutdown_connections 2023-12-19T16:15:43.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.203+0000 7f11cd1f3640 1 -- 172.21.15.119:0/3147874679 wait complete. 2023-12-19T16:15:43.229 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:15:43.229 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:43.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.363+0000 7f692cde9640 1 Processor -- start 2023-12-19T16:15:43.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.363+0000 7f692cde9640 1 -- start start 2023-12-19T16:15:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692cde9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f692815c9d0 0x7f69280cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692cde9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f69280cdd40 0x7f6928160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692cde9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6928161060 0x7f692806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692cde9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69281603f0 con 0x7f6928161060 2023-12-19T16:15:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692cde9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6928160690 con 0x7f69280cdd40 2023-12-19T16:15:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692cde9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69280b0d80 con 0x7f692815c9d0 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6928161060 0x7f692806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6928161060 0x7f692806fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56474/0 (socket says 172.21.15.119:56474) 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 -- 172.21.15.119:0/3983511338 learned_addr learned my addr 172.21.15.119:0/3983511338 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f691dd9b640 1 --2- 172.21.15.119:0/3983511338 >> v2:172.21.15.143:3300/0 conn(0x7f69280cdd40 0x7f6928160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f692659c640 1 --2- 172.21.15.119:0/3983511338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f692815c9d0 0x7f69280cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 -- 172.21.15.119:0/3983511338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f692815c9d0 msgr2=0x7f69280cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 --2- 172.21.15.119:0/3983511338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f692815c9d0 0x7f69280cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 -- 172.21.15.119:0/3983511338 >> v2:172.21.15.143:3300/0 conn(0x7f69280cdd40 msgr2=0x7f6928160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 --2- 172.21.15.119:0/3983511338 >> v2:172.21.15.143:3300/0 conn(0x7f69280cdd40 0x7f6928160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f6926d9d640 1 -- 172.21.15.119:0/3983511338 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69280ccb00 con 0x7f6928161060 2023-12-19T16:15:43.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.367+0000 7f691dd9b640 1 --2- 172.21.15.119:0/3983511338 >> v2:172.21.15.143:3300/0 conn(0x7f69280cdd40 0x7f6928160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:43.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f6926d9d640 1 --2- 172.21.15.119:0/3983511338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928161060 0x7f692806fdb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f692806cf00 tx=0x7f692001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199932954b2b7ba0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f6925d9b640 1 -- 172.21.15.119:0/3983511338 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200aa640 con 0x7f6928161060 2023-12-19T16:15:43.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f6925d9b640 1 -- 172.21.15.119:0/3983511338 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200aa7a0 con 0x7f6928161060 2023-12-19T16:15:43.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f6925d9b640 1 -- 172.21.15.119:0/3983511338 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200aab30 con 0x7f6928161060 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 -- 172.21.15.119:0/3983511338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928161060 msgr2=0x7f692806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 --2- 172.21.15.119:0/3983511338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928161060 0x7f692806fdb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f692806cf00 tx=0x7f692001c500 comp rx=0 tx=0).stop 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 -- 172.21.15.119:0/3983511338 shutdown_connections 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 --2- 172.21.15.119:0/3983511338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928161060 0x7f692806fdb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 --2- 172.21.15.119:0/3983511338 >> v2:172.21.15.143:3300/0 conn(0x7f69280cdd40 0x7f6928160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 --2- 172.21.15.119:0/3983511338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f692815c9d0 0x7f69280cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 -- 172.21.15.119:0/3983511338 >> 172.21.15.119:0/3983511338 conn(0x7f692806a3e0 msgr2=0x7f69280afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 -- 172.21.15.119:0/3983511338 shutdown_connections 2023-12-19T16:15:43.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 -- 172.21.15.119:0/3983511338 wait complete. 2023-12-19T16:15:43.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 Processor -- start 2023-12-19T16:15:43.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.371+0000 7f692cde9640 1 -- start start 2023-12-19T16:15:43.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69280cdd40 0x7f6928154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 0x7f69280c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6928161060 0x7f692815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280b0f80 con 0x7f692815c9d0 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c4b30 con 0x7f6928161060 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6928155090 con 0x7f69280cdd40 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 0x7f69280c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 0x7f69280c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56480/0 (socket says 172.21.15.119:56480) 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 -- 172.21.15.119:0/4187150822 learned_addr learned my addr 172.21.15.119:0/4187150822 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692659c640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69280cdd40 0x7f6928154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f6926d9d640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6928161060 0x7f692815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 -- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69280cdd40 msgr2=0x7f6928154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69280cdd40 0x7f6928154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 -- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6928161060 msgr2=0x7f692815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6928161060 0x7f692815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 -- 172.21.15.119:0/4187150822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200094d0 con 0x7f692815c9d0 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f6926d9d640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6928161060 0x7f692815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:43.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691dd9b640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 0x7f69280c7250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f691000e810 tx=0x7f691000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000c8d0 con 0x7f692815c9d0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000ca30 con 0x7f692815c9d0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69280b1190 con 0x7f692815c9d0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000cdc0 con 0x7f692815c9d0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69280b1750 con 0x7f692815c9d0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69280735b0 con 0x7f692815c9d0 2023-12-19T16:15:43.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.375+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6910013410 con 0x7f692815c9d0 2023-12-19T16:15:43.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.379+0000 7f691f7fe640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6908065a60 0x7f6908067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.379+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69100831a0 con 0x7f692815c9d0 2023-12-19T16:15:43.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.379+0000 7f692659c640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6908065a60 0x7f6908067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.379+0000 7f692659c640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6908065a60 0x7f6908067f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6918003ab0 tx=0x7f69180098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.383+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6910050920 con 0x7f692815c9d0 2023-12-19T16:15:43.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69280b4040 con 0x7f692815c9d0 2023-12-19T16:15:43.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f691f7fe640 1 -- 172.21.15.119:0/4187150822 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f6910053f40 con 0x7f692815c9d0 2023-12-19T16:15:43.569 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:43.569 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:43.570 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6908065a60 msgr2=0x7f6908067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6908065a60 0x7f6908067f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6918003ab0 tx=0x7f69180098d0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 msgr2=0x7f69280c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 0x7f69280c7250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f691000e810 tx=0x7f691000ecd0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 shutdown_connections 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6908065a60 0x7f6908067f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6928161060 0x7f692815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f692815c9d0 0x7f69280c7250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 --2- 172.21.15.119:0/4187150822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69280cdd40 0x7f6928154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 >> 172.21.15.119:0/4187150822 conn(0x7f692806a3e0 msgr2=0x7f69280ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 shutdown_connections 2023-12-19T16:15:43.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.567+0000 7f692cde9640 1 -- 172.21.15.119:0/4187150822 wait complete. 2023-12-19T16:15:43.591 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:43.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.723+0000 7fbb24539640 1 Processor -- start 2023-12-19T16:15:43.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.723+0000 7fbb24539640 1 -- start start 2023-12-19T16:15:43.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb24539640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbb1c15c9d0 0x7fbb1c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb24539640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c160690 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb24539640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0b0d80 con 0x7fbb1c06fdb0 2023-12-19T16:15:43.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb24539640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c1603f0 con 0x7fbb1c15c9d0 2023-12-19T16:15:43.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb222d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbb1c15c9d0 0x7fbb1c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb21ad4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbb1c0cdd40 0x7fbb1c160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59430/0 (socket says 172.21.15.119:59430) 2023-12-19T16:15:43.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb21ad4640 1 -- 172.21.15.119:0/2657112158 learned_addr learned my addr 172.21.15.119:0/2657112158 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:43.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb222d5640 1 -- 172.21.15.119:0/2657112158 >> v1:172.21.15.143:6789/0 conn(0x7fbb1c06fdb0 legacy=0x7fbb1c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:43.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb222d5640 1 -- 172.21.15.119:0/2657112158 >> v1:172.21.15.119:6789/0 conn(0x7fbb1c0cdd40 legacy=0x7fbb1c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb222d5640 1 -- 172.21.15.119:0/2657112158 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0ccb00 con 0x7fbb1c15c9d0 2023-12-19T16:15:43.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.727+0000 7fbb212d3640 1 -- 172.21.15.119:0/2657112158 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697257428 0 0) 0x7fbb1c160690 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb222d5640 1 --2- 172.21.15.119:0/2657112158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c15c9d0 0x7fbb1c0cc400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbb180097c0 tx=0x7fbb1801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e775aac41e68a35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb212d3640 1 -- 172.21.15.119:0/2657112158 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18004230 con 0x7fbb1c15c9d0 2023-12-19T16:15:43.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb212d3640 1 -- 172.21.15.119:0/2657112158 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb180a7050 con 0x7fbb1c15c9d0 2023-12-19T16:15:43.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb212d3640 1 -- 172.21.15.119:0/2657112158 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003620 con 0x7fbb1c15c9d0 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- 172.21.15.119:0/2657112158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c15c9d0 msgr2=0x7fbb1c0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 --2- 172.21.15.119:0/2657112158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c15c9d0 0x7fbb1c0cc400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbb180097c0 tx=0x7fbb1801c440 comp rx=0 tx=0).stop 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- 172.21.15.119:0/2657112158 shutdown_connections 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 --2- 172.21.15.119:0/2657112158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c15c9d0 0x7fbb1c0cc400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- 172.21.15.119:0/2657112158 >> 172.21.15.119:0/2657112158 conn(0x7fbb1c06a3e0 msgr2=0x7fbb1c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- 172.21.15.119:0/2657112158 shutdown_connections 2023-12-19T16:15:43.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- 172.21.15.119:0/2657112158 wait complete. 2023-12-19T16:15:43.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 Processor -- start 2023-12-19T16:15:43.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- start start 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb1c06fdb0 0x7fbb1c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 0x7fbb1c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb1c15c9d0 0x7fbb1c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0c7290 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0c5f20 con 0x7fbb1c15c9d0 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.731+0000 7fbb24539640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0c61f0 con 0x7fbb1c06fdb0 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 0x7fbb1c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 0x7fbb1c0c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56490/0 (socket says 172.21.15.119:56490) 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 -- 172.21.15.119:0/2071661971 learned_addr learned my addr 172.21.15.119:0/2071661971 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb222d5640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb1c06fdb0 0x7fbb1c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 -- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb1c06fdb0 msgr2=0x7fbb1c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb1c06fdb0 0x7fbb1c0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 -- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb1c15c9d0 msgr2=0x7fbb1c0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb1c15c9d0 0x7fbb1c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 -- 172.21.15.119:0/2071661971 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18009420 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb21ad4640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 0x7fbb1c0c54a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0011f0 tx=0x7fbb0c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0074e0 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c007640 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c1613b0 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c004a10 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c0c67b0 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0735b0 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb0c004b70 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb12ffd640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb00065a90 0x7fbb00067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.735+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb0c082a20 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.739+0000 7fbb222d5640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb00065a90 0x7fbb00067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.739+0000 7fbb222d5640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb00065a90 0x7fbb00067f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb180ad000 tx=0x7fbb18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.739+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb0c050050 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.891+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb1c04e000 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.891+0000 7fbb12ffd640 1 -- 172.21.15.119:0/2071661971 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fbb0c018090 con 0x7fbb1c0cdd40 2023-12-19T16:15:43.896 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:43.896 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb00065a90 msgr2=0x7fbb00067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb00065a90 0x7fbb00067f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb180ad000 tx=0x7fbb18008040 comp rx=0 tx=0).stop 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 msgr2=0x7fbb1c0c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 0x7fbb1c0c54a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0011f0 tx=0x7fbb0c00c9b0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 shutdown_connections 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb00065a90 0x7fbb00067f50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb1c15c9d0 0x7fbb1c0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1c0cdd40 0x7fbb1c0c54a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 --2- 172.21.15.119:0/2071661971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb1c06fdb0 0x7fbb1c0ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 >> 172.21.15.119:0/2071661971 conn(0x7fbb1c06a3e0 msgr2=0x7fbb1c0ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 shutdown_connections 2023-12-19T16:15:43.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:43.895+0000 7fbb24539640 1 -- 172.21.15.119:0/2071661971 wait complete. 2023-12-19T16:15:43.917 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:15:43.918 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:44.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.051+0000 7f0fcaf2c640 1 Processor -- start 2023-12-19T16:15:44.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.051+0000 7f0fcaf2c640 1 -- start start 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fcaf2c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0fc4158c20 0x7f0fc4070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fcaf2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0fc415c800 0x7f0fc40caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fcaf2c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc4070b80 con 0x7f0fc40cafb0 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fcaf2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc4070e60 con 0x7f0fc415c800 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fcaf2c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc4071140 con 0x7f0fc4158c20 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0fc415c800 0x7f0fc40caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0fc415c800 0x7f0fc40caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56502/0 (socket says 172.21.15.119:56502) 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 -- 172.21.15.119:0/1153885453 learned_addr learned my addr 172.21.15.119:0/1153885453 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc8cc8640 1 --2- 172.21.15.119:0/1153885453 >> v2:172.21.15.143:3300/0 conn(0x7f0fc4158c20 0x7f0fc4070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 -- 172.21.15.119:0/1153885453 >> v2:172.21.15.143:3300/0 conn(0x7f0fc4158c20 msgr2=0x7f0fc4070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 --2- 172.21.15.119:0/1153885453 >> v2:172.21.15.143:3300/0 conn(0x7f0fc4158c20 0x7f0fc4070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 -- 172.21.15.119:0/1153885453 >> v1:172.21.15.143:6789/0 conn(0x7f0fc40cafb0 legacy=0x7f0fc406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.055+0000 7f0fc3fff640 1 -- 172.21.15.119:0/1153885453 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4071420 con 0x7f0fc415c800 2023-12-19T16:15:44.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fc3fff640 1 --2- 172.21.15.119:0/1153885453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40caa70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40cc0c0 tx=0x7f0fb001d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16748bcd213aa8f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fc37fe640 1 -- 172.21.15.119:0/1153885453 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00a6800 con 0x7f0fc415c800 2023-12-19T16:15:44.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fc37fe640 1 -- 172.21.15.119:0/1153885453 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb00a6960 con 0x7f0fc415c800 2023-12-19T16:15:44.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fc37fe640 1 -- 172.21.15.119:0/1153885453 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00a6cf0 con 0x7f0fc415c800 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/1153885453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 msgr2=0x7f0fc40caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/1153885453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40caa70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40cc0c0 tx=0x7f0fb001d7d0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/1153885453 shutdown_connections 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/1153885453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40caa70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/1153885453 >> v2:172.21.15.143:3300/0 conn(0x7f0fc4158c20 0x7f0fc4070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/1153885453 >> 172.21.15.119:0/1153885453 conn(0x7f0fc406a3e0 msgr2=0x7f0fc40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/1153885453 shutdown_connections 2023-12-19T16:15:44.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/1153885453 wait complete. 2023-12-19T16:15:44.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 Processor -- start 2023-12-19T16:15:44.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 -- start start 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fc40cafb0 0x7f0fc40c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.059+0000 7f0fcaf2c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fc4158c20 0x7f0fc4149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c6780 con 0x7f0fc415c800 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c6a60 con 0x7f0fc40cafb0 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c6d40 con 0x7f0fc4158c20 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56516/0 (socket says 172.21.15.119:56516) 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 -- 172.21.15.119:0/431621924 learned_addr learned my addr 172.21.15.119:0/431621924 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc8cc8640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fc40cafb0 0x7f0fc40c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc3fff640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fc4158c20 0x7f0fc4149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 -- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fc4158c20 msgr2=0x7f0fc4149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fc4158c20 0x7f0fc4149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 -- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fc40cafb0 msgr2=0x7f0fc40c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fc40cafb0 0x7f0fc40c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 -- 172.21.15.119:0/431621924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb000a670 con 0x7f0fc415c800 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc94c9640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40ccb80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c780 tx=0x7f0fbc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc004b70 con 0x7f0fc415c800 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc00ce90 con 0x7f0fc415c800 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00a850 con 0x7f0fc415c800 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40c8800 con 0x7f0fc415c800 2023-12-19T16:15:44.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40c7300 con 0x7f0fc415c800 2023-12-19T16:15:44.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc40735b0 con 0x7f0fc415c800 2023-12-19T16:15:44.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.063+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0fbc00a9b0 con 0x7f0fc415c800 2023-12-19T16:15:44.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.067+0000 7f0fc17fa640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0fa8065a60 0x7f0fa8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.067+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fbc0835b0 con 0x7f0fc415c800 2023-12-19T16:15:44.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.067+0000 7f0fc8cc8640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0fa8065a60 0x7f0fa8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.067+0000 7f0fc8cc8640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0fa8065a60 0x7f0fa8067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8007a60 tx=0x7f0fb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.067+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0fbc050c90 con 0x7f0fc415c800 2023-12-19T16:15:44.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.223+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fc40c6bd0 con 0x7f0fa8065a60 2023-12-19T16:15:44.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.235+0000 7f0fc17fa640 1 -- 172.21.15.119:0/431621924 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345289 (secure 0 0 0) 0x7f0fc40c6bd0 con 0x7f0fa8065a60 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0fa8065a60 msgr2=0x7f0fa8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0fa8065a60 0x7f0fa8067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8007a60 tx=0x7f0fb8008040 comp rx=0 tx=0).stop 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 msgr2=0x7f0fc40ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40ccb80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c780 tx=0x7f0fbc00cc40 comp rx=0 tx=0).stop 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 shutdown_connections 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0fa8065a60 0x7f0fa8067f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc415c800 0x7f0fc40ccb80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fc4158c20 0x7f0fc4149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 --2- 172.21.15.119:0/431621924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fc40cafb0 0x7f0fc40c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 >> 172.21.15.119:0/431621924 conn(0x7f0fc406a3e0 msgr2=0x7f0fc40adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 shutdown_connections 2023-12-19T16:15:44.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.239+0000 7f0fcaf2c640 1 -- 172.21.15.119:0/431621924 wait complete. 2023-12-19T16:15:44.260 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-12-19T16:15:42.452496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002879"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588192+0000","last_change":"2023-12-19T16:15:20.196445+0000","last_active":"2023-12-19T16:15:24.588192+0000","last_peered":"2023-12-19T16:15:24.588192+0000","last_clean":"2023-12-19T16:15:24.588192+0000","last_became_active":"2023-12-19T16:15:20.196170+0000","last_became_peered":"2023-12-19T16:15:20.196170+0000","last_unstale":"2023-12-19T16:15:24.588192+0000","last_undegraded":"2023-12-19T16:15:24.588192+0000","last_fullsized":"2023-12-19T16:15:24.588192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:39.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580441+0000","last_change":"2023-12-19T16:15:20.606495+0000","last_active":"2023-12-19T16:15:24.580441+0000","last_peered":"2023-12-19T16:15:24.580441+0000","last_clean":"2023-12-19T16:15:24.580441+0000","last_became_active":"2023-12-19T16:15:20.605146+0000","last_became_peered":"2023-12-19T16:15:20.605146+0000","last_unstale":"2023-12-19T16:15:24.580441+0000","last_undegraded":"2023-12-19T16:15:24.580441+0000","last_fullsized":"2023-12-19T16:15:24.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991230+0000","last_change":"2023-12-19T16:15:24.614967+0000","last_active":"2023-12-19T16:15:24.991230+0000","last_peered":"2023-12-19T16:15:24.991230+0000","last_clean":"2023-12-19T16:15:24.991230+0000","last_became_active":"2023-12-19T16:15:24.614174+0000","last_became_peered":"2023-12-19T16:15:24.614174+0000","last_unstale":"2023-12-19T16:15:24.991230+0000","last_undegraded":"2023-12-19T16:15:24.991230+0000","last_fullsized":"2023-12-19T16:15:24.991230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580626+0000","last_change":"2023-12-19T16:15:20.202976+0000","last_active":"2023-12-19T16:15:24.580626+0000","last_peered":"2023-12-19T16:15:24.580626+0000","last_clean":"2023-12-19T16:15:24.580626+0000","last_became_active":"2023-12-19T16:15:20.202692+0000","last_became_peered":"2023-12-19T16:15:20.202692+0000","last_unstale":"2023-12-19T16:15:24.580626+0000","last_undegraded":"2023-12-19T16:15:24.580626+0000","last_fullsized":"2023-12-19T16:15:24.580626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587899+0000","last_change":"2023-12-19T16:15:20.579266+0000","last_active":"2023-12-19T16:15:24.587899+0000","last_peered":"2023-12-19T16:15:24.587899+0000","last_clean":"2023-12-19T16:15:24.587899+0000","last_became_active":"2023-12-19T16:15:20.579039+0000","last_became_peered":"2023-12-19T16:15:20.579039+0000","last_unstale":"2023-12-19T16:15:24.587899+0000","last_undegraded":"2023-12-19T16:15:24.587899+0000","last_fullsized":"2023-12-19T16:15:24.587899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987177+0000","last_change":"2023-12-19T16:15:24.618815+0000","last_active":"2023-12-19T16:15:24.987177+0000","last_peered":"2023-12-19T16:15:24.987177+0000","last_clean":"2023-12-19T16:15:24.987177+0000","last_became_active":"2023-12-19T16:15:24.618408+0000","last_became_peered":"2023-12-19T16:15:24.618408+0000","last_unstale":"2023-12-19T16:15:24.987177+0000","last_undegraded":"2023-12-19T16:15:24.987177+0000","last_fullsized":"2023-12-19T16:15:24.987177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.615964+0000","last_change":"2023-12-19T16:15:20.206941+0000","last_active":"2023-12-19T16:15:24.615964+0000","last_peered":"2023-12-19T16:15:24.615964+0000","last_clean":"2023-12-19T16:15:24.615964+0000","last_became_active":"2023-12-19T16:15:20.206623+0000","last_became_peered":"2023-12-19T16:15:20.206623+0000","last_unstale":"2023-12-19T16:15:24.615964+0000","last_undegraded":"2023-12-19T16:15:24.615964+0000","last_fullsized":"2023-12-19T16:15:24.615964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:42.922649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582028+0000","last_change":"2023-12-19T16:15:20.576757+0000","last_active":"2023-12-19T16:15:24.582028+0000","last_peered":"2023-12-19T16:15:24.582028+0000","last_clean":"2023-12-19T16:15:24.582028+0000","last_became_active":"2023-12-19T16:15:20.576280+0000","last_became_peered":"2023-12-19T16:15:20.576280+0000","last_unstale":"2023-12-19T16:15:24.582028+0000","last_undegraded":"2023-12-19T16:15:24.582028+0000","last_fullsized":"2023-12-19T16:15:24.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987587+0000","last_change":"2023-12-19T16:15:24.618996+0000","last_active":"2023-12-19T16:15:24.987587+0000","last_peered":"2023-12-19T16:15:24.987587+0000","last_clean":"2023-12-19T16:15:24.987587+0000","last_became_active":"2023-12-19T16:15:24.613588+0000","last_became_peered":"2023-12-19T16:15:24.613588+0000","last_unstale":"2023-12-19T16:15:24.987587+0000","last_undegraded":"2023-12-19T16:15:24.987587+0000","last_fullsized":"2023-12-19T16:15:24.987587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:20.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612643+0000","last_change":"2023-12-19T16:15:20.209759+0000","last_active":"2023-12-19T16:15:24.612643+0000","last_peered":"2023-12-19T16:15:24.612643+0000","last_clean":"2023-12-19T16:15:24.612643+0000","last_became_active":"2023-12-19T16:15:20.209441+0000","last_became_peered":"2023-12-19T16:15:20.209441+0000","last_unstale":"2023-12-19T16:15:24.612643+0000","last_undegraded":"2023-12-19T16:15:24.612643+0000","last_fullsized":"2023-12-19T16:15:24.612643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:45.528168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583519+0000","last_change":"2023-12-19T16:15:20.576676+0000","last_active":"2023-12-19T16:15:24.583519+0000","last_peered":"2023-12-19T16:15:24.583519+0000","last_clean":"2023-12-19T16:15:24.583519+0000","last_became_active":"2023-12-19T16:15:20.576400+0000","last_became_peered":"2023-12-19T16:15:20.576400+0000","last_unstale":"2023-12-19T16:15:24.583519+0000","last_undegraded":"2023-12-19T16:15:24.583519+0000","last_fullsized":"2023-12-19T16:15:24.583519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987579+0000","last_change":"2023-12-19T16:15:24.619492+0000","last_active":"2023-12-19T16:15:24.987579+0000","last_peered":"2023-12-19T16:15:24.987579+0000","last_clean":"2023-12-19T16:15:24.987579+0000","last_became_active":"2023-12-19T16:15:24.618455+0000","last_became_peered":"2023-12-19T16:15:24.618455+0000","last_unstale":"2023-12-19T16:15:24.987579+0000","last_undegraded":"2023-12-19T16:15:24.987579+0000","last_fullsized":"2023-12-19T16:15:24.987579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:27.195791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590403+0000","last_change":"2023-12-19T16:15:20.598403+0000","last_active":"2023-12-19T16:15:24.590403+0000","last_peered":"2023-12-19T16:15:24.590403+0000","last_clean":"2023-12-19T16:15:24.590403+0000","last_became_active":"2023-12-19T16:15:20.598090+0000","last_became_peered":"2023-12-19T16:15:20.598090+0000","last_unstale":"2023-12-19T16:15:24.590403+0000","last_undegraded":"2023-12-19T16:15:24.590403+0000","last_fullsized":"2023-12-19T16:15:24.590403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612925+0000","last_change":"2023-12-19T16:15:20.202909+0000","last_active":"2023-12-19T16:15:24.612925+0000","last_peered":"2023-12-19T16:15:24.612925+0000","last_clean":"2023-12-19T16:15:24.612925+0000","last_became_active":"2023-12-19T16:15:20.202536+0000","last_became_peered":"2023-12-19T16:15:20.202536+0000","last_unstale":"2023-12-19T16:15:24.612925+0000","last_undegraded":"2023-12-19T16:15:24.612925+0000","last_fullsized":"2023-12-19T16:15:24.612925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:37.663686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987782+0000","last_change":"2023-12-19T16:15:24.611948+0000","last_active":"2023-12-19T16:15:24.987782+0000","last_peered":"2023-12-19T16:15:24.987782+0000","last_clean":"2023-12-19T16:15:24.987782+0000","last_became_active":"2023-12-19T16:15:24.611168+0000","last_became_peered":"2023-12-19T16:15:24.611168+0000","last_unstale":"2023-12-19T16:15:24.987782+0000","last_undegraded":"2023-12-19T16:15:24.987782+0000","last_fullsized":"2023-12-19T16:15:24.987782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:58.259665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580838+0000","last_change":"2023-12-19T16:15:20.582515+0000","last_active":"2023-12-19T16:15:24.580838+0000","last_peered":"2023-12-19T16:15:24.580838+0000","last_clean":"2023-12-19T16:15:24.580838+0000","last_became_active":"2023-12-19T16:15:20.582246+0000","last_became_peered":"2023-12-19T16:15:20.582246+0000","last_unstale":"2023-12-19T16:15:24.580838+0000","last_undegraded":"2023-12-19T16:15:24.580838+0000","last_fullsized":"2023-12-19T16:15:24.580838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609028+0000","last_change":"2023-12-19T16:15:20.193662+0000","last_active":"2023-12-19T16:15:24.609028+0000","last_peered":"2023-12-19T16:15:24.609028+0000","last_clean":"2023-12-19T16:15:24.609028+0000","last_became_active":"2023-12-19T16:15:20.193345+0000","last_became_peered":"2023-12-19T16:15:20.193345+0000","last_unstale":"2023-12-19T16:15:24.609028+0000","last_undegraded":"2023-12-19T16:15:24.609028+0000","last_fullsized":"2023-12-19T16:15:24.609028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987322+0000","last_change":"2023-12-19T16:15:24.621026+0000","last_active":"2023-12-19T16:15:24.987322+0000","last_peered":"2023-12-19T16:15:24.987322+0000","last_clean":"2023-12-19T16:15:24.987322+0000","last_became_active":"2023-12-19T16:15:24.618568+0000","last_became_peered":"2023-12-19T16:15:24.618568+0000","last_unstale":"2023-12-19T16:15:24.987322+0000","last_undegraded":"2023-12-19T16:15:24.987322+0000","last_fullsized":"2023-12-19T16:15:24.987322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580610+0000","last_change":"2023-12-19T16:15:20.593268+0000","last_active":"2023-12-19T16:15:24.580610+0000","last_peered":"2023-12-19T16:15:24.580610+0000","last_clean":"2023-12-19T16:15:24.580610+0000","last_became_active":"2023-12-19T16:15:20.593033+0000","last_became_peered":"2023-12-19T16:15:20.593033+0000","last_unstale":"2023-12-19T16:15:24.580610+0000","last_undegraded":"2023-12-19T16:15:24.580610+0000","last_fullsized":"2023-12-19T16:15:24.580610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607527+0000","last_change":"2023-12-19T16:15:20.190652+0000","last_active":"2023-12-19T16:15:24.607527+0000","last_peered":"2023-12-19T16:15:24.607527+0000","last_clean":"2023-12-19T16:15:24.607527+0000","last_became_active":"2023-12-19T16:15:20.190271+0000","last_became_peered":"2023-12-19T16:15:20.190271+0000","last_unstale":"2023-12-19T16:15:24.607527+0000","last_undegraded":"2023-12-19T16:15:24.607527+0000","last_fullsized":"2023-12-19T16:15:24.607527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991773+0000","last_change":"2023-12-19T16:15:24.620676+0000","last_active":"2023-12-19T16:15:24.991773+0000","last_peered":"2023-12-19T16:15:24.991773+0000","last_clean":"2023-12-19T16:15:24.991773+0000","last_became_active":"2023-12-19T16:15:24.619756+0000","last_became_peered":"2023-12-19T16:15:24.619756+0000","last_unstale":"2023-12-19T16:15:24.991773+0000","last_undegraded":"2023-12-19T16:15:24.991773+0000","last_fullsized":"2023-12-19T16:15:24.991773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588078+0000","last_change":"2023-12-19T16:15:20.583947+0000","last_active":"2023-12-19T16:15:24.588078+0000","last_peered":"2023-12-19T16:15:24.588078+0000","last_clean":"2023-12-19T16:15:24.588078+0000","last_became_active":"2023-12-19T16:15:20.583625+0000","last_became_peered":"2023-12-19T16:15:20.583625+0000","last_unstale":"2023-12-19T16:15:24.588078+0000","last_undegraded":"2023-12-19T16:15:24.588078+0000","last_fullsized":"2023-12-19T16:15:24.588078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:00.076039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606271+0000","last_change":"2023-12-19T16:15:20.197434+0000","last_active":"2023-12-19T16:15:24.606271+0000","last_peered":"2023-12-19T16:15:24.606271+0000","last_clean":"2023-12-19T16:15:24.606271+0000","last_became_active":"2023-12-19T16:15:20.197066+0000","last_became_peered":"2023-12-19T16:15:20.197066+0000","last_unstale":"2023-12-19T16:15:24.606271+0000","last_undegraded":"2023-12-19T16:15:24.606271+0000","last_fullsized":"2023-12-19T16:15:24.606271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987228+0000","last_change":"2023-12-19T16:15:24.614999+0000","last_active":"2023-12-19T16:15:24.987228+0000","last_peered":"2023-12-19T16:15:24.987228+0000","last_clean":"2023-12-19T16:15:24.987228+0000","last_became_active":"2023-12-19T16:15:24.613975+0000","last_became_peered":"2023-12-19T16:15:24.613975+0000","last_unstale":"2023-12-19T16:15:24.987228+0000","last_undegraded":"2023-12-19T16:15:24.987228+0000","last_fullsized":"2023-12-19T16:15:24.987228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588898+0000","last_change":"2023-12-19T16:15:20.592452+0000","last_active":"2023-12-19T16:15:24.588898+0000","last_peered":"2023-12-19T16:15:24.588898+0000","last_clean":"2023-12-19T16:15:24.588898+0000","last_became_active":"2023-12-19T16:15:20.592161+0000","last_became_peered":"2023-12-19T16:15:20.592161+0000","last_unstale":"2023-12-19T16:15:24.588898+0000","last_undegraded":"2023-12-19T16:15:24.588898+0000","last_fullsized":"2023-12-19T16:15:24.588898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591886+0000","last_change":"2023-12-19T16:15:20.208862+0000","last_active":"2023-12-19T16:15:24.591886+0000","last_peered":"2023-12-19T16:15:24.591886+0000","last_clean":"2023-12-19T16:15:24.591886+0000","last_became_active":"2023-12-19T16:15:20.208590+0000","last_became_peered":"2023-12-19T16:15:20.208590+0000","last_unstale":"2023-12-19T16:15:24.591886+0000","last_undegraded":"2023-12-19T16:15:24.591886+0000","last_fullsized":"2023-12-19T16:15:24.591886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987223+0000","last_change":"2023-12-19T16:15:24.614167+0000","last_active":"2023-12-19T16:15:24.987223+0000","last_peered":"2023-12-19T16:15:24.987223+0000","last_clean":"2023-12-19T16:15:24.987223+0000","last_became_active":"2023-12-19T16:15:24.613456+0000","last_became_peered":"2023-12-19T16:15:24.613456+0000","last_unstale":"2023-12-19T16:15:24.987223+0000","last_undegraded":"2023-12-19T16:15:24.987223+0000","last_fullsized":"2023-12-19T16:15:24.987223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580848+0000","last_change":"2023-12-19T16:15:20.587069+0000","last_active":"2023-12-19T16:15:24.580848+0000","last_peered":"2023-12-19T16:15:24.580848+0000","last_clean":"2023-12-19T16:15:24.580848+0000","last_became_active":"2023-12-19T16:15:20.586781+0000","last_became_peered":"2023-12-19T16:15:20.586781+0000","last_unstale":"2023-12-19T16:15:24.580848+0000","last_undegraded":"2023-12-19T16:15:24.580848+0000","last_fullsized":"2023-12-19T16:15:24.580848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609772+0000","last_change":"2023-12-19T16:15:20.206431+0000","last_active":"2023-12-19T16:15:24.609772+0000","last_peered":"2023-12-19T16:15:24.609772+0000","last_clean":"2023-12-19T16:15:24.609772+0000","last_became_active":"2023-12-19T16:15:20.206208+0000","last_became_peered":"2023-12-19T16:15:20.206208+0000","last_unstale":"2023-12-19T16:15:24.609772+0000","last_undegraded":"2023-12-19T16:15:24.609772+0000","last_fullsized":"2023-12-19T16:15:24.609772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990754+0000","last_change":"2023-12-19T16:15:24.612174+0000","last_active":"2023-12-19T16:15:24.990754+0000","last_peered":"2023-12-19T16:15:24.990754+0000","last_clean":"2023-12-19T16:15:24.990754+0000","last_became_active":"2023-12-19T16:15:24.611609+0000","last_became_peered":"2023-12-19T16:15:24.611609+0000","last_unstale":"2023-12-19T16:15:24.990754+0000","last_undegraded":"2023-12-19T16:15:24.990754+0000","last_fullsized":"2023-12-19T16:15:24.990754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:54.794163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609936+0000","last_change":"2023-12-19T16:15:20.590393+0000","last_active":"2023-12-19T16:15:24.609936+0000","last_peered":"2023-12-19T16:15:24.609936+0000","last_clean":"2023-12-19T16:15:24.609936+0000","last_became_active":"2023-12-19T16:15:20.589290+0000","last_became_peered":"2023-12-19T16:15:20.589290+0000","last_unstale":"2023-12-19T16:15:24.609936+0000","last_undegraded":"2023-12-19T16:15:24.609936+0000","last_fullsized":"2023-12-19T16:15:24.609936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616161+0000","last_change":"2023-12-19T16:15:20.203475+0000","last_active":"2023-12-19T16:15:24.616161+0000","last_peered":"2023-12-19T16:15:24.616161+0000","last_clean":"2023-12-19T16:15:24.616161+0000","last_became_active":"2023-12-19T16:15:20.203209+0000","last_became_peered":"2023-12-19T16:15:20.203209+0000","last_unstale":"2023-12-19T16:15:24.616161+0000","last_undegraded":"2023-12-19T16:15:24.616161+0000","last_fullsized":"2023-12-19T16:15:24.616161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991778+0000","last_change":"2023-12-19T16:15:24.604368+0000","last_active":"2023-12-19T16:15:24.991778+0000","last_peered":"2023-12-19T16:15:24.991778+0000","last_clean":"2023-12-19T16:15:24.991778+0000","last_became_active":"2023-12-19T16:15:24.603970+0000","last_became_peered":"2023-12-19T16:15:24.603970+0000","last_unstale":"2023-12-19T16:15:24.991778+0000","last_undegraded":"2023-12-19T16:15:24.991778+0000","last_fullsized":"2023-12-19T16:15:24.991778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583544+0000","last_change":"2023-12-19T16:15:20.590364+0000","last_active":"2023-12-19T16:15:24.583544+0000","last_peered":"2023-12-19T16:15:24.583544+0000","last_clean":"2023-12-19T16:15:24.583544+0000","last_became_active":"2023-12-19T16:15:20.589975+0000","last_became_peered":"2023-12-19T16:15:20.589975+0000","last_unstale":"2023-12-19T16:15:24.583544+0000","last_undegraded":"2023-12-19T16:15:24.583544+0000","last_fullsized":"2023-12-19T16:15:24.583544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610003+0000","last_change":"2023-12-19T16:15:20.190567+0000","last_active":"2023-12-19T16:15:24.610003+0000","last_peered":"2023-12-19T16:15:24.610003+0000","last_clean":"2023-12-19T16:15:24.610003+0000","last_became_active":"2023-12-19T16:15:20.189732+0000","last_became_peered":"2023-12-19T16:15:20.189732+0000","last_unstale":"2023-12-19T16:15:24.610003+0000","last_undegraded":"2023-12-19T16:15:24.610003+0000","last_fullsized":"2023-12-19T16:15:24.610003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990745+0000","last_change":"2023-12-19T16:15:24.613205+0000","last_active":"2023-12-19T16:15:24.990745+0000","last_peered":"2023-12-19T16:15:24.990745+0000","last_clean":"2023-12-19T16:15:24.990745+0000","last_became_active":"2023-12-19T16:15:24.612609+0000","last_became_peered":"2023-12-19T16:15:24.612609+0000","last_unstale":"2023-12-19T16:15:24.990745+0000","last_undegraded":"2023-12-19T16:15:24.990745+0000","last_fullsized":"2023-12-19T16:15:24.990745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586333+0000","last_change":"2023-12-19T16:15:20.574569+0000","last_active":"2023-12-19T16:15:24.586333+0000","last_peered":"2023-12-19T16:15:24.586333+0000","last_clean":"2023-12-19T16:15:24.586333+0000","last_became_active":"2023-12-19T16:15:20.573795+0000","last_became_peered":"2023-12-19T16:15:20.573795+0000","last_unstale":"2023-12-19T16:15:24.586333+0000","last_undegraded":"2023-12-19T16:15:24.586333+0000","last_fullsized":"2023-12-19T16:15:24.586333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583390+0000","last_change":"2023-12-19T16:15:20.194527+0000","last_active":"2023-12-19T16:15:24.583390+0000","last_peered":"2023-12-19T16:15:24.583390+0000","last_clean":"2023-12-19T16:15:24.583390+0000","last_became_active":"2023-12-19T16:15:20.194212+0000","last_became_peered":"2023-12-19T16:15:20.194212+0000","last_unstale":"2023-12-19T16:15:24.583390+0000","last_undegraded":"2023-12-19T16:15:24.583390+0000","last_fullsized":"2023-12-19T16:15:24.583390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991169+0000","last_change":"2023-12-19T16:15:24.619624+0000","last_active":"2023-12-19T16:15:24.991169+0000","last_peered":"2023-12-19T16:15:24.991169+0000","last_clean":"2023-12-19T16:15:24.991169+0000","last_became_active":"2023-12-19T16:15:24.619279+0000","last_became_peered":"2023-12-19T16:15:24.619279+0000","last_unstale":"2023-12-19T16:15:24.991169+0000","last_undegraded":"2023-12-19T16:15:24.991169+0000","last_fullsized":"2023-12-19T16:15:24.991169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.604284+0000","last_change":"2023-12-19T16:15:20.588633+0000","last_active":"2023-12-19T16:15:24.604284+0000","last_peered":"2023-12-19T16:15:24.604284+0000","last_clean":"2023-12-19T16:15:24.604284+0000","last_became_active":"2023-12-19T16:15:20.585483+0000","last_became_peered":"2023-12-19T16:15:20.585483+0000","last_unstale":"2023-12-19T16:15:24.604284+0000","last_undegraded":"2023-12-19T16:15:24.604284+0000","last_fullsized":"2023-12-19T16:15:24.604284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586562+0000","last_change":"2023-12-19T16:15:20.190133+0000","last_active":"2023-12-19T16:15:24.586562+0000","last_peered":"2023-12-19T16:15:24.586562+0000","last_clean":"2023-12-19T16:15:24.586562+0000","last_became_active":"2023-12-19T16:15:20.189767+0000","last_became_peered":"2023-12-19T16:15:20.189767+0000","last_unstale":"2023-12-19T16:15:24.586562+0000","last_undegraded":"2023-12-19T16:15:24.586562+0000","last_fullsized":"2023-12-19T16:15:24.586562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991870+0000","last_change":"2023-12-19T16:15:24.620960+0000","last_active":"2023-12-19T16:15:24.991870+0000","last_peered":"2023-12-19T16:15:24.991870+0000","last_clean":"2023-12-19T16:15:24.991870+0000","last_became_active":"2023-12-19T16:15:24.620316+0000","last_became_peered":"2023-12-19T16:15:24.620316+0000","last_unstale":"2023-12-19T16:15:24.991870+0000","last_undegraded":"2023-12-19T16:15:24.991870+0000","last_fullsized":"2023-12-19T16:15:24.991870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589097+0000","last_change":"2023-12-19T16:15:20.577774+0000","last_active":"2023-12-19T16:15:24.589097+0000","last_peered":"2023-12-19T16:15:24.589097+0000","last_clean":"2023-12-19T16:15:24.589097+0000","last_became_active":"2023-12-19T16:15:20.577521+0000","last_became_peered":"2023-12-19T16:15:20.577521+0000","last_unstale":"2023-12-19T16:15:24.589097+0000","last_undegraded":"2023-12-19T16:15:24.589097+0000","last_fullsized":"2023-12-19T16:15:24.589097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606291+0000","last_change":"2023-12-19T16:15:20.201723+0000","last_active":"2023-12-19T16:15:24.606291+0000","last_peered":"2023-12-19T16:15:24.606291+0000","last_clean":"2023-12-19T16:15:24.606291+0000","last_became_active":"2023-12-19T16:15:20.201368+0000","last_became_peered":"2023-12-19T16:15:20.201368+0000","last_unstale":"2023-12-19T16:15:24.606291+0000","last_undegraded":"2023-12-19T16:15:24.606291+0000","last_fullsized":"2023-12-19T16:15:24.606291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:17.746223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991977+0000","last_change":"2023-12-19T16:15:24.614648+0000","last_active":"2023-12-19T16:15:24.991977+0000","last_peered":"2023-12-19T16:15:24.991977+0000","last_clean":"2023-12-19T16:15:24.991977+0000","last_became_active":"2023-12-19T16:15:24.611988+0000","last_became_peered":"2023-12-19T16:15:24.611988+0000","last_unstale":"2023-12-19T16:15:24.991977+0000","last_undegraded":"2023-12-19T16:15:24.991977+0000","last_fullsized":"2023-12-19T16:15:24.991977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579894+0000","last_change":"2023-12-19T16:15:20.591587+0000","last_active":"2023-12-19T16:15:24.579894+0000","last_peered":"2023-12-19T16:15:24.579894+0000","last_clean":"2023-12-19T16:15:24.579894+0000","last_became_active":"2023-12-19T16:15:20.589033+0000","last_became_peered":"2023-12-19T16:15:20.589033+0000","last_unstale":"2023-12-19T16:15:24.579894+0000","last_undegraded":"2023-12-19T16:15:24.579894+0000","last_fullsized":"2023-12-19T16:15:24.579894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583506+0000","last_change":"2023-12-19T16:15:20.193675+0000","last_active":"2023-12-19T16:15:24.583506+0000","last_peered":"2023-12-19T16:15:24.583506+0000","last_clean":"2023-12-19T16:15:24.583506+0000","last_became_active":"2023-12-19T16:15:20.189433+0000","last_became_peered":"2023-12-19T16:15:20.189433+0000","last_unstale":"2023-12-19T16:15:24.583506+0000","last_undegraded":"2023-12-19T16:15:24.583506+0000","last_fullsized":"2023-12-19T16:15:24.583506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606398+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:15:24.606398+0000","last_peered":"2023-12-19T16:15:24.606398+0000","last_clean":"2023-12-19T16:15:24.606398+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:15:24.606398+0000","last_undegraded":"2023-12-19T16:15:24.606398+0000","last_fullsized":"2023-12-19T16:15:24.606398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992081+0000","last_change":"2023-12-19T16:15:24.621441+0000","last_active":"2023-12-19T16:15:24.992081+0000","last_peered":"2023-12-19T16:15:24.992081+0000","last_clean":"2023-12-19T16:15:24.992081+0000","last_became_active":"2023-12-19T16:15:24.619272+0000","last_became_peered":"2023-12-19T16:15:24.619272+0000","last_unstale":"2023-12-19T16:15:24.992081+0000","last_undegraded":"2023-12-19T16:15:24.992081+0000","last_fullsized":"2023-12-19T16:15:24.992081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:04.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.614464+0000","last_change":"2023-12-19T16:15:20.608106+0000","last_active":"2023-12-19T16:15:24.614464+0000","last_peered":"2023-12-19T16:15:24.614464+0000","last_clean":"2023-12-19T16:15:24.614464+0000","last_became_active":"2023-12-19T16:15:20.607827+0000","last_became_peered":"2023-12-19T16:15:20.607827+0000","last_unstale":"2023-12-19T16:15:24.614464+0000","last_undegraded":"2023-12-19T16:15:24.614464+0000","last_fullsized":"2023-12-19T16:15:24.614464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:56.432350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586822+0000","last_change":"2023-12-19T16:15:20.188280+0000","last_active":"2023-12-19T16:15:24.586822+0000","last_peered":"2023-12-19T16:15:24.586822+0000","last_clean":"2023-12-19T16:15:24.586822+0000","last_became_active":"2023-12-19T16:15:20.187947+0000","last_became_peered":"2023-12-19T16:15:20.187947+0000","last_unstale":"2023-12-19T16:15:24.586822+0000","last_undegraded":"2023-12-19T16:15:24.586822+0000","last_fullsized":"2023-12-19T16:15:24.586822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991784+0000","last_change":"2023-12-19T16:15:24.611679+0000","last_active":"2023-12-19T16:15:24.991784+0000","last_peered":"2023-12-19T16:15:24.991784+0000","last_clean":"2023-12-19T16:15:24.991784+0000","last_became_active":"2023-12-19T16:15:24.610986+0000","last_became_peered":"2023-12-19T16:15:24.610986+0000","last_unstale":"2023-12-19T16:15:24.991784+0000","last_undegraded":"2023-12-19T16:15:24.991784+0000","last_fullsized":"2023-12-19T16:15:24.991784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:11.191541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582165+0000","last_change":"2023-12-19T16:15:20.595169+0000","last_active":"2023-12-19T16:15:24.582165+0000","last_peered":"2023-12-19T16:15:24.582165+0000","last_clean":"2023-12-19T16:15:24.582165+0000","last_became_active":"2023-12-19T16:15:20.594861+0000","last_became_peered":"2023-12-19T16:15:20.594861+0000","last_unstale":"2023-12-19T16:15:24.582165+0000","last_undegraded":"2023-12-19T16:15:24.582165+0000","last_fullsized":"2023-12-19T16:15:24.582165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610122+0000","last_change":"2023-12-19T16:15:20.189994+0000","last_active":"2023-12-19T16:15:24.610122+0000","last_peered":"2023-12-19T16:15:24.610122+0000","last_clean":"2023-12-19T16:15:24.610122+0000","last_became_active":"2023-12-19T16:15:20.188076+0000","last_became_peered":"2023-12-19T16:15:20.188076+0000","last_unstale":"2023-12-19T16:15:24.610122+0000","last_undegraded":"2023-12-19T16:15:24.610122+0000","last_fullsized":"2023-12-19T16:15:24.610122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991932+0000","last_change":"2023-12-19T16:15:24.602286+0000","last_active":"2023-12-19T16:15:24.991932+0000","last_peered":"2023-12-19T16:15:24.991932+0000","last_clean":"2023-12-19T16:15:24.991932+0000","last_became_active":"2023-12-19T16:15:24.601875+0000","last_became_peered":"2023-12-19T16:15:24.601875+0000","last_unstale":"2023-12-19T16:15:24.991932+0000","last_undegraded":"2023-12-19T16:15:24.991932+0000","last_fullsized":"2023-12-19T16:15:24.991932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616423+0000","last_change":"2023-12-19T16:15:20.605190+0000","last_active":"2023-12-19T16:15:24.616423+0000","last_peered":"2023-12-19T16:15:24.616423+0000","last_clean":"2023-12-19T16:15:24.616423+0000","last_became_active":"2023-12-19T16:15:20.605031+0000","last_became_peered":"2023-12-19T16:15:20.605031+0000","last_unstale":"2023-12-19T16:15:24.616423+0000","last_undegraded":"2023-12-19T16:15:24.616423+0000","last_fullsized":"2023-12-19T16:15:24.616423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586417+0000","last_change":"2023-12-19T16:15:20.188422+0000","last_active":"2023-12-19T16:15:24.586417+0000","last_peered":"2023-12-19T16:15:24.586417+0000","last_clean":"2023-12-19T16:15:24.586417+0000","last_became_active":"2023-12-19T16:15:20.188093+0000","last_became_peered":"2023-12-19T16:15:20.188093+0000","last_unstale":"2023-12-19T16:15:24.586417+0000","last_undegraded":"2023-12-19T16:15:24.586417+0000","last_fullsized":"2023-12-19T16:15:24.586417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987050+0000","last_change":"2023-12-19T16:15:24.601682+0000","last_active":"2023-12-19T16:15:24.987050+0000","last_peered":"2023-12-19T16:15:24.987050+0000","last_clean":"2023-12-19T16:15:24.987050+0000","last_became_active":"2023-12-19T16:15:24.601267+0000","last_became_peered":"2023-12-19T16:15:24.601267+0000","last_unstale":"2023-12-19T16:15:24.987050+0000","last_undegraded":"2023-12-19T16:15:24.987050+0000","last_fullsized":"2023-12-19T16:15:24.987050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616152+0000","last_change":"2023-12-19T16:15:20.601877+0000","last_active":"2023-12-19T16:15:24.616152+0000","last_peered":"2023-12-19T16:15:24.616152+0000","last_clean":"2023-12-19T16:15:24.616152+0000","last_became_active":"2023-12-19T16:15:20.601574+0000","last_became_peered":"2023-12-19T16:15:20.601574+0000","last_unstale":"2023-12-19T16:15:24.616152+0000","last_undegraded":"2023-12-19T16:15:24.616152+0000","last_fullsized":"2023-12-19T16:15:24.616152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586605+0000","last_change":"2023-12-19T16:15:20.203704+0000","last_active":"2023-12-19T16:15:24.586605+0000","last_peered":"2023-12-19T16:15:24.586605+0000","last_clean":"2023-12-19T16:15:24.586605+0000","last_became_active":"2023-12-19T16:15:20.203355+0000","last_became_peered":"2023-12-19T16:15:20.203355+0000","last_unstale":"2023-12-19T16:15:24.586605+0000","last_undegraded":"2023-12-19T16:15:24.586605+0000","last_fullsized":"2023-12-19T16:15:24.586605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987820+0000","last_change":"2023-12-19T16:15:24.624496+0000","last_active":"2023-12-19T16:15:24.987820+0000","last_peered":"2023-12-19T16:15:24.987820+0000","last_clean":"2023-12-19T16:15:24.987820+0000","last_became_active":"2023-12-19T16:15:24.620007+0000","last_became_peered":"2023-12-19T16:15:24.620007+0000","last_unstale":"2023-12-19T16:15:24.987820+0000","last_undegraded":"2023-12-19T16:15:24.987820+0000","last_fullsized":"2023-12-19T16:15:24.987820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611918+0000","last_change":"2023-12-19T16:15:20.592930+0000","last_active":"2023-12-19T16:15:24.611918+0000","last_peered":"2023-12-19T16:15:24.611918+0000","last_clean":"2023-12-19T16:15:24.611918+0000","last_became_active":"2023-12-19T16:15:20.592602+0000","last_became_peered":"2023-12-19T16:15:20.592602+0000","last_unstale":"2023-12-19T16:15:24.611918+0000","last_undegraded":"2023-12-19T16:15:24.611918+0000","last_fullsized":"2023-12-19T16:15:24.611918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586537+0000","last_change":"2023-12-19T16:15:20.193145+0000","last_active":"2023-12-19T16:15:24.586537+0000","last_peered":"2023-12-19T16:15:24.586537+0000","last_clean":"2023-12-19T16:15:24.586537+0000","last_became_active":"2023-12-19T16:15:20.192849+0000","last_became_peered":"2023-12-19T16:15:20.192849+0000","last_unstale":"2023-12-19T16:15:24.586537+0000","last_undegraded":"2023-12-19T16:15:24.586537+0000","last_fullsized":"2023-12-19T16:15:24.586537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990894+0000","last_change":"2023-12-19T16:15:24.617964+0000","last_active":"2023-12-19T16:15:24.990894+0000","last_peered":"2023-12-19T16:15:24.990894+0000","last_clean":"2023-12-19T16:15:24.990894+0000","last_became_active":"2023-12-19T16:15:24.617522+0000","last_became_peered":"2023-12-19T16:15:24.617522+0000","last_unstale":"2023-12-19T16:15:24.990894+0000","last_undegraded":"2023-12-19T16:15:24.990894+0000","last_fullsized":"2023-12-19T16:15:24.990894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589828+0000","last_change":"2023-12-19T16:15:20.610470+0000","last_active":"2023-12-19T16:15:24.589828+0000","last_peered":"2023-12-19T16:15:24.589828+0000","last_clean":"2023-12-19T16:15:24.589828+0000","last_became_active":"2023-12-19T16:15:20.610140+0000","last_became_peered":"2023-12-19T16:15:20.610140+0000","last_unstale":"2023-12-19T16:15:24.589828+0000","last_undegraded":"2023-12-19T16:15:24.589828+0000","last_fullsized":"2023-12-19T16:15:24.589828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590885+0000","last_change":"2023-12-19T16:15:20.193278+0000","last_active":"2023-12-19T16:15:24.590885+0000","last_peered":"2023-12-19T16:15:24.590885+0000","last_clean":"2023-12-19T16:15:24.590885+0000","last_became_active":"2023-12-19T16:15:20.189782+0000","last_became_peered":"2023-12-19T16:15:20.189782+0000","last_unstale":"2023-12-19T16:15:24.590885+0000","last_undegraded":"2023-12-19T16:15:24.590885+0000","last_fullsized":"2023-12-19T16:15:24.590885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.993027+0000","last_change":"2023-12-19T16:15:24.609889+0000","last_active":"2023-12-19T16:15:24.993027+0000","last_peered":"2023-12-19T16:15:24.993027+0000","last_clean":"2023-12-19T16:15:24.993027+0000","last_became_active":"2023-12-19T16:15:24.609251+0000","last_became_peered":"2023-12-19T16:15:24.609251+0000","last_unstale":"2023-12-19T16:15:24.993027+0000","last_undegraded":"2023-12-19T16:15:24.993027+0000","last_fullsized":"2023-12-19T16:15:24.993027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:02.692965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612765+0000","last_change":"2023-12-19T16:15:20.600917+0000","last_active":"2023-12-19T16:15:24.612765+0000","last_peered":"2023-12-19T16:15:24.612765+0000","last_clean":"2023-12-19T16:15:24.612765+0000","last_became_active":"2023-12-19T16:15:20.600561+0000","last_became_peered":"2023-12-19T16:15:20.600561+0000","last_unstale":"2023-12-19T16:15:24.612765+0000","last_undegraded":"2023-12-19T16:15:24.612765+0000","last_fullsized":"2023-12-19T16:15:24.612765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583304+0000","last_change":"2023-12-19T16:15:20.201508+0000","last_active":"2023-12-19T16:15:24.583304+0000","last_peered":"2023-12-19T16:15:24.583304+0000","last_clean":"2023-12-19T16:15:24.583304+0000","last_became_active":"2023-12-19T16:15:20.201097+0000","last_became_peered":"2023-12-19T16:15:20.201097+0000","last_unstale":"2023-12-19T16:15:24.583304+0000","last_undegraded":"2023-12-19T16:15:24.583304+0000","last_fullsized":"2023-12-19T16:15:24.583304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992254+0000","last_change":"2023-12-19T16:15:24.608002+0000","last_active":"2023-12-19T16:15:24.992254+0000","last_peered":"2023-12-19T16:15:24.992254+0000","last_clean":"2023-12-19T16:15:24.992254+0000","last_became_active":"2023-12-19T16:15:24.606747+0000","last_became_peered":"2023-12-19T16:15:24.606747+0000","last_unstale":"2023-12-19T16:15:24.992254+0000","last_undegraded":"2023-12-19T16:15:24.992254+0000","last_fullsized":"2023-12-19T16:15:24.992254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:18.036976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588578+0000","last_change":"2023-12-19T16:15:20.587572+0000","last_active":"2023-12-19T16:15:24.588578+0000","last_peered":"2023-12-19T16:15:24.588578+0000","last_clean":"2023-12-19T16:15:24.588578+0000","last_became_active":"2023-12-19T16:15:20.581946+0000","last_became_peered":"2023-12-19T16:15:20.581946+0000","last_unstale":"2023-12-19T16:15:24.588578+0000","last_undegraded":"2023-12-19T16:15:24.588578+0000","last_fullsized":"2023-12-19T16:15:24.588578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589554+0000","last_change":"2023-12-19T16:15:20.195315+0000","last_active":"2023-12-19T16:15:24.589554+0000","last_peered":"2023-12-19T16:15:24.589554+0000","last_clean":"2023-12-19T16:15:24.589554+0000","last_became_active":"2023-12-19T16:15:20.194795+0000","last_became_peered":"2023-12-19T16:15:20.194795+0000","last_unstale":"2023-12-19T16:15:24.589554+0000","last_undegraded":"2023-12-19T16:15:24.589554+0000","last_fullsized":"2023-12-19T16:15:24.589554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.989014+0000","last_change":"2023-12-19T16:15:24.620913+0000","last_active":"2023-12-19T16:15:24.989014+0000","last_peered":"2023-12-19T16:15:24.989014+0000","last_clean":"2023-12-19T16:15:24.989014+0000","last_became_active":"2023-12-19T16:15:24.620490+0000","last_became_peered":"2023-12-19T16:15:24.620490+0000","last_unstale":"2023-12-19T16:15:24.989014+0000","last_undegraded":"2023-12-19T16:15:24.989014+0000","last_fullsized":"2023-12-19T16:15:24.989014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.613716+0000","last_change":"2023-12-19T16:15:20.607538+0000","last_active":"2023-12-19T16:15:24.613716+0000","last_peered":"2023-12-19T16:15:24.613716+0000","last_clean":"2023-12-19T16:15:24.613716+0000","last_became_active":"2023-12-19T16:15:20.607181+0000","last_became_peered":"2023-12-19T16:15:20.607181+0000","last_unstale":"2023-12-19T16:15:24.613716+0000","last_undegraded":"2023-12-19T16:15:24.613716+0000","last_fullsized":"2023-12-19T16:15:24.613716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:30.750566+0000","last_change":"2023-12-19T16:15:20.199632+0000","last_active":"2023-12-19T16:15:30.750566+0000","last_peered":"2023-12-19T16:15:30.750566+0000","last_clean":"2023-12-19T16:15:30.750566+0000","last_became_active":"2023-12-19T16:15:20.198790+0000","last_became_peered":"2023-12-19T16:15:20.198790+0000","last_unstale":"2023-12-19T16:15:30.750566+0000","last_undegraded":"2023-12-19T16:15:30.750566+0000","last_fullsized":"2023-12-19T16:15:30.750566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990866+0000","last_change":"2023-12-19T16:15:24.608145+0000","last_active":"2023-12-19T16:15:24.990866+0000","last_peered":"2023-12-19T16:15:24.990866+0000","last_clean":"2023-12-19T16:15:24.990866+0000","last_became_active":"2023-12-19T16:15:24.607175+0000","last_became_peered":"2023-12-19T16:15:24.607175+0000","last_unstale":"2023-12-19T16:15:24.990866+0000","last_undegraded":"2023-12-19T16:15:24.990866+0000","last_fullsized":"2023-12-19T16:15:24.990866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589930+0000","last_change":"2023-12-19T16:15:20.579667+0000","last_active":"2023-12-19T16:15:24.589930+0000","last_peered":"2023-12-19T16:15:24.589930+0000","last_clean":"2023-12-19T16:15:24.589930+0000","last_became_active":"2023-12-19T16:15:20.578820+0000","last_became_peered":"2023-12-19T16:15:20.578820+0000","last_unstale":"2023-12-19T16:15:24.589930+0000","last_undegraded":"2023-12-19T16:15:24.589930+0000","last_fullsized":"2023-12-19T16:15:24.589930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610063+0000","last_change":"2023-12-19T16:15:20.202464+0000","last_active":"2023-12-19T16:15:24.610063+0000","last_peered":"2023-12-19T16:15:24.610063+0000","last_clean":"2023-12-19T16:15:24.610063+0000","last_became_active":"2023-12-19T16:15:20.202201+0000","last_became_peered":"2023-12-19T16:15:20.202201+0000","last_unstale":"2023-12-19T16:15:24.610063+0000","last_undegraded":"2023-12-19T16:15:24.610063+0000","last_fullsized":"2023-12-19T16:15:24.610063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987742+0000","last_change":"2023-12-19T16:15:24.606235+0000","last_active":"2023-12-19T16:15:24.987742+0000","last_peered":"2023-12-19T16:15:24.987742+0000","last_clean":"2023-12-19T16:15:24.987742+0000","last_became_active":"2023-12-19T16:15:24.605689+0000","last_became_peered":"2023-12-19T16:15:24.605689+0000","last_unstale":"2023-12-19T16:15:24.987742+0000","last_undegraded":"2023-12-19T16:15:24.987742+0000","last_fullsized":"2023-12-19T16:15:24.987742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588108+0000","last_change":"2023-12-19T16:15:20.579264+0000","last_active":"2023-12-19T16:15:24.588108+0000","last_peered":"2023-12-19T16:15:24.588108+0000","last_clean":"2023-12-19T16:15:24.588108+0000","last_became_active":"2023-12-19T16:15:20.578990+0000","last_became_peered":"2023-12-19T16:15:20.578990+0000","last_unstale":"2023-12-19T16:15:24.588108+0000","last_undegraded":"2023-12-19T16:15:24.588108+0000","last_fullsized":"2023-12-19T16:15:24.588108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583852+0000","last_change":"2023-12-19T16:15:20.199283+0000","last_active":"2023-12-19T16:15:24.583852+0000","last_peered":"2023-12-19T16:15:24.583852+0000","last_clean":"2023-12-19T16:15:24.583852+0000","last_became_active":"2023-12-19T16:15:20.199018+0000","last_became_peered":"2023-12-19T16:15:20.199018+0000","last_unstale":"2023-12-19T16:15:24.583852+0000","last_undegraded":"2023-12-19T16:15:24.583852+0000","last_fullsized":"2023-12-19T16:15:24.583852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990899+0000","last_change":"2023-12-19T16:15:24.606050+0000","last_active":"2023-12-19T16:15:24.990899+0000","last_peered":"2023-12-19T16:15:24.990899+0000","last_clean":"2023-12-19T16:15:24.990899+0000","last_became_active":"2023-12-19T16:15:24.605031+0000","last_became_peered":"2023-12-19T16:15:24.605031+0000","last_unstale":"2023-12-19T16:15:24.990899+0000","last_undegraded":"2023-12-19T16:15:24.990899+0000","last_fullsized":"2023-12-19T16:15:24.990899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:43.598139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583755+0000","last_change":"2023-12-19T16:15:20.587105+0000","last_active":"2023-12-19T16:15:24.583755+0000","last_peered":"2023-12-19T16:15:24.583755+0000","last_clean":"2023-12-19T16:15:24.583755+0000","last_became_active":"2023-12-19T16:15:20.586267+0000","last_became_peered":"2023-12-19T16:15:20.586267+0000","last_unstale":"2023-12-19T16:15:24.583755+0000","last_undegraded":"2023-12-19T16:15:24.583755+0000","last_fullsized":"2023-12-19T16:15:24.583755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591781+0000","last_change":"2023-12-19T16:15:20.205716+0000","last_active":"2023-12-19T16:15:24.591781+0000","last_peered":"2023-12-19T16:15:24.591781+0000","last_clean":"2023-12-19T16:15:24.591781+0000","last_became_active":"2023-12-19T16:15:20.205375+0000","last_became_peered":"2023-12-19T16:15:20.205375+0000","last_unstale":"2023-12-19T16:15:24.591781+0000","last_undegraded":"2023-12-19T16:15:24.591781+0000","last_fullsized":"2023-12-19T16:15:24.591781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991323+0000","last_change":"2023-12-19T16:15:24.614651+0000","last_active":"2023-12-19T16:15:24.991323+0000","last_peered":"2023-12-19T16:15:24.991323+0000","last_clean":"2023-12-19T16:15:24.991323+0000","last_became_active":"2023-12-19T16:15:24.613651+0000","last_became_peered":"2023-12-19T16:15:24.613651+0000","last_unstale":"2023-12-19T16:15:24.991323+0000","last_undegraded":"2023-12-19T16:15:24.991323+0000","last_fullsized":"2023-12-19T16:15:24.991323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990804+0000","last_change":"2023-12-19T16:15:24.617457+0000","last_active":"2023-12-19T16:15:24.990804+0000","last_peered":"2023-12-19T16:15:24.990804+0000","last_clean":"2023-12-19T16:15:24.990804+0000","last_became_active":"2023-12-19T16:15:24.617082+0000","last_became_peered":"2023-12-19T16:15:24.617082+0000","last_unstale":"2023-12-19T16:15:24.990804+0000","last_undegraded":"2023-12-19T16:15:24.990804+0000","last_fullsized":"2023-12-19T16:15:24.990804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606089+0000","last_change":"2023-12-19T16:15:20.596047+0000","last_active":"2023-12-19T16:15:24.606089+0000","last_peered":"2023-12-19T16:15:24.606089+0000","last_clean":"2023-12-19T16:15:24.606089+0000","last_became_active":"2023-12-19T16:15:20.595801+0000","last_became_peered":"2023-12-19T16:15:20.595801+0000","last_unstale":"2023-12-19T16:15:24.606089+0000","last_undegraded":"2023-12-19T16:15:24.606089+0000","last_fullsized":"2023-12-19T16:15:24.606089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582938+0000","last_change":"2023-12-19T16:15:20.198366+0000","last_active":"2023-12-19T16:15:24.582938+0000","last_peered":"2023-12-19T16:15:24.582938+0000","last_clean":"2023-12-19T16:15:24.582938+0000","last_became_active":"2023-12-19T16:15:20.198123+0000","last_became_peered":"2023-12-19T16:15:20.198123+0000","last_unstale":"2023-12-19T16:15:24.582938+0000","last_undegraded":"2023-12-19T16:15:24.582938+0000","last_fullsized":"2023-12-19T16:15:24.582938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992336+0000","last_change":"2023-12-19T16:15:24.613114+0000","last_active":"2023-12-19T16:15:24.992336+0000","last_peered":"2023-12-19T16:15:24.992336+0000","last_clean":"2023-12-19T16:15:24.992336+0000","last_became_active":"2023-12-19T16:15:24.612703+0000","last_became_peered":"2023-12-19T16:15:24.612703+0000","last_unstale":"2023-12-19T16:15:24.992336+0000","last_undegraded":"2023-12-19T16:15:24.992336+0000","last_fullsized":"2023-12-19T16:15:24.992336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580525+0000","last_change":"2023-12-19T16:15:20.578523+0000","last_active":"2023-12-19T16:15:24.580525+0000","last_peered":"2023-12-19T16:15:24.580525+0000","last_clean":"2023-12-19T16:15:24.580525+0000","last_became_active":"2023-12-19T16:15:20.578185+0000","last_became_peered":"2023-12-19T16:15:20.578185+0000","last_unstale":"2023-12-19T16:15:24.580525+0000","last_undegraded":"2023-12-19T16:15:24.580525+0000","last_fullsized":"2023-12-19T16:15:24.580525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582035+0000","last_change":"2023-12-19T16:15:20.197343+0000","last_active":"2023-12-19T16:15:24.582035+0000","last_peered":"2023-12-19T16:15:24.582035+0000","last_clean":"2023-12-19T16:15:24.582035+0000","last_became_active":"2023-12-19T16:15:20.196946+0000","last_became_peered":"2023-12-19T16:15:20.196946+0000","last_unstale":"2023-12-19T16:15:24.582035+0000","last_undegraded":"2023-12-19T16:15:24.582035+0000","last_fullsized":"2023-12-19T16:15:24.582035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590498+0000","last_change":"2023-12-19T16:15:20.196588+0000","last_active":"2023-12-19T16:15:24.590498+0000","last_peered":"2023-12-19T16:15:24.590498+0000","last_clean":"2023-12-19T16:15:24.590498+0000","last_became_active":"2023-12-19T16:15:20.196249+0000","last_became_peered":"2023-12-19T16:15:20.196249+0000","last_unstale":"2023-12-19T16:15:24.590498+0000","last_undegraded":"2023-12-19T16:15:24.590498+0000","last_fullsized":"2023-12-19T16:15:24.590498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589480+0000","last_change":"2023-12-19T16:15:20.578312+0000","last_active":"2023-12-19T16:15:24.589480+0000","last_peered":"2023-12-19T16:15:24.589480+0000","last_clean":"2023-12-19T16:15:24.589480+0000","last_became_active":"2023-12-19T16:15:20.578056+0000","last_became_peered":"2023-12-19T16:15:20.578056+0000","last_unstale":"2023-12-19T16:15:24.589480+0000","last_undegraded":"2023-12-19T16:15:24.589480+0000","last_fullsized":"2023-12-19T16:15:24.589480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.985598+0000","last_change":"2023-12-19T16:15:24.614365+0000","last_active":"2023-12-19T16:15:24.985598+0000","last_peered":"2023-12-19T16:15:24.985598+0000","last_clean":"2023-12-19T16:15:24.985598+0000","last_became_active":"2023-12-19T16:15:24.613978+0000","last_became_peered":"2023-12-19T16:15:24.613978+0000","last_unstale":"2023-12-19T16:15:24.985598+0000","last_undegraded":"2023-12-19T16:15:24.985598+0000","last_fullsized":"2023-12-19T16:15:24.985598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:33.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580327+0000","last_change":"2023-12-19T16:15:20.191767+0000","last_active":"2023-12-19T16:15:24.580327+0000","last_peered":"2023-12-19T16:15:24.580327+0000","last_clean":"2023-12-19T16:15:24.580327+0000","last_became_active":"2023-12-19T16:15:20.191391+0000","last_became_peered":"2023-12-19T16:15:20.191391+0000","last_unstale":"2023-12-19T16:15:24.580327+0000","last_undegraded":"2023-12-19T16:15:24.580327+0000","last_fullsized":"2023-12-19T16:15:24.580327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587620+0000","last_change":"2023-12-19T16:15:20.593654+0000","last_active":"2023-12-19T16:15:24.587620+0000","last_peered":"2023-12-19T16:15:24.587620+0000","last_clean":"2023-12-19T16:15:24.587620+0000","last_became_active":"2023-12-19T16:15:20.593384+0000","last_became_peered":"2023-12-19T16:15:20.593384+0000","last_unstale":"2023-12-19T16:15:24.587620+0000","last_undegraded":"2023-12-19T16:15:24.587620+0000","last_fullsized":"2023-12-19T16:15:24.587620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992753+0000","last_change":"2023-12-19T16:15:24.608692+0000","last_active":"2023-12-19T16:15:24.992753+0000","last_peered":"2023-12-19T16:15:24.992753+0000","last_clean":"2023-12-19T16:15:24.992753+0000","last_became_active":"2023-12-19T16:15:24.608307+0000","last_became_peered":"2023-12-19T16:15:24.608307+0000","last_unstale":"2023-12-19T16:15:24.992753+0000","last_undegraded":"2023-12-19T16:15:24.992753+0000","last_fullsized":"2023-12-19T16:15:24.992753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:21:37.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589734+0000","last_change":"2023-12-19T16:15:20.608095+0000","last_active":"2023-12-19T16:15:24.589734+0000","last_peered":"2023-12-19T16:15:24.589734+0000","last_clean":"2023-12-19T16:15:24.589734+0000","last_became_active":"2023-12-19T16:15:20.604431+0000","last_became_peered":"2023-12-19T16:15:20.604431+0000","last_unstale":"2023-12-19T16:15:24.589734+0000","last_undegraded":"2023-12-19T16:15:24.589734+0000","last_fullsized":"2023-12-19T16:15:24.589734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586488+0000","last_change":"2023-12-19T16:15:20.587765+0000","last_active":"2023-12-19T16:15:24.586488+0000","last_peered":"2023-12-19T16:15:24.586488+0000","last_clean":"2023-12-19T16:15:24.586488+0000","last_became_active":"2023-12-19T16:15:20.587480+0000","last_became_peered":"2023-12-19T16:15:20.587480+0000","last_unstale":"2023-12-19T16:15:24.586488+0000","last_undegraded":"2023-12-19T16:15:24.586488+0000","last_fullsized":"2023-12-19T16:15:24.586488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583224+0000","last_change":"2023-12-19T16:15:20.590224+0000","last_active":"2023-12-19T16:15:24.583224+0000","last_peered":"2023-12-19T16:15:24.583224+0000","last_clean":"2023-12-19T16:15:24.583224+0000","last_became_active":"2023-12-19T16:15:20.589817+0000","last_became_peered":"2023-12-19T16:15:20.589817+0000","last_unstale":"2023-12-19T16:15:24.583224+0000","last_undegraded":"2023-12-19T16:15:24.583224+0000","last_fullsized":"2023-12-19T16:15:24.583224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589415+0000","last_change":"2023-12-19T16:15:20.584816+0000","last_active":"2023-12-19T16:15:24.589415+0000","last_peered":"2023-12-19T16:15:24.589415+0000","last_clean":"2023-12-19T16:15:24.589415+0000","last_became_active":"2023-12-19T16:15:20.584532+0000","last_became_peered":"2023-12-19T16:15:20.584532+0000","last_unstale":"2023-12-19T16:15:24.589415+0000","last_undegraded":"2023-12-19T16:15:24.589415+0000","last_fullsized":"2023-12-19T16:15:24.589415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580387+0000","last_change":"2023-12-19T16:15:20.583294+0000","last_active":"2023-12-19T16:15:24.580387+0000","last_peered":"2023-12-19T16:15:24.580387+0000","last_clean":"2023-12-19T16:15:24.580387+0000","last_became_active":"2023-12-19T16:15:20.583080+0000","last_became_peered":"2023-12-19T16:15:20.583080+0000","last_unstale":"2023-12-19T16:15:24.580387+0000","last_undegraded":"2023-12-19T16:15:24.580387+0000","last_fullsized":"2023-12-19T16:15:24.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609991+0000","last_change":"2023-12-19T16:15:20.604537+0000","last_active":"2023-12-19T16:15:24.609991+0000","last_peered":"2023-12-19T16:15:24.609991+0000","last_clean":"2023-12-19T16:15:24.609991+0000","last_became_active":"2023-12-19T16:15:20.604292+0000","last_became_peered":"2023-12-19T16:15:20.604292+0000","last_unstale":"2023-12-19T16:15:24.609991+0000","last_undegraded":"2023-12-19T16:15:24.609991+0000","last_fullsized":"2023-12-19T16:15:24.609991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592846+0000","last_change":"2023-12-19T16:15:20.586983+0000","last_active":"2023-12-19T16:15:24.592846+0000","last_peered":"2023-12-19T16:15:24.592846+0000","last_clean":"2023-12-19T16:15:24.592846+0000","last_became_active":"2023-12-19T16:15:20.586747+0000","last_became_peered":"2023-12-19T16:15:20.586747+0000","last_unstale":"2023-12-19T16:15:24.592846+0000","last_undegraded":"2023-12-19T16:15:24.592846+0000","last_fullsized":"2023-12-19T16:15:24.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580756+0000","last_change":"2023-12-19T16:15:20.600781+0000","last_active":"2023-12-19T16:15:24.580756+0000","last_peered":"2023-12-19T16:15:24.580756+0000","last_clean":"2023-12-19T16:15:24.580756+0000","last_became_active":"2023-12-19T16:15:20.600499+0000","last_became_peered":"2023-12-19T16:15:20.600499+0000","last_unstale":"2023-12-19T16:15:24.580756+0000","last_undegraded":"2023-12-19T16:15:24.580756+0000","last_fullsized":"2023-12-19T16:15:24.580756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582940+0000","last_change":"2023-12-19T16:15:20.590492+0000","last_active":"2023-12-19T16:15:24.582940+0000","last_peered":"2023-12-19T16:15:24.582940+0000","last_clean":"2023-12-19T16:15:24.582940+0000","last_became_active":"2023-12-19T16:15:20.590230+0000","last_became_peered":"2023-12-19T16:15:20.590230+0000","last_unstale":"2023-12-19T16:15:24.582940+0000","last_undegraded":"2023-12-19T16:15:24.582940+0000","last_fullsized":"2023-12-19T16:15:24.582940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581284+0000","last_change":"2023-12-19T16:15:20.582285+0000","last_active":"2023-12-19T16:15:24.581284+0000","last_peered":"2023-12-19T16:15:24.581284+0000","last_clean":"2023-12-19T16:15:24.581284+0000","last_became_active":"2023-12-19T16:15:20.581886+0000","last_became_peered":"2023-12-19T16:15:20.581886+0000","last_unstale":"2023-12-19T16:15:24.581284+0000","last_undegraded":"2023-12-19T16:15:24.581284+0000","last_fullsized":"2023-12-19T16:15:24.581284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583151+0000","last_change":"2023-12-19T16:15:20.580662+0000","last_active":"2023-12-19T16:15:24.583151+0000","last_peered":"2023-12-19T16:15:24.583151+0000","last_clean":"2023-12-19T16:15:24.583151+0000","last_became_active":"2023-12-19T16:15:20.580373+0000","last_became_peered":"2023-12-19T16:15:20.580373+0000","last_unstale":"2023-12-19T16:15:24.583151+0000","last_undegraded":"2023-12-19T16:15:24.583151+0000","last_fullsized":"2023-12-19T16:15:24.583151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589332+0000","last_change":"2023-12-19T16:15:20.583886+0000","last_active":"2023-12-19T16:15:24.589332+0000","last_peered":"2023-12-19T16:15:24.589332+0000","last_clean":"2023-12-19T16:15:24.589332+0000","last_became_active":"2023-12-19T16:15:20.583709+0000","last_became_peered":"2023-12-19T16:15:20.583709+0000","last_unstale":"2023-12-19T16:15:24.589332+0000","last_undegraded":"2023-12-19T16:15:24.589332+0000","last_fullsized":"2023-12-19T16:15:24.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591040+0000","last_change":"2023-12-19T16:15:20.611237+0000","last_active":"2023-12-19T16:15:24.591040+0000","last_peered":"2023-12-19T16:15:24.591040+0000","last_clean":"2023-12-19T16:15:24.591040+0000","last_became_active":"2023-12-19T16:15:20.610946+0000","last_became_peered":"2023-12-19T16:15:20.610946+0000","last_unstale":"2023-12-19T16:15:24.591040+0000","last_undegraded":"2023-12-19T16:15:24.591040+0000","last_fullsized":"2023-12-19T16:15:24.591040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616066+0000","last_change":"2023-12-19T16:15:20.602585+0000","last_active":"2023-12-19T16:15:24.616066+0000","last_peered":"2023-12-19T16:15:24.616066+0000","last_clean":"2023-12-19T16:15:24.616066+0000","last_became_active":"2023-12-19T16:15:20.602278+0000","last_became_peered":"2023-12-19T16:15:20.602278+0000","last_unstale":"2023-12-19T16:15:24.616066+0000","last_undegraded":"2023-12-19T16:15:24.616066+0000","last_fullsized":"2023-12-19T16:15:24.616066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586325+0000","last_change":"2023-12-19T16:15:20.602226+0000","last_active":"2023-12-19T16:15:24.586325+0000","last_peered":"2023-12-19T16:15:24.586325+0000","last_clean":"2023-12-19T16:15:24.586325+0000","last_became_active":"2023-12-19T16:15:20.601928+0000","last_became_peered":"2023-12-19T16:15:20.601928+0000","last_unstale":"2023-12-19T16:15:24.586325+0000","last_undegraded":"2023-12-19T16:15:24.586325+0000","last_fullsized":"2023-12-19T16:15:24.586325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.584077+0000","last_change":"2023-12-19T16:15:20.584639+0000","last_active":"2023-12-19T16:15:24.584077+0000","last_peered":"2023-12-19T16:15:24.584077+0000","last_clean":"2023-12-19T16:15:24.584077+0000","last_became_active":"2023-12-19T16:15:20.584426+0000","last_became_peered":"2023-12-19T16:15:20.584426+0000","last_unstale":"2023-12-19T16:15:24.584077+0000","last_undegraded":"2023-12-19T16:15:24.584077+0000","last_fullsized":"2023-12-19T16:15:24.584077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582785+0000","last_change":"2023-12-19T16:15:20.575948+0000","last_active":"2023-12-19T16:15:24.582785+0000","last_peered":"2023-12-19T16:15:24.582785+0000","last_clean":"2023-12-19T16:15:24.582785+0000","last_became_active":"2023-12-19T16:15:20.573675+0000","last_became_peered":"2023-12-19T16:15:20.573675+0000","last_unstale":"2023-12-19T16:15:24.582785+0000","last_undegraded":"2023-12-19T16:15:24.582785+0000","last_fullsized":"2023-12-19T16:15:24.582785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:23.787433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607444+0000","last_change":"2023-12-19T16:15:20.588200+0000","last_active":"2023-12-19T16:15:24.607444+0000","last_peered":"2023-12-19T16:15:24.607444+0000","last_clean":"2023-12-19T16:15:24.607444+0000","last_became_active":"2023-12-19T16:15:20.587984+0000","last_became_peered":"2023-12-19T16:15:20.587984+0000","last_unstale":"2023-12-19T16:15:24.607444+0000","last_undegraded":"2023-12-19T16:15:24.607444+0000","last_fullsized":"2023-12-19T16:15:24.607444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588501+0000","last_change":"2023-12-19T16:15:20.588750+0000","last_active":"2023-12-19T16:15:24.588501+0000","last_peered":"2023-12-19T16:15:24.588501+0000","last_clean":"2023-12-19T16:15:24.588501+0000","last_became_active":"2023-12-19T16:15:20.588398+0000","last_became_peered":"2023-12-19T16:15:20.588398+0000","last_unstale":"2023-12-19T16:15:24.588501+0000","last_undegraded":"2023-12-19T16:15:24.588501+0000","last_fullsized":"2023-12-19T16:15:24.588501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580194+0000","last_change":"2023-12-19T16:15:20.604284+0000","last_active":"2023-12-19T16:15:24.580194+0000","last_peered":"2023-12-19T16:15:24.580194+0000","last_clean":"2023-12-19T16:15:24.580194+0000","last_became_active":"2023-12-19T16:15:20.603889+0000","last_became_peered":"2023-12-19T16:15:20.603889+0000","last_unstale":"2023-12-19T16:15:24.580194+0000","last_undegraded":"2023-12-19T16:15:24.580194+0000","last_fullsized":"2023-12-19T16:15:24.580194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589849+0000","last_change":"2023-12-19T16:15:20.611693+0000","last_active":"2023-12-19T16:15:24.589849+0000","last_peered":"2023-12-19T16:15:24.589849+0000","last_clean":"2023-12-19T16:15:24.589849+0000","last_became_active":"2023-12-19T16:15:20.611287+0000","last_became_peered":"2023-12-19T16:15:20.611287+0000","last_unstale":"2023-12-19T16:15:24.589849+0000","last_undegraded":"2023-12-19T16:15:24.589849+0000","last_fullsized":"2023-12-19T16:15:24.589849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592587+0000","last_change":"2023-12-19T16:15:20.603377+0000","last_active":"2023-12-19T16:15:24.592587+0000","last_peered":"2023-12-19T16:15:24.592587+0000","last_clean":"2023-12-19T16:15:24.592587+0000","last_became_active":"2023-12-19T16:15:20.603157+0000","last_became_peered":"2023-12-19T16:15:20.603157+0000","last_unstale":"2023-12-19T16:15:24.592587+0000","last_undegraded":"2023-12-19T16:15:24.592587+0000","last_fullsized":"2023-12-19T16:15:24.592587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592770+0000","last_change":"2023-12-19T16:15:20.599480+0000","last_active":"2023-12-19T16:15:24.592770+0000","last_peered":"2023-12-19T16:15:24.592770+0000","last_clean":"2023-12-19T16:15:24.592770+0000","last_became_active":"2023-12-19T16:15:20.599204+0000","last_became_peered":"2023-12-19T16:15:20.599204+0000","last_unstale":"2023-12-19T16:15:24.592770+0000","last_undegraded":"2023-12-19T16:15:24.592770+0000","last_fullsized":"2023-12-19T16:15:24.592770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616342+0000","last_change":"2023-12-19T16:15:20.609122+0000","last_active":"2023-12-19T16:15:24.616342+0000","last_peered":"2023-12-19T16:15:24.616342+0000","last_clean":"2023-12-19T16:15:24.616342+0000","last_became_active":"2023-12-19T16:15:20.608840+0000","last_became_peered":"2023-12-19T16:15:20.608840+0000","last_unstale":"2023-12-19T16:15:24.616342+0000","last_undegraded":"2023-12-19T16:15:24.616342+0000","last_fullsized":"2023-12-19T16:15:24.616342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:01.062348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579734+0000","last_change":"2023-12-19T16:15:20.589707+0000","last_active":"2023-12-19T16:15:24.579734+0000","last_peered":"2023-12-19T16:15:24.579734+0000","last_clean":"2023-12-19T16:15:24.579734+0000","last_became_active":"2023-12-19T16:15:20.589430+0000","last_became_peered":"2023-12-19T16:15:20.589430+0000","last_unstale":"2023-12-19T16:15:24.579734+0000","last_undegraded":"2023-12-19T16:15:24.579734+0000","last_fullsized":"2023-12-19T16:15:24.579734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611868+0000","last_change":"2023-12-19T16:15:20.594142+0000","last_active":"2023-12-19T16:15:24.611868+0000","last_peered":"2023-12-19T16:15:24.611868+0000","last_clean":"2023-12-19T16:15:24.611868+0000","last_became_active":"2023-12-19T16:15:20.593842+0000","last_became_peered":"2023-12-19T16:15:20.593842+0000","last_unstale":"2023-12-19T16:15:24.611868+0000","last_undegraded":"2023-12-19T16:15:24.611868+0000","last_fullsized":"2023-12-19T16:15:24.611868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583063+0000","last_change":"2023-12-19T16:15:20.574706+0000","last_active":"2023-12-19T16:15:24.583063+0000","last_peered":"2023-12-19T16:15:24.583063+0000","last_clean":"2023-12-19T16:15:24.583063+0000","last_became_active":"2023-12-19T16:15:20.574376+0000","last_became_peered":"2023-12-19T16:15:20.574376+0000","last_unstale":"2023-12-19T16:15:24.583063+0000","last_undegraded":"2023-12-19T16:15:24.583063+0000","last_fullsized":"2023-12-19T16:15:24.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612667+0000","last_change":"2023-12-19T16:15:20.605920+0000","last_active":"2023-12-19T16:15:24.612667+0000","last_peered":"2023-12-19T16:15:24.612667+0000","last_clean":"2023-12-19T16:15:24.612667+0000","last_became_active":"2023-12-19T16:15:20.605610+0000","last_became_peered":"2023-12-19T16:15:20.605610+0000","last_unstale":"2023-12-19T16:15:24.612667+0000","last_undegraded":"2023-12-19T16:15:24.612667+0000","last_fullsized":"2023-12-19T16:15:24.612667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581912+0000","last_change":"2023-12-19T16:15:20.594793+0000","last_active":"2023-12-19T16:15:24.581912+0000","last_peered":"2023-12-19T16:15:24.581912+0000","last_clean":"2023-12-19T16:15:24.581912+0000","last_became_active":"2023-12-19T16:15:20.593463+0000","last_became_peered":"2023-12-19T16:15:20.593463+0000","last_unstale":"2023-12-19T16:15:24.581912+0000","last_undegraded":"2023-12-19T16:15:24.581912+0000","last_fullsized":"2023-12-19T16:15:24.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588263+0000","last_change":"2023-12-19T16:15:20.590564+0000","last_active":"2023-12-19T16:15:24.588263+0000","last_peered":"2023-12-19T16:15:24.588263+0000","last_clean":"2023-12-19T16:15:24.588263+0000","last_became_active":"2023-12-19T16:15:20.590320+0000","last_became_peered":"2023-12-19T16:15:20.590320+0000","last_unstale":"2023-12-19T16:15:24.588263+0000","last_undegraded":"2023-12-19T16:15:24.588263+0000","last_fullsized":"2023-12-19T16:15:24.588263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609610+0000","last_change":"2023-12-19T16:15:20.603717+0000","last_active":"2023-12-19T16:15:24.609610+0000","last_peered":"2023-12-19T16:15:24.609610+0000","last_clean":"2023-12-19T16:15:24.609610+0000","last_became_active":"2023-12-19T16:15:20.603426+0000","last_became_peered":"2023-12-19T16:15:20.603426+0000","last_unstale":"2023-12-19T16:15:24.609610+0000","last_undegraded":"2023-12-19T16:15:24.609610+0000","last_fullsized":"2023-12-19T16:15:24.609610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616243+0000","last_change":"2023-12-19T16:15:20.614781+0000","last_active":"2023-12-19T16:15:24.616243+0000","last_peered":"2023-12-19T16:15:24.616243+0000","last_clean":"2023-12-19T16:15:24.616243+0000","last_became_active":"2023-12-19T16:15:20.614271+0000","last_became_peered":"2023-12-19T16:15:20.614271+0000","last_unstale":"2023-12-19T16:15:24.616243+0000","last_undegraded":"2023-12-19T16:15:24.616243+0000","last_fullsized":"2023-12-19T16:15:24.616243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:44.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:44.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 Processor -- start 2023-12-19T16:15:44.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 -- start start 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fbc0ae040 0x7f2fbc06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 0x7f2fbc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0cccf0 con 0x7f2fbc06d170 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0ae420 con 0x7f2fbc0ae040 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fc136d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0ccf90 con 0x7f2fbc0ce460 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fb3fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2fbc06d170 0x7f2fbc0cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59442/0 (socket says 172.21.15.119:59442) 2023-12-19T16:15:44.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fb3fff640 1 -- 172.21.15.119:0/2205269405 learned_addr learned my addr 172.21.15.119:0/2205269405 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:44.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fbb7fe640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 0x7f2fbc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/2205269405 >> v2:172.21.15.143:3300/0 conn(0x7f2fbc0ae040 0x7f2fbc06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358176998 0 0) 0x7f2fbc0cccf0 con 0x7f2fbc06d170 2023-12-19T16:15:44.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa8003530 con 0x7f2fbc06d170 2023-12-19T16:15:44.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192395936 0 0) 0x7f2fa8003530 con 0x7f2fbc06d170 2023-12-19T16:15:44.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 msgr2=0x7f2fbc0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 0x7f2fbc0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 >> v2:172.21.15.143:3300/0 conn(0x7f2fbc0ae040 msgr2=0x7f2fbc06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 --2- 172.21.15.119:0/2205269405 >> v2:172.21.15.143:3300/0 conn(0x7f2fbc0ae040 0x7f2fbc06cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0cd270 con 0x7f2fbc06d170 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f2fa40016a0 con 0x7f2fbc06d170 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 >> v1:172.21.15.119:6789/0 conn(0x7f2fbc06d170 legacy=0x7f2fbc0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa8003980 0x7f2fa8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa80047d0 0x7f2fa8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 0x7f2fa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0ae420 con 0x7f2fa8003980 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0ccf90 con 0x7f2fa80047d0 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa800b990 con 0x7f2fbc0ce460 2023-12-19T16:15:44.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa8003980 0x7f2fa8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fb3fff640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa80047d0 0x7f2fa8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.443+0000 7f2fbb7fe640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 0x7f2fa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbaffd640 1 -- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 msgr2=0x7f2fa8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0ce460 0x7f2fa8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbaffd640 1 -- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa80047d0 msgr2=0x7f2fa8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa80047d0 0x7f2fa8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbaffd640 1 -- 172.21.15.119:0/2205269405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8003530 con 0x7f2fa8003980 2023-12-19T16:15:44.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa8003980 0x7f2fa8003da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ae0 tx=0x7f2fac01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3938dd06a3d40c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0a6470 con 0x7f2fa8003980 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0a65d0 con 0x7f2fa8003980 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fba7fc640 1 -- 172.21.15.119:0/2205269405 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0a6980 con 0x7f2fa8003980 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fc136d640 1 -- 172.21.15.119:0/2205269405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa8003980 msgr2=0x7f2fa8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fc136d640 1 --2- 172.21.15.119:0/2205269405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fa8003980 0x7f2fa8003da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ae0 tx=0x7f2fac01ca60 comp rx=0 tx=0).stop 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.447+0000 7f2fbb7fe640 1 -- 172.21.15.119:0/2205269405 reap_dead start 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- 172.21.15.119:0/2205269405 shutdown_connections 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- 172.21.15.119:0/2205269405 >> 172.21.15.119:0/2205269405 conn(0x7f2fbc0cb610 msgr2=0x7f2fbc0cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- 172.21.15.119:0/2205269405 shutdown_connections 2023-12-19T16:15:44.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- 172.21.15.119:0/2205269405 wait complete. 2023-12-19T16:15:44.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 Processor -- start 2023-12-19T16:15:44.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- start start 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa8003980 0x7f2fbc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0aca40 0x7f2fbc1f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 0x7f2fbc1f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c6320 con 0x7f2fbc0acec0 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1f5fd0 con 0x7f2fa8003980 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fc136d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c8780 con 0x7f2fbc0aca40 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 0x7f2fbc1f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 0x7f2fbc1f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56536/0 (socket says 172.21.15.119:56536) 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 -- 172.21.15.119:0/5662837 learned_addr learned my addr 172.21.15.119:0/5662837 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:44.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa8003980 0x7f2fbc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fb3fff640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0aca40 0x7f2fbc1f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 -- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0aca40 msgr2=0x7f2fbc1f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0aca40 0x7f2fbc1f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 -- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa8003980 msgr2=0x7f2fbc1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa8003980 0x7f2fbc1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fbb7fe640 1 -- 172.21.15.119:0/5662837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0c8a60 con 0x7f2fbc0acec0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.451+0000 7f2fb3fff640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0aca40 0x7f2fbc1f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fbb7fe640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 0x7f2fbc1f5660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0cca00 tx=0x7f2fb400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400e040 con 0x7f2fbc0acec0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb400f040 con 0x7f2fbc0acec0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4015670 con 0x7f2fbc0acec0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0c5c60 con 0x7f2fbc0acec0 2023-12-19T16:15:44.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0c8430 con 0x7f2fbc0acec0 2023-12-19T16:15:44.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc0c6460 con 0x7f2fbc0acec0 2023-12-19T16:15:44.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fb40157d0 con 0x7f2fbc0acec0 2023-12-19T16:15:44.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fb37fe640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f9c065a60 0x7f2f9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fb4083c80 con 0x7f2fbc0acec0 2023-12-19T16:15:44.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.455+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f9c065a60 0x7f2f9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.459+0000 7f2fbaffd640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f9c065a60 0x7f2f9c067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0ad000 tx=0x7f2fac0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.459+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fbc0c6460 con 0x7f2fbc0acec0 2023-12-19T16:15:44.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.611+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fbc0c8c20 con 0x7f2f9c065a60 2023-12-19T16:15:44.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.623+0000 7f2fb37fe640 1 -- 172.21.15.119:0/5662837 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345256 (secure 0 0 0) 0x7f2fbc0c8c20 con 0x7f2f9c065a60 2023-12-19T16:15:44.629 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:44.631 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f9c065a60 msgr2=0x7f2f9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f9c065a60 0x7f2f9c067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0ad000 tx=0x7f2fac0046d0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 msgr2=0x7f2fbc1f5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 0x7f2fbc1f5660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0cca00 tx=0x7f2fb400f580 comp rx=0 tx=0).stop 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 shutdown_connections 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f9c065a60 0x7f2f9c067f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fbc0acec0 0x7f2fbc1f5660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fbc0aca40 0x7f2fbc1f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 --2- 172.21.15.119:0/5662837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fa8003980 0x7f2fbc1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 >> 172.21.15.119:0/5662837 conn(0x7f2fbc0cb610 msgr2=0x7f2fbc069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 shutdown_connections 2023-12-19T16:15:44.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.627+0000 7f2fc136d640 1 -- 172.21.15.119:0/5662837 wait complete. 2023-12-19T16:15:44.649 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-19T16:15:44.452839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002599"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588192+0000","last_change":"2023-12-19T16:15:20.196445+0000","last_active":"2023-12-19T16:15:24.588192+0000","last_peered":"2023-12-19T16:15:24.588192+0000","last_clean":"2023-12-19T16:15:24.588192+0000","last_became_active":"2023-12-19T16:15:20.196170+0000","last_became_peered":"2023-12-19T16:15:20.196170+0000","last_unstale":"2023-12-19T16:15:24.588192+0000","last_undegraded":"2023-12-19T16:15:24.588192+0000","last_fullsized":"2023-12-19T16:15:24.588192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:39.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580441+0000","last_change":"2023-12-19T16:15:20.606495+0000","last_active":"2023-12-19T16:15:24.580441+0000","last_peered":"2023-12-19T16:15:24.580441+0000","last_clean":"2023-12-19T16:15:24.580441+0000","last_became_active":"2023-12-19T16:15:20.605146+0000","last_became_peered":"2023-12-19T16:15:20.605146+0000","last_unstale":"2023-12-19T16:15:24.580441+0000","last_undegraded":"2023-12-19T16:15:24.580441+0000","last_fullsized":"2023-12-19T16:15:24.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991230+0000","last_change":"2023-12-19T16:15:24.614967+0000","last_active":"2023-12-19T16:15:24.991230+0000","last_peered":"2023-12-19T16:15:24.991230+0000","last_clean":"2023-12-19T16:15:24.991230+0000","last_became_active":"2023-12-19T16:15:24.614174+0000","last_became_peered":"2023-12-19T16:15:24.614174+0000","last_unstale":"2023-12-19T16:15:24.991230+0000","last_undegraded":"2023-12-19T16:15:24.991230+0000","last_fullsized":"2023-12-19T16:15:24.991230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580626+0000","last_change":"2023-12-19T16:15:20.202976+0000","last_active":"2023-12-19T16:15:24.580626+0000","last_peered":"2023-12-19T16:15:24.580626+0000","last_clean":"2023-12-19T16:15:24.580626+0000","last_became_active":"2023-12-19T16:15:20.202692+0000","last_became_peered":"2023-12-19T16:15:20.202692+0000","last_unstale":"2023-12-19T16:15:24.580626+0000","last_undegraded":"2023-12-19T16:15:24.580626+0000","last_fullsized":"2023-12-19T16:15:24.580626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587899+0000","last_change":"2023-12-19T16:15:20.579266+0000","last_active":"2023-12-19T16:15:24.587899+0000","last_peered":"2023-12-19T16:15:24.587899+0000","last_clean":"2023-12-19T16:15:24.587899+0000","last_became_active":"2023-12-19T16:15:20.579039+0000","last_became_peered":"2023-12-19T16:15:20.579039+0000","last_unstale":"2023-12-19T16:15:24.587899+0000","last_undegraded":"2023-12-19T16:15:24.587899+0000","last_fullsized":"2023-12-19T16:15:24.587899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987177+0000","last_change":"2023-12-19T16:15:24.618815+0000","last_active":"2023-12-19T16:15:24.987177+0000","last_peered":"2023-12-19T16:15:24.987177+0000","last_clean":"2023-12-19T16:15:24.987177+0000","last_became_active":"2023-12-19T16:15:24.618408+0000","last_became_peered":"2023-12-19T16:15:24.618408+0000","last_unstale":"2023-12-19T16:15:24.987177+0000","last_undegraded":"2023-12-19T16:15:24.987177+0000","last_fullsized":"2023-12-19T16:15:24.987177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.615964+0000","last_change":"2023-12-19T16:15:20.206941+0000","last_active":"2023-12-19T16:15:24.615964+0000","last_peered":"2023-12-19T16:15:24.615964+0000","last_clean":"2023-12-19T16:15:24.615964+0000","last_became_active":"2023-12-19T16:15:20.206623+0000","last_became_peered":"2023-12-19T16:15:20.206623+0000","last_unstale":"2023-12-19T16:15:24.615964+0000","last_undegraded":"2023-12-19T16:15:24.615964+0000","last_fullsized":"2023-12-19T16:15:24.615964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:42.922649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582028+0000","last_change":"2023-12-19T16:15:20.576757+0000","last_active":"2023-12-19T16:15:24.582028+0000","last_peered":"2023-12-19T16:15:24.582028+0000","last_clean":"2023-12-19T16:15:24.582028+0000","last_became_active":"2023-12-19T16:15:20.576280+0000","last_became_peered":"2023-12-19T16:15:20.576280+0000","last_unstale":"2023-12-19T16:15:24.582028+0000","last_undegraded":"2023-12-19T16:15:24.582028+0000","last_fullsized":"2023-12-19T16:15:24.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987587+0000","last_change":"2023-12-19T16:15:24.618996+0000","last_active":"2023-12-19T16:15:24.987587+0000","last_peered":"2023-12-19T16:15:24.987587+0000","last_clean":"2023-12-19T16:15:24.987587+0000","last_became_active":"2023-12-19T16:15:24.613588+0000","last_became_peered":"2023-12-19T16:15:24.613588+0000","last_unstale":"2023-12-19T16:15:24.987587+0000","last_undegraded":"2023-12-19T16:15:24.987587+0000","last_fullsized":"2023-12-19T16:15:24.987587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:20.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612643+0000","last_change":"2023-12-19T16:15:20.209759+0000","last_active":"2023-12-19T16:15:24.612643+0000","last_peered":"2023-12-19T16:15:24.612643+0000","last_clean":"2023-12-19T16:15:24.612643+0000","last_became_active":"2023-12-19T16:15:20.209441+0000","last_became_peered":"2023-12-19T16:15:20.209441+0000","last_unstale":"2023-12-19T16:15:24.612643+0000","last_undegraded":"2023-12-19T16:15:24.612643+0000","last_fullsized":"2023-12-19T16:15:24.612643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:45.528168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583519+0000","last_change":"2023-12-19T16:15:20.576676+0000","last_active":"2023-12-19T16:15:24.583519+0000","last_peered":"2023-12-19T16:15:24.583519+0000","last_clean":"2023-12-19T16:15:24.583519+0000","last_became_active":"2023-12-19T16:15:20.576400+0000","last_became_peered":"2023-12-19T16:15:20.576400+0000","last_unstale":"2023-12-19T16:15:24.583519+0000","last_undegraded":"2023-12-19T16:15:24.583519+0000","last_fullsized":"2023-12-19T16:15:24.583519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987579+0000","last_change":"2023-12-19T16:15:24.619492+0000","last_active":"2023-12-19T16:15:24.987579+0000","last_peered":"2023-12-19T16:15:24.987579+0000","last_clean":"2023-12-19T16:15:24.987579+0000","last_became_active":"2023-12-19T16:15:24.618455+0000","last_became_peered":"2023-12-19T16:15:24.618455+0000","last_unstale":"2023-12-19T16:15:24.987579+0000","last_undegraded":"2023-12-19T16:15:24.987579+0000","last_fullsized":"2023-12-19T16:15:24.987579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:27.195791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590403+0000","last_change":"2023-12-19T16:15:20.598403+0000","last_active":"2023-12-19T16:15:24.590403+0000","last_peered":"2023-12-19T16:15:24.590403+0000","last_clean":"2023-12-19T16:15:24.590403+0000","last_became_active":"2023-12-19T16:15:20.598090+0000","last_became_peered":"2023-12-19T16:15:20.598090+0000","last_unstale":"2023-12-19T16:15:24.590403+0000","last_undegraded":"2023-12-19T16:15:24.590403+0000","last_fullsized":"2023-12-19T16:15:24.590403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612925+0000","last_change":"2023-12-19T16:15:20.202909+0000","last_active":"2023-12-19T16:15:24.612925+0000","last_peered":"2023-12-19T16:15:24.612925+0000","last_clean":"2023-12-19T16:15:24.612925+0000","last_became_active":"2023-12-19T16:15:20.202536+0000","last_became_peered":"2023-12-19T16:15:20.202536+0000","last_unstale":"2023-12-19T16:15:24.612925+0000","last_undegraded":"2023-12-19T16:15:24.612925+0000","last_fullsized":"2023-12-19T16:15:24.612925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:37.663686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987782+0000","last_change":"2023-12-19T16:15:24.611948+0000","last_active":"2023-12-19T16:15:24.987782+0000","last_peered":"2023-12-19T16:15:24.987782+0000","last_clean":"2023-12-19T16:15:24.987782+0000","last_became_active":"2023-12-19T16:15:24.611168+0000","last_became_peered":"2023-12-19T16:15:24.611168+0000","last_unstale":"2023-12-19T16:15:24.987782+0000","last_undegraded":"2023-12-19T16:15:24.987782+0000","last_fullsized":"2023-12-19T16:15:24.987782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:58.259665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580838+0000","last_change":"2023-12-19T16:15:20.582515+0000","last_active":"2023-12-19T16:15:24.580838+0000","last_peered":"2023-12-19T16:15:24.580838+0000","last_clean":"2023-12-19T16:15:24.580838+0000","last_became_active":"2023-12-19T16:15:20.582246+0000","last_became_peered":"2023-12-19T16:15:20.582246+0000","last_unstale":"2023-12-19T16:15:24.580838+0000","last_undegraded":"2023-12-19T16:15:24.580838+0000","last_fullsized":"2023-12-19T16:15:24.580838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609028+0000","last_change":"2023-12-19T16:15:20.193662+0000","last_active":"2023-12-19T16:15:24.609028+0000","last_peered":"2023-12-19T16:15:24.609028+0000","last_clean":"2023-12-19T16:15:24.609028+0000","last_became_active":"2023-12-19T16:15:20.193345+0000","last_became_peered":"2023-12-19T16:15:20.193345+0000","last_unstale":"2023-12-19T16:15:24.609028+0000","last_undegraded":"2023-12-19T16:15:24.609028+0000","last_fullsized":"2023-12-19T16:15:24.609028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987322+0000","last_change":"2023-12-19T16:15:24.621026+0000","last_active":"2023-12-19T16:15:24.987322+0000","last_peered":"2023-12-19T16:15:24.987322+0000","last_clean":"2023-12-19T16:15:24.987322+0000","last_became_active":"2023-12-19T16:15:24.618568+0000","last_became_peered":"2023-12-19T16:15:24.618568+0000","last_unstale":"2023-12-19T16:15:24.987322+0000","last_undegraded":"2023-12-19T16:15:24.987322+0000","last_fullsized":"2023-12-19T16:15:24.987322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580610+0000","last_change":"2023-12-19T16:15:20.593268+0000","last_active":"2023-12-19T16:15:24.580610+0000","last_peered":"2023-12-19T16:15:24.580610+0000","last_clean":"2023-12-19T16:15:24.580610+0000","last_became_active":"2023-12-19T16:15:20.593033+0000","last_became_peered":"2023-12-19T16:15:20.593033+0000","last_unstale":"2023-12-19T16:15:24.580610+0000","last_undegraded":"2023-12-19T16:15:24.580610+0000","last_fullsized":"2023-12-19T16:15:24.580610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607527+0000","last_change":"2023-12-19T16:15:20.190652+0000","last_active":"2023-12-19T16:15:24.607527+0000","last_peered":"2023-12-19T16:15:24.607527+0000","last_clean":"2023-12-19T16:15:24.607527+0000","last_became_active":"2023-12-19T16:15:20.190271+0000","last_became_peered":"2023-12-19T16:15:20.190271+0000","last_unstale":"2023-12-19T16:15:24.607527+0000","last_undegraded":"2023-12-19T16:15:24.607527+0000","last_fullsized":"2023-12-19T16:15:24.607527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991773+0000","last_change":"2023-12-19T16:15:24.620676+0000","last_active":"2023-12-19T16:15:24.991773+0000","last_peered":"2023-12-19T16:15:24.991773+0000","last_clean":"2023-12-19T16:15:24.991773+0000","last_became_active":"2023-12-19T16:15:24.619756+0000","last_became_peered":"2023-12-19T16:15:24.619756+0000","last_unstale":"2023-12-19T16:15:24.991773+0000","last_undegraded":"2023-12-19T16:15:24.991773+0000","last_fullsized":"2023-12-19T16:15:24.991773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588078+0000","last_change":"2023-12-19T16:15:20.583947+0000","last_active":"2023-12-19T16:15:24.588078+0000","last_peered":"2023-12-19T16:15:24.588078+0000","last_clean":"2023-12-19T16:15:24.588078+0000","last_became_active":"2023-12-19T16:15:20.583625+0000","last_became_peered":"2023-12-19T16:15:20.583625+0000","last_unstale":"2023-12-19T16:15:24.588078+0000","last_undegraded":"2023-12-19T16:15:24.588078+0000","last_fullsized":"2023-12-19T16:15:24.588078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:00.076039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606271+0000","last_change":"2023-12-19T16:15:20.197434+0000","last_active":"2023-12-19T16:15:24.606271+0000","last_peered":"2023-12-19T16:15:24.606271+0000","last_clean":"2023-12-19T16:15:24.606271+0000","last_became_active":"2023-12-19T16:15:20.197066+0000","last_became_peered":"2023-12-19T16:15:20.197066+0000","last_unstale":"2023-12-19T16:15:24.606271+0000","last_undegraded":"2023-12-19T16:15:24.606271+0000","last_fullsized":"2023-12-19T16:15:24.606271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987228+0000","last_change":"2023-12-19T16:15:24.614999+0000","last_active":"2023-12-19T16:15:24.987228+0000","last_peered":"2023-12-19T16:15:24.987228+0000","last_clean":"2023-12-19T16:15:24.987228+0000","last_became_active":"2023-12-19T16:15:24.613975+0000","last_became_peered":"2023-12-19T16:15:24.613975+0000","last_unstale":"2023-12-19T16:15:24.987228+0000","last_undegraded":"2023-12-19T16:15:24.987228+0000","last_fullsized":"2023-12-19T16:15:24.987228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588898+0000","last_change":"2023-12-19T16:15:20.592452+0000","last_active":"2023-12-19T16:15:24.588898+0000","last_peered":"2023-12-19T16:15:24.588898+0000","last_clean":"2023-12-19T16:15:24.588898+0000","last_became_active":"2023-12-19T16:15:20.592161+0000","last_became_peered":"2023-12-19T16:15:20.592161+0000","last_unstale":"2023-12-19T16:15:24.588898+0000","last_undegraded":"2023-12-19T16:15:24.588898+0000","last_fullsized":"2023-12-19T16:15:24.588898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591886+0000","last_change":"2023-12-19T16:15:20.208862+0000","last_active":"2023-12-19T16:15:24.591886+0000","last_peered":"2023-12-19T16:15:24.591886+0000","last_clean":"2023-12-19T16:15:24.591886+0000","last_became_active":"2023-12-19T16:15:20.208590+0000","last_became_peered":"2023-12-19T16:15:20.208590+0000","last_unstale":"2023-12-19T16:15:24.591886+0000","last_undegraded":"2023-12-19T16:15:24.591886+0000","last_fullsized":"2023-12-19T16:15:24.591886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987223+0000","last_change":"2023-12-19T16:15:24.614167+0000","last_active":"2023-12-19T16:15:24.987223+0000","last_peered":"2023-12-19T16:15:24.987223+0000","last_clean":"2023-12-19T16:15:24.987223+0000","last_became_active":"2023-12-19T16:15:24.613456+0000","last_became_peered":"2023-12-19T16:15:24.613456+0000","last_unstale":"2023-12-19T16:15:24.987223+0000","last_undegraded":"2023-12-19T16:15:24.987223+0000","last_fullsized":"2023-12-19T16:15:24.987223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580848+0000","last_change":"2023-12-19T16:15:20.587069+0000","last_active":"2023-12-19T16:15:24.580848+0000","last_peered":"2023-12-19T16:15:24.580848+0000","last_clean":"2023-12-19T16:15:24.580848+0000","last_became_active":"2023-12-19T16:15:20.586781+0000","last_became_peered":"2023-12-19T16:15:20.586781+0000","last_unstale":"2023-12-19T16:15:24.580848+0000","last_undegraded":"2023-12-19T16:15:24.580848+0000","last_fullsized":"2023-12-19T16:15:24.580848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609772+0000","last_change":"2023-12-19T16:15:20.206431+0000","last_active":"2023-12-19T16:15:24.609772+0000","last_peered":"2023-12-19T16:15:24.609772+0000","last_clean":"2023-12-19T16:15:24.609772+0000","last_became_active":"2023-12-19T16:15:20.206208+0000","last_became_peered":"2023-12-19T16:15:20.206208+0000","last_unstale":"2023-12-19T16:15:24.609772+0000","last_undegraded":"2023-12-19T16:15:24.609772+0000","last_fullsized":"2023-12-19T16:15:24.609772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990754+0000","last_change":"2023-12-19T16:15:24.612174+0000","last_active":"2023-12-19T16:15:24.990754+0000","last_peered":"2023-12-19T16:15:24.990754+0000","last_clean":"2023-12-19T16:15:24.990754+0000","last_became_active":"2023-12-19T16:15:24.611609+0000","last_became_peered":"2023-12-19T16:15:24.611609+0000","last_unstale":"2023-12-19T16:15:24.990754+0000","last_undegraded":"2023-12-19T16:15:24.990754+0000","last_fullsized":"2023-12-19T16:15:24.990754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:54.794163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609936+0000","last_change":"2023-12-19T16:15:20.590393+0000","last_active":"2023-12-19T16:15:24.609936+0000","last_peered":"2023-12-19T16:15:24.609936+0000","last_clean":"2023-12-19T16:15:24.609936+0000","last_became_active":"2023-12-19T16:15:20.589290+0000","last_became_peered":"2023-12-19T16:15:20.589290+0000","last_unstale":"2023-12-19T16:15:24.609936+0000","last_undegraded":"2023-12-19T16:15:24.609936+0000","last_fullsized":"2023-12-19T16:15:24.609936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616161+0000","last_change":"2023-12-19T16:15:20.203475+0000","last_active":"2023-12-19T16:15:24.616161+0000","last_peered":"2023-12-19T16:15:24.616161+0000","last_clean":"2023-12-19T16:15:24.616161+0000","last_became_active":"2023-12-19T16:15:20.203209+0000","last_became_peered":"2023-12-19T16:15:20.203209+0000","last_unstale":"2023-12-19T16:15:24.616161+0000","last_undegraded":"2023-12-19T16:15:24.616161+0000","last_fullsized":"2023-12-19T16:15:24.616161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991778+0000","last_change":"2023-12-19T16:15:24.604368+0000","last_active":"2023-12-19T16:15:24.991778+0000","last_peered":"2023-12-19T16:15:24.991778+0000","last_clean":"2023-12-19T16:15:24.991778+0000","last_became_active":"2023-12-19T16:15:24.603970+0000","last_became_peered":"2023-12-19T16:15:24.603970+0000","last_unstale":"2023-12-19T16:15:24.991778+0000","last_undegraded":"2023-12-19T16:15:24.991778+0000","last_fullsized":"2023-12-19T16:15:24.991778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583544+0000","last_change":"2023-12-19T16:15:20.590364+0000","last_active":"2023-12-19T16:15:24.583544+0000","last_peered":"2023-12-19T16:15:24.583544+0000","last_clean":"2023-12-19T16:15:24.583544+0000","last_became_active":"2023-12-19T16:15:20.589975+0000","last_became_peered":"2023-12-19T16:15:20.589975+0000","last_unstale":"2023-12-19T16:15:24.583544+0000","last_undegraded":"2023-12-19T16:15:24.583544+0000","last_fullsized":"2023-12-19T16:15:24.583544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610003+0000","last_change":"2023-12-19T16:15:20.190567+0000","last_active":"2023-12-19T16:15:24.610003+0000","last_peered":"2023-12-19T16:15:24.610003+0000","last_clean":"2023-12-19T16:15:24.610003+0000","last_became_active":"2023-12-19T16:15:20.189732+0000","last_became_peered":"2023-12-19T16:15:20.189732+0000","last_unstale":"2023-12-19T16:15:24.610003+0000","last_undegraded":"2023-12-19T16:15:24.610003+0000","last_fullsized":"2023-12-19T16:15:24.610003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990745+0000","last_change":"2023-12-19T16:15:24.613205+0000","last_active":"2023-12-19T16:15:24.990745+0000","last_peered":"2023-12-19T16:15:24.990745+0000","last_clean":"2023-12-19T16:15:24.990745+0000","last_became_active":"2023-12-19T16:15:24.612609+0000","last_became_peered":"2023-12-19T16:15:24.612609+0000","last_unstale":"2023-12-19T16:15:24.990745+0000","last_undegraded":"2023-12-19T16:15:24.990745+0000","last_fullsized":"2023-12-19T16:15:24.990745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586333+0000","last_change":"2023-12-19T16:15:20.574569+0000","last_active":"2023-12-19T16:15:24.586333+0000","last_peered":"2023-12-19T16:15:24.586333+0000","last_clean":"2023-12-19T16:15:24.586333+0000","last_became_active":"2023-12-19T16:15:20.573795+0000","last_became_peered":"2023-12-19T16:15:20.573795+0000","last_unstale":"2023-12-19T16:15:24.586333+0000","last_undegraded":"2023-12-19T16:15:24.586333+0000","last_fullsized":"2023-12-19T16:15:24.586333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583390+0000","last_change":"2023-12-19T16:15:20.194527+0000","last_active":"2023-12-19T16:15:24.583390+0000","last_peered":"2023-12-19T16:15:24.583390+0000","last_clean":"2023-12-19T16:15:24.583390+0000","last_became_active":"2023-12-19T16:15:20.194212+0000","last_became_peered":"2023-12-19T16:15:20.194212+0000","last_unstale":"2023-12-19T16:15:24.583390+0000","last_undegraded":"2023-12-19T16:15:24.583390+0000","last_fullsized":"2023-12-19T16:15:24.583390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991169+0000","last_change":"2023-12-19T16:15:24.619624+0000","last_active":"2023-12-19T16:15:24.991169+0000","last_peered":"2023-12-19T16:15:24.991169+0000","last_clean":"2023-12-19T16:15:24.991169+0000","last_became_active":"2023-12-19T16:15:24.619279+0000","last_became_peered":"2023-12-19T16:15:24.619279+0000","last_unstale":"2023-12-19T16:15:24.991169+0000","last_undegraded":"2023-12-19T16:15:24.991169+0000","last_fullsized":"2023-12-19T16:15:24.991169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.604284+0000","last_change":"2023-12-19T16:15:20.588633+0000","last_active":"2023-12-19T16:15:24.604284+0000","last_peered":"2023-12-19T16:15:24.604284+0000","last_clean":"2023-12-19T16:15:24.604284+0000","last_became_active":"2023-12-19T16:15:20.585483+0000","last_became_peered":"2023-12-19T16:15:20.585483+0000","last_unstale":"2023-12-19T16:15:24.604284+0000","last_undegraded":"2023-12-19T16:15:24.604284+0000","last_fullsized":"2023-12-19T16:15:24.604284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586562+0000","last_change":"2023-12-19T16:15:20.190133+0000","last_active":"2023-12-19T16:15:24.586562+0000","last_peered":"2023-12-19T16:15:24.586562+0000","last_clean":"2023-12-19T16:15:24.586562+0000","last_became_active":"2023-12-19T16:15:20.189767+0000","last_became_peered":"2023-12-19T16:15:20.189767+0000","last_unstale":"2023-12-19T16:15:24.586562+0000","last_undegraded":"2023-12-19T16:15:24.586562+0000","last_fullsized":"2023-12-19T16:15:24.586562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991870+0000","last_change":"2023-12-19T16:15:24.620960+0000","last_active":"2023-12-19T16:15:24.991870+0000","last_peered":"2023-12-19T16:15:24.991870+0000","last_clean":"2023-12-19T16:15:24.991870+0000","last_became_active":"2023-12-19T16:15:24.620316+0000","last_became_peered":"2023-12-19T16:15:24.620316+0000","last_unstale":"2023-12-19T16:15:24.991870+0000","last_undegraded":"2023-12-19T16:15:24.991870+0000","last_fullsized":"2023-12-19T16:15:24.991870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589097+0000","last_change":"2023-12-19T16:15:20.577774+0000","last_active":"2023-12-19T16:15:24.589097+0000","last_peered":"2023-12-19T16:15:24.589097+0000","last_clean":"2023-12-19T16:15:24.589097+0000","last_became_active":"2023-12-19T16:15:20.577521+0000","last_became_peered":"2023-12-19T16:15:20.577521+0000","last_unstale":"2023-12-19T16:15:24.589097+0000","last_undegraded":"2023-12-19T16:15:24.589097+0000","last_fullsized":"2023-12-19T16:15:24.589097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606291+0000","last_change":"2023-12-19T16:15:20.201723+0000","last_active":"2023-12-19T16:15:24.606291+0000","last_peered":"2023-12-19T16:15:24.606291+0000","last_clean":"2023-12-19T16:15:24.606291+0000","last_became_active":"2023-12-19T16:15:20.201368+0000","last_became_peered":"2023-12-19T16:15:20.201368+0000","last_unstale":"2023-12-19T16:15:24.606291+0000","last_undegraded":"2023-12-19T16:15:24.606291+0000","last_fullsized":"2023-12-19T16:15:24.606291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:17.746223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991977+0000","last_change":"2023-12-19T16:15:24.614648+0000","last_active":"2023-12-19T16:15:24.991977+0000","last_peered":"2023-12-19T16:15:24.991977+0000","last_clean":"2023-12-19T16:15:24.991977+0000","last_became_active":"2023-12-19T16:15:24.611988+0000","last_became_peered":"2023-12-19T16:15:24.611988+0000","last_unstale":"2023-12-19T16:15:24.991977+0000","last_undegraded":"2023-12-19T16:15:24.991977+0000","last_fullsized":"2023-12-19T16:15:24.991977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579894+0000","last_change":"2023-12-19T16:15:20.591587+0000","last_active":"2023-12-19T16:15:24.579894+0000","last_peered":"2023-12-19T16:15:24.579894+0000","last_clean":"2023-12-19T16:15:24.579894+0000","last_became_active":"2023-12-19T16:15:20.589033+0000","last_became_peered":"2023-12-19T16:15:20.589033+0000","last_unstale":"2023-12-19T16:15:24.579894+0000","last_undegraded":"2023-12-19T16:15:24.579894+0000","last_fullsized":"2023-12-19T16:15:24.579894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583506+0000","last_change":"2023-12-19T16:15:20.193675+0000","last_active":"2023-12-19T16:15:24.583506+0000","last_peered":"2023-12-19T16:15:24.583506+0000","last_clean":"2023-12-19T16:15:24.583506+0000","last_became_active":"2023-12-19T16:15:20.189433+0000","last_became_peered":"2023-12-19T16:15:20.189433+0000","last_unstale":"2023-12-19T16:15:24.583506+0000","last_undegraded":"2023-12-19T16:15:24.583506+0000","last_fullsized":"2023-12-19T16:15:24.583506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606398+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:15:24.606398+0000","last_peered":"2023-12-19T16:15:24.606398+0000","last_clean":"2023-12-19T16:15:24.606398+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:15:24.606398+0000","last_undegraded":"2023-12-19T16:15:24.606398+0000","last_fullsized":"2023-12-19T16:15:24.606398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992081+0000","last_change":"2023-12-19T16:15:24.621441+0000","last_active":"2023-12-19T16:15:24.992081+0000","last_peered":"2023-12-19T16:15:24.992081+0000","last_clean":"2023-12-19T16:15:24.992081+0000","last_became_active":"2023-12-19T16:15:24.619272+0000","last_became_peered":"2023-12-19T16:15:24.619272+0000","last_unstale":"2023-12-19T16:15:24.992081+0000","last_undegraded":"2023-12-19T16:15:24.992081+0000","last_fullsized":"2023-12-19T16:15:24.992081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:04.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.614464+0000","last_change":"2023-12-19T16:15:20.608106+0000","last_active":"2023-12-19T16:15:24.614464+0000","last_peered":"2023-12-19T16:15:24.614464+0000","last_clean":"2023-12-19T16:15:24.614464+0000","last_became_active":"2023-12-19T16:15:20.607827+0000","last_became_peered":"2023-12-19T16:15:20.607827+0000","last_unstale":"2023-12-19T16:15:24.614464+0000","last_undegraded":"2023-12-19T16:15:24.614464+0000","last_fullsized":"2023-12-19T16:15:24.614464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:56.432350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586822+0000","last_change":"2023-12-19T16:15:20.188280+0000","last_active":"2023-12-19T16:15:24.586822+0000","last_peered":"2023-12-19T16:15:24.586822+0000","last_clean":"2023-12-19T16:15:24.586822+0000","last_became_active":"2023-12-19T16:15:20.187947+0000","last_became_peered":"2023-12-19T16:15:20.187947+0000","last_unstale":"2023-12-19T16:15:24.586822+0000","last_undegraded":"2023-12-19T16:15:24.586822+0000","last_fullsized":"2023-12-19T16:15:24.586822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991784+0000","last_change":"2023-12-19T16:15:24.611679+0000","last_active":"2023-12-19T16:15:24.991784+0000","last_peered":"2023-12-19T16:15:24.991784+0000","last_clean":"2023-12-19T16:15:24.991784+0000","last_became_active":"2023-12-19T16:15:24.610986+0000","last_became_peered":"2023-12-19T16:15:24.610986+0000","last_unstale":"2023-12-19T16:15:24.991784+0000","last_undegraded":"2023-12-19T16:15:24.991784+0000","last_fullsized":"2023-12-19T16:15:24.991784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:11.191541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582165+0000","last_change":"2023-12-19T16:15:20.595169+0000","last_active":"2023-12-19T16:15:24.582165+0000","last_peered":"2023-12-19T16:15:24.582165+0000","last_clean":"2023-12-19T16:15:24.582165+0000","last_became_active":"2023-12-19T16:15:20.594861+0000","last_became_peered":"2023-12-19T16:15:20.594861+0000","last_unstale":"2023-12-19T16:15:24.582165+0000","last_undegraded":"2023-12-19T16:15:24.582165+0000","last_fullsized":"2023-12-19T16:15:24.582165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610122+0000","last_change":"2023-12-19T16:15:20.189994+0000","last_active":"2023-12-19T16:15:24.610122+0000","last_peered":"2023-12-19T16:15:24.610122+0000","last_clean":"2023-12-19T16:15:24.610122+0000","last_became_active":"2023-12-19T16:15:20.188076+0000","last_became_peered":"2023-12-19T16:15:20.188076+0000","last_unstale":"2023-12-19T16:15:24.610122+0000","last_undegraded":"2023-12-19T16:15:24.610122+0000","last_fullsized":"2023-12-19T16:15:24.610122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991932+0000","last_change":"2023-12-19T16:15:24.602286+0000","last_active":"2023-12-19T16:15:24.991932+0000","last_peered":"2023-12-19T16:15:24.991932+0000","last_clean":"2023-12-19T16:15:24.991932+0000","last_became_active":"2023-12-19T16:15:24.601875+0000","last_became_peered":"2023-12-19T16:15:24.601875+0000","last_unstale":"2023-12-19T16:15:24.991932+0000","last_undegraded":"2023-12-19T16:15:24.991932+0000","last_fullsized":"2023-12-19T16:15:24.991932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616423+0000","last_change":"2023-12-19T16:15:20.605190+0000","last_active":"2023-12-19T16:15:24.616423+0000","last_peered":"2023-12-19T16:15:24.616423+0000","last_clean":"2023-12-19T16:15:24.616423+0000","last_became_active":"2023-12-19T16:15:20.605031+0000","last_became_peered":"2023-12-19T16:15:20.605031+0000","last_unstale":"2023-12-19T16:15:24.616423+0000","last_undegraded":"2023-12-19T16:15:24.616423+0000","last_fullsized":"2023-12-19T16:15:24.616423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586417+0000","last_change":"2023-12-19T16:15:20.188422+0000","last_active":"2023-12-19T16:15:24.586417+0000","last_peered":"2023-12-19T16:15:24.586417+0000","last_clean":"2023-12-19T16:15:24.586417+0000","last_became_active":"2023-12-19T16:15:20.188093+0000","last_became_peered":"2023-12-19T16:15:20.188093+0000","last_unstale":"2023-12-19T16:15:24.586417+0000","last_undegraded":"2023-12-19T16:15:24.586417+0000","last_fullsized":"2023-12-19T16:15:24.586417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987050+0000","last_change":"2023-12-19T16:15:24.601682+0000","last_active":"2023-12-19T16:15:24.987050+0000","last_peered":"2023-12-19T16:15:24.987050+0000","last_clean":"2023-12-19T16:15:24.987050+0000","last_became_active":"2023-12-19T16:15:24.601267+0000","last_became_peered":"2023-12-19T16:15:24.601267+0000","last_unstale":"2023-12-19T16:15:24.987050+0000","last_undegraded":"2023-12-19T16:15:24.987050+0000","last_fullsized":"2023-12-19T16:15:24.987050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616152+0000","last_change":"2023-12-19T16:15:20.601877+0000","last_active":"2023-12-19T16:15:24.616152+0000","last_peered":"2023-12-19T16:15:24.616152+0000","last_clean":"2023-12-19T16:15:24.616152+0000","last_became_active":"2023-12-19T16:15:20.601574+0000","last_became_peered":"2023-12-19T16:15:20.601574+0000","last_unstale":"2023-12-19T16:15:24.616152+0000","last_undegraded":"2023-12-19T16:15:24.616152+0000","last_fullsized":"2023-12-19T16:15:24.616152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586605+0000","last_change":"2023-12-19T16:15:20.203704+0000","last_active":"2023-12-19T16:15:24.586605+0000","last_peered":"2023-12-19T16:15:24.586605+0000","last_clean":"2023-12-19T16:15:24.586605+0000","last_became_active":"2023-12-19T16:15:20.203355+0000","last_became_peered":"2023-12-19T16:15:20.203355+0000","last_unstale":"2023-12-19T16:15:24.586605+0000","last_undegraded":"2023-12-19T16:15:24.586605+0000","last_fullsized":"2023-12-19T16:15:24.586605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987820+0000","last_change":"2023-12-19T16:15:24.624496+0000","last_active":"2023-12-19T16:15:24.987820+0000","last_peered":"2023-12-19T16:15:24.987820+0000","last_clean":"2023-12-19T16:15:24.987820+0000","last_became_active":"2023-12-19T16:15:24.620007+0000","last_became_peered":"2023-12-19T16:15:24.620007+0000","last_unstale":"2023-12-19T16:15:24.987820+0000","last_undegraded":"2023-12-19T16:15:24.987820+0000","last_fullsized":"2023-12-19T16:15:24.987820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611918+0000","last_change":"2023-12-19T16:15:20.592930+0000","last_active":"2023-12-19T16:15:24.611918+0000","last_peered":"2023-12-19T16:15:24.611918+0000","last_clean":"2023-12-19T16:15:24.611918+0000","last_became_active":"2023-12-19T16:15:20.592602+0000","last_became_peered":"2023-12-19T16:15:20.592602+0000","last_unstale":"2023-12-19T16:15:24.611918+0000","last_undegraded":"2023-12-19T16:15:24.611918+0000","last_fullsized":"2023-12-19T16:15:24.611918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586537+0000","last_change":"2023-12-19T16:15:20.193145+0000","last_active":"2023-12-19T16:15:24.586537+0000","last_peered":"2023-12-19T16:15:24.586537+0000","last_clean":"2023-12-19T16:15:24.586537+0000","last_became_active":"2023-12-19T16:15:20.192849+0000","last_became_peered":"2023-12-19T16:15:20.192849+0000","last_unstale":"2023-12-19T16:15:24.586537+0000","last_undegraded":"2023-12-19T16:15:24.586537+0000","last_fullsized":"2023-12-19T16:15:24.586537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990894+0000","last_change":"2023-12-19T16:15:24.617964+0000","last_active":"2023-12-19T16:15:24.990894+0000","last_peered":"2023-12-19T16:15:24.990894+0000","last_clean":"2023-12-19T16:15:24.990894+0000","last_became_active":"2023-12-19T16:15:24.617522+0000","last_became_peered":"2023-12-19T16:15:24.617522+0000","last_unstale":"2023-12-19T16:15:24.990894+0000","last_undegraded":"2023-12-19T16:15:24.990894+0000","last_fullsized":"2023-12-19T16:15:24.990894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589828+0000","last_change":"2023-12-19T16:15:20.610470+0000","last_active":"2023-12-19T16:15:24.589828+0000","last_peered":"2023-12-19T16:15:24.589828+0000","last_clean":"2023-12-19T16:15:24.589828+0000","last_became_active":"2023-12-19T16:15:20.610140+0000","last_became_peered":"2023-12-19T16:15:20.610140+0000","last_unstale":"2023-12-19T16:15:24.589828+0000","last_undegraded":"2023-12-19T16:15:24.589828+0000","last_fullsized":"2023-12-19T16:15:24.589828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590885+0000","last_change":"2023-12-19T16:15:20.193278+0000","last_active":"2023-12-19T16:15:24.590885+0000","last_peered":"2023-12-19T16:15:24.590885+0000","last_clean":"2023-12-19T16:15:24.590885+0000","last_became_active":"2023-12-19T16:15:20.189782+0000","last_became_peered":"2023-12-19T16:15:20.189782+0000","last_unstale":"2023-12-19T16:15:24.590885+0000","last_undegraded":"2023-12-19T16:15:24.590885+0000","last_fullsized":"2023-12-19T16:15:24.590885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.993027+0000","last_change":"2023-12-19T16:15:24.609889+0000","last_active":"2023-12-19T16:15:24.993027+0000","last_peered":"2023-12-19T16:15:24.993027+0000","last_clean":"2023-12-19T16:15:24.993027+0000","last_became_active":"2023-12-19T16:15:24.609251+0000","last_became_peered":"2023-12-19T16:15:24.609251+0000","last_unstale":"2023-12-19T16:15:24.993027+0000","last_undegraded":"2023-12-19T16:15:24.993027+0000","last_fullsized":"2023-12-19T16:15:24.993027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:02.692965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612765+0000","last_change":"2023-12-19T16:15:20.600917+0000","last_active":"2023-12-19T16:15:24.612765+0000","last_peered":"2023-12-19T16:15:24.612765+0000","last_clean":"2023-12-19T16:15:24.612765+0000","last_became_active":"2023-12-19T16:15:20.600561+0000","last_became_peered":"2023-12-19T16:15:20.600561+0000","last_unstale":"2023-12-19T16:15:24.612765+0000","last_undegraded":"2023-12-19T16:15:24.612765+0000","last_fullsized":"2023-12-19T16:15:24.612765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583304+0000","last_change":"2023-12-19T16:15:20.201508+0000","last_active":"2023-12-19T16:15:24.583304+0000","last_peered":"2023-12-19T16:15:24.583304+0000","last_clean":"2023-12-19T16:15:24.583304+0000","last_became_active":"2023-12-19T16:15:20.201097+0000","last_became_peered":"2023-12-19T16:15:20.201097+0000","last_unstale":"2023-12-19T16:15:24.583304+0000","last_undegraded":"2023-12-19T16:15:24.583304+0000","last_fullsized":"2023-12-19T16:15:24.583304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992254+0000","last_change":"2023-12-19T16:15:24.608002+0000","last_active":"2023-12-19T16:15:24.992254+0000","last_peered":"2023-12-19T16:15:24.992254+0000","last_clean":"2023-12-19T16:15:24.992254+0000","last_became_active":"2023-12-19T16:15:24.606747+0000","last_became_peered":"2023-12-19T16:15:24.606747+0000","last_unstale":"2023-12-19T16:15:24.992254+0000","last_undegraded":"2023-12-19T16:15:24.992254+0000","last_fullsized":"2023-12-19T16:15:24.992254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:18.036976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588578+0000","last_change":"2023-12-19T16:15:20.587572+0000","last_active":"2023-12-19T16:15:24.588578+0000","last_peered":"2023-12-19T16:15:24.588578+0000","last_clean":"2023-12-19T16:15:24.588578+0000","last_became_active":"2023-12-19T16:15:20.581946+0000","last_became_peered":"2023-12-19T16:15:20.581946+0000","last_unstale":"2023-12-19T16:15:24.588578+0000","last_undegraded":"2023-12-19T16:15:24.588578+0000","last_fullsized":"2023-12-19T16:15:24.588578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589554+0000","last_change":"2023-12-19T16:15:20.195315+0000","last_active":"2023-12-19T16:15:24.589554+0000","last_peered":"2023-12-19T16:15:24.589554+0000","last_clean":"2023-12-19T16:15:24.589554+0000","last_became_active":"2023-12-19T16:15:20.194795+0000","last_became_peered":"2023-12-19T16:15:20.194795+0000","last_unstale":"2023-12-19T16:15:24.589554+0000","last_undegraded":"2023-12-19T16:15:24.589554+0000","last_fullsized":"2023-12-19T16:15:24.589554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.989014+0000","last_change":"2023-12-19T16:15:24.620913+0000","last_active":"2023-12-19T16:15:24.989014+0000","last_peered":"2023-12-19T16:15:24.989014+0000","last_clean":"2023-12-19T16:15:24.989014+0000","last_became_active":"2023-12-19T16:15:24.620490+0000","last_became_peered":"2023-12-19T16:15:24.620490+0000","last_unstale":"2023-12-19T16:15:24.989014+0000","last_undegraded":"2023-12-19T16:15:24.989014+0000","last_fullsized":"2023-12-19T16:15:24.989014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.613716+0000","last_change":"2023-12-19T16:15:20.607538+0000","last_active":"2023-12-19T16:15:24.613716+0000","last_peered":"2023-12-19T16:15:24.613716+0000","last_clean":"2023-12-19T16:15:24.613716+0000","last_became_active":"2023-12-19T16:15:20.607181+0000","last_became_peered":"2023-12-19T16:15:20.607181+0000","last_unstale":"2023-12-19T16:15:24.613716+0000","last_undegraded":"2023-12-19T16:15:24.613716+0000","last_fullsized":"2023-12-19T16:15:24.613716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:30.750566+0000","last_change":"2023-12-19T16:15:20.199632+0000","last_active":"2023-12-19T16:15:30.750566+0000","last_peered":"2023-12-19T16:15:30.750566+0000","last_clean":"2023-12-19T16:15:30.750566+0000","last_became_active":"2023-12-19T16:15:20.198790+0000","last_became_peered":"2023-12-19T16:15:20.198790+0000","last_unstale":"2023-12-19T16:15:30.750566+0000","last_undegraded":"2023-12-19T16:15:30.750566+0000","last_fullsized":"2023-12-19T16:15:30.750566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990866+0000","last_change":"2023-12-19T16:15:24.608145+0000","last_active":"2023-12-19T16:15:24.990866+0000","last_peered":"2023-12-19T16:15:24.990866+0000","last_clean":"2023-12-19T16:15:24.990866+0000","last_became_active":"2023-12-19T16:15:24.607175+0000","last_became_peered":"2023-12-19T16:15:24.607175+0000","last_unstale":"2023-12-19T16:15:24.990866+0000","last_undegraded":"2023-12-19T16:15:24.990866+0000","last_fullsized":"2023-12-19T16:15:24.990866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589930+0000","last_change":"2023-12-19T16:15:20.579667+0000","last_active":"2023-12-19T16:15:24.589930+0000","last_peered":"2023-12-19T16:15:24.589930+0000","last_clean":"2023-12-19T16:15:24.589930+0000","last_became_active":"2023-12-19T16:15:20.578820+0000","last_became_peered":"2023-12-19T16:15:20.578820+0000","last_unstale":"2023-12-19T16:15:24.589930+0000","last_undegraded":"2023-12-19T16:15:24.589930+0000","last_fullsized":"2023-12-19T16:15:24.589930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610063+0000","last_change":"2023-12-19T16:15:20.202464+0000","last_active":"2023-12-19T16:15:24.610063+0000","last_peered":"2023-12-19T16:15:24.610063+0000","last_clean":"2023-12-19T16:15:24.610063+0000","last_became_active":"2023-12-19T16:15:20.202201+0000","last_became_peered":"2023-12-19T16:15:20.202201+0000","last_unstale":"2023-12-19T16:15:24.610063+0000","last_undegraded":"2023-12-19T16:15:24.610063+0000","last_fullsized":"2023-12-19T16:15:24.610063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987742+0000","last_change":"2023-12-19T16:15:24.606235+0000","last_active":"2023-12-19T16:15:24.987742+0000","last_peered":"2023-12-19T16:15:24.987742+0000","last_clean":"2023-12-19T16:15:24.987742+0000","last_became_active":"2023-12-19T16:15:24.605689+0000","last_became_peered":"2023-12-19T16:15:24.605689+0000","last_unstale":"2023-12-19T16:15:24.987742+0000","last_undegraded":"2023-12-19T16:15:24.987742+0000","last_fullsized":"2023-12-19T16:15:24.987742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588108+0000","last_change":"2023-12-19T16:15:20.579264+0000","last_active":"2023-12-19T16:15:24.588108+0000","last_peered":"2023-12-19T16:15:24.588108+0000","last_clean":"2023-12-19T16:15:24.588108+0000","last_became_active":"2023-12-19T16:15:20.578990+0000","last_became_peered":"2023-12-19T16:15:20.578990+0000","last_unstale":"2023-12-19T16:15:24.588108+0000","last_undegraded":"2023-12-19T16:15:24.588108+0000","last_fullsized":"2023-12-19T16:15:24.588108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583852+0000","last_change":"2023-12-19T16:15:20.199283+0000","last_active":"2023-12-19T16:15:24.583852+0000","last_peered":"2023-12-19T16:15:24.583852+0000","last_clean":"2023-12-19T16:15:24.583852+0000","last_became_active":"2023-12-19T16:15:20.199018+0000","last_became_peered":"2023-12-19T16:15:20.199018+0000","last_unstale":"2023-12-19T16:15:24.583852+0000","last_undegraded":"2023-12-19T16:15:24.583852+0000","last_fullsized":"2023-12-19T16:15:24.583852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990899+0000","last_change":"2023-12-19T16:15:24.606050+0000","last_active":"2023-12-19T16:15:24.990899+0000","last_peered":"2023-12-19T16:15:24.990899+0000","last_clean":"2023-12-19T16:15:24.990899+0000","last_became_active":"2023-12-19T16:15:24.605031+0000","last_became_peered":"2023-12-19T16:15:24.605031+0000","last_unstale":"2023-12-19T16:15:24.990899+0000","last_undegraded":"2023-12-19T16:15:24.990899+0000","last_fullsized":"2023-12-19T16:15:24.990899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:43.598139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583755+0000","last_change":"2023-12-19T16:15:20.587105+0000","last_active":"2023-12-19T16:15:24.583755+0000","last_peered":"2023-12-19T16:15:24.583755+0000","last_clean":"2023-12-19T16:15:24.583755+0000","last_became_active":"2023-12-19T16:15:20.586267+0000","last_became_peered":"2023-12-19T16:15:20.586267+0000","last_unstale":"2023-12-19T16:15:24.583755+0000","last_undegraded":"2023-12-19T16:15:24.583755+0000","last_fullsized":"2023-12-19T16:15:24.583755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591781+0000","last_change":"2023-12-19T16:15:20.205716+0000","last_active":"2023-12-19T16:15:24.591781+0000","last_peered":"2023-12-19T16:15:24.591781+0000","last_clean":"2023-12-19T16:15:24.591781+0000","last_became_active":"2023-12-19T16:15:20.205375+0000","last_became_peered":"2023-12-19T16:15:20.205375+0000","last_unstale":"2023-12-19T16:15:24.591781+0000","last_undegraded":"2023-12-19T16:15:24.591781+0000","last_fullsized":"2023-12-19T16:15:24.591781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991323+0000","last_change":"2023-12-19T16:15:24.614651+0000","last_active":"2023-12-19T16:15:24.991323+0000","last_peered":"2023-12-19T16:15:24.991323+0000","last_clean":"2023-12-19T16:15:24.991323+0000","last_became_active":"2023-12-19T16:15:24.613651+0000","last_became_peered":"2023-12-19T16:15:24.613651+0000","last_unstale":"2023-12-19T16:15:24.991323+0000","last_undegraded":"2023-12-19T16:15:24.991323+0000","last_fullsized":"2023-12-19T16:15:24.991323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990804+0000","last_change":"2023-12-19T16:15:24.617457+0000","last_active":"2023-12-19T16:15:24.990804+0000","last_peered":"2023-12-19T16:15:24.990804+0000","last_clean":"2023-12-19T16:15:24.990804+0000","last_became_active":"2023-12-19T16:15:24.617082+0000","last_became_peered":"2023-12-19T16:15:24.617082+0000","last_unstale":"2023-12-19T16:15:24.990804+0000","last_undegraded":"2023-12-19T16:15:24.990804+0000","last_fullsized":"2023-12-19T16:15:24.990804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606089+0000","last_change":"2023-12-19T16:15:20.596047+0000","last_active":"2023-12-19T16:15:24.606089+0000","last_peered":"2023-12-19T16:15:24.606089+0000","last_clean":"2023-12-19T16:15:24.606089+0000","last_became_active":"2023-12-19T16:15:20.595801+0000","last_became_peered":"2023-12-19T16:15:20.595801+0000","last_unstale":"2023-12-19T16:15:24.606089+0000","last_undegraded":"2023-12-19T16:15:24.606089+0000","last_fullsized":"2023-12-19T16:15:24.606089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582938+0000","last_change":"2023-12-19T16:15:20.198366+0000","last_active":"2023-12-19T16:15:24.582938+0000","last_peered":"2023-12-19T16:15:24.582938+0000","last_clean":"2023-12-19T16:15:24.582938+0000","last_became_active":"2023-12-19T16:15:20.198123+0000","last_became_peered":"2023-12-19T16:15:20.198123+0000","last_unstale":"2023-12-19T16:15:24.582938+0000","last_undegraded":"2023-12-19T16:15:24.582938+0000","last_fullsized":"2023-12-19T16:15:24.582938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992336+0000","last_change":"2023-12-19T16:15:24.613114+0000","last_active":"2023-12-19T16:15:24.992336+0000","last_peered":"2023-12-19T16:15:24.992336+0000","last_clean":"2023-12-19T16:15:24.992336+0000","last_became_active":"2023-12-19T16:15:24.612703+0000","last_became_peered":"2023-12-19T16:15:24.612703+0000","last_unstale":"2023-12-19T16:15:24.992336+0000","last_undegraded":"2023-12-19T16:15:24.992336+0000","last_fullsized":"2023-12-19T16:15:24.992336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580525+0000","last_change":"2023-12-19T16:15:20.578523+0000","last_active":"2023-12-19T16:15:24.580525+0000","last_peered":"2023-12-19T16:15:24.580525+0000","last_clean":"2023-12-19T16:15:24.580525+0000","last_became_active":"2023-12-19T16:15:20.578185+0000","last_became_peered":"2023-12-19T16:15:20.578185+0000","last_unstale":"2023-12-19T16:15:24.580525+0000","last_undegraded":"2023-12-19T16:15:24.580525+0000","last_fullsized":"2023-12-19T16:15:24.580525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582035+0000","last_change":"2023-12-19T16:15:20.197343+0000","last_active":"2023-12-19T16:15:24.582035+0000","last_peered":"2023-12-19T16:15:24.582035+0000","last_clean":"2023-12-19T16:15:24.582035+0000","last_became_active":"2023-12-19T16:15:20.196946+0000","last_became_peered":"2023-12-19T16:15:20.196946+0000","last_unstale":"2023-12-19T16:15:24.582035+0000","last_undegraded":"2023-12-19T16:15:24.582035+0000","last_fullsized":"2023-12-19T16:15:24.582035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590498+0000","last_change":"2023-12-19T16:15:20.196588+0000","last_active":"2023-12-19T16:15:24.590498+0000","last_peered":"2023-12-19T16:15:24.590498+0000","last_clean":"2023-12-19T16:15:24.590498+0000","last_became_active":"2023-12-19T16:15:20.196249+0000","last_became_peered":"2023-12-19T16:15:20.196249+0000","last_unstale":"2023-12-19T16:15:24.590498+0000","last_undegraded":"2023-12-19T16:15:24.590498+0000","last_fullsized":"2023-12-19T16:15:24.590498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589480+0000","last_change":"2023-12-19T16:15:20.578312+0000","last_active":"2023-12-19T16:15:24.589480+0000","last_peered":"2023-12-19T16:15:24.589480+0000","last_clean":"2023-12-19T16:15:24.589480+0000","last_became_active":"2023-12-19T16:15:20.578056+0000","last_became_peered":"2023-12-19T16:15:20.578056+0000","last_unstale":"2023-12-19T16:15:24.589480+0000","last_undegraded":"2023-12-19T16:15:24.589480+0000","last_fullsized":"2023-12-19T16:15:24.589480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.985598+0000","last_change":"2023-12-19T16:15:24.614365+0000","last_active":"2023-12-19T16:15:24.985598+0000","last_peered":"2023-12-19T16:15:24.985598+0000","last_clean":"2023-12-19T16:15:24.985598+0000","last_became_active":"2023-12-19T16:15:24.613978+0000","last_became_peered":"2023-12-19T16:15:24.613978+0000","last_unstale":"2023-12-19T16:15:24.985598+0000","last_undegraded":"2023-12-19T16:15:24.985598+0000","last_fullsized":"2023-12-19T16:15:24.985598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:33.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580327+0000","last_change":"2023-12-19T16:15:20.191767+0000","last_active":"2023-12-19T16:15:24.580327+0000","last_peered":"2023-12-19T16:15:24.580327+0000","last_clean":"2023-12-19T16:15:24.580327+0000","last_became_active":"2023-12-19T16:15:20.191391+0000","last_became_peered":"2023-12-19T16:15:20.191391+0000","last_unstale":"2023-12-19T16:15:24.580327+0000","last_undegraded":"2023-12-19T16:15:24.580327+0000","last_fullsized":"2023-12-19T16:15:24.580327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587620+0000","last_change":"2023-12-19T16:15:20.593654+0000","last_active":"2023-12-19T16:15:24.587620+0000","last_peered":"2023-12-19T16:15:24.587620+0000","last_clean":"2023-12-19T16:15:24.587620+0000","last_became_active":"2023-12-19T16:15:20.593384+0000","last_became_peered":"2023-12-19T16:15:20.593384+0000","last_unstale":"2023-12-19T16:15:24.587620+0000","last_undegraded":"2023-12-19T16:15:24.587620+0000","last_fullsized":"2023-12-19T16:15:24.587620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992753+0000","last_change":"2023-12-19T16:15:24.608692+0000","last_active":"2023-12-19T16:15:24.992753+0000","last_peered":"2023-12-19T16:15:24.992753+0000","last_clean":"2023-12-19T16:15:24.992753+0000","last_became_active":"2023-12-19T16:15:24.608307+0000","last_became_peered":"2023-12-19T16:15:24.608307+0000","last_unstale":"2023-12-19T16:15:24.992753+0000","last_undegraded":"2023-12-19T16:15:24.992753+0000","last_fullsized":"2023-12-19T16:15:24.992753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:21:37.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589734+0000","last_change":"2023-12-19T16:15:20.608095+0000","last_active":"2023-12-19T16:15:24.589734+0000","last_peered":"2023-12-19T16:15:24.589734+0000","last_clean":"2023-12-19T16:15:24.589734+0000","last_became_active":"2023-12-19T16:15:20.604431+0000","last_became_peered":"2023-12-19T16:15:20.604431+0000","last_unstale":"2023-12-19T16:15:24.589734+0000","last_undegraded":"2023-12-19T16:15:24.589734+0000","last_fullsized":"2023-12-19T16:15:24.589734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586488+0000","last_change":"2023-12-19T16:15:20.587765+0000","last_active":"2023-12-19T16:15:24.586488+0000","last_peered":"2023-12-19T16:15:24.586488+0000","last_clean":"2023-12-19T16:15:24.586488+0000","last_became_active":"2023-12-19T16:15:20.587480+0000","last_became_peered":"2023-12-19T16:15:20.587480+0000","last_unstale":"2023-12-19T16:15:24.586488+0000","last_undegraded":"2023-12-19T16:15:24.586488+0000","last_fullsized":"2023-12-19T16:15:24.586488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583224+0000","last_change":"2023-12-19T16:15:20.590224+0000","last_active":"2023-12-19T16:15:24.583224+0000","last_peered":"2023-12-19T16:15:24.583224+0000","last_clean":"2023-12-19T16:15:24.583224+0000","last_became_active":"2023-12-19T16:15:20.589817+0000","last_became_peered":"2023-12-19T16:15:20.589817+0000","last_unstale":"2023-12-19T16:15:24.583224+0000","last_undegraded":"2023-12-19T16:15:24.583224+0000","last_fullsized":"2023-12-19T16:15:24.583224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589415+0000","last_change":"2023-12-19T16:15:20.584816+0000","last_active":"2023-12-19T16:15:24.589415+0000","last_peered":"2023-12-19T16:15:24.589415+0000","last_clean":"2023-12-19T16:15:24.589415+0000","last_became_active":"2023-12-19T16:15:20.584532+0000","last_became_peered":"2023-12-19T16:15:20.584532+0000","last_unstale":"2023-12-19T16:15:24.589415+0000","last_undegraded":"2023-12-19T16:15:24.589415+0000","last_fullsized":"2023-12-19T16:15:24.589415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580387+0000","last_change":"2023-12-19T16:15:20.583294+0000","last_active":"2023-12-19T16:15:24.580387+0000","last_peered":"2023-12-19T16:15:24.580387+0000","last_clean":"2023-12-19T16:15:24.580387+0000","last_became_active":"2023-12-19T16:15:20.583080+0000","last_became_peered":"2023-12-19T16:15:20.583080+0000","last_unstale":"2023-12-19T16:15:24.580387+0000","last_undegraded":"2023-12-19T16:15:24.580387+0000","last_fullsized":"2023-12-19T16:15:24.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609991+0000","last_change":"2023-12-19T16:15:20.604537+0000","last_active":"2023-12-19T16:15:24.609991+0000","last_peered":"2023-12-19T16:15:24.609991+0000","last_clean":"2023-12-19T16:15:24.609991+0000","last_became_active":"2023-12-19T16:15:20.604292+0000","last_became_peered":"2023-12-19T16:15:20.604292+0000","last_unstale":"2023-12-19T16:15:24.609991+0000","last_undegraded":"2023-12-19T16:15:24.609991+0000","last_fullsized":"2023-12-19T16:15:24.609991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592846+0000","last_change":"2023-12-19T16:15:20.586983+0000","last_active":"2023-12-19T16:15:24.592846+0000","last_peered":"2023-12-19T16:15:24.592846+0000","last_clean":"2023-12-19T16:15:24.592846+0000","last_became_active":"2023-12-19T16:15:20.586747+0000","last_became_peered":"2023-12-19T16:15:20.586747+0000","last_unstale":"2023-12-19T16:15:24.592846+0000","last_undegraded":"2023-12-19T16:15:24.592846+0000","last_fullsized":"2023-12-19T16:15:24.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580756+0000","last_change":"2023-12-19T16:15:20.600781+0000","last_active":"2023-12-19T16:15:24.580756+0000","last_peered":"2023-12-19T16:15:24.580756+0000","last_clean":"2023-12-19T16:15:24.580756+0000","last_became_active":"2023-12-19T16:15:20.600499+0000","last_became_peered":"2023-12-19T16:15:20.600499+0000","last_unstale":"2023-12-19T16:15:24.580756+0000","last_undegraded":"2023-12-19T16:15:24.580756+0000","last_fullsized":"2023-12-19T16:15:24.580756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582940+0000","last_change":"2023-12-19T16:15:20.590492+0000","last_active":"2023-12-19T16:15:24.582940+0000","last_peered":"2023-12-19T16:15:24.582940+0000","last_clean":"2023-12-19T16:15:24.582940+0000","last_became_active":"2023-12-19T16:15:20.590230+0000","last_became_peered":"2023-12-19T16:15:20.590230+0000","last_unstale":"2023-12-19T16:15:24.582940+0000","last_undegraded":"2023-12-19T16:15:24.582940+0000","last_fullsized":"2023-12-19T16:15:24.582940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581284+0000","last_change":"2023-12-19T16:15:20.582285+0000","last_active":"2023-12-19T16:15:24.581284+0000","last_peered":"2023-12-19T16:15:24.581284+0000","last_clean":"2023-12-19T16:15:24.581284+0000","last_became_active":"2023-12-19T16:15:20.581886+0000","last_became_peered":"2023-12-19T16:15:20.581886+0000","last_unstale":"2023-12-19T16:15:24.581284+0000","last_undegraded":"2023-12-19T16:15:24.581284+0000","last_fullsized":"2023-12-19T16:15:24.581284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583151+0000","last_change":"2023-12-19T16:15:20.580662+0000","last_active":"2023-12-19T16:15:24.583151+0000","last_peered":"2023-12-19T16:15:24.583151+0000","last_clean":"2023-12-19T16:15:24.583151+0000","last_became_active":"2023-12-19T16:15:20.580373+0000","last_became_peered":"2023-12-19T16:15:20.580373+0000","last_unstale":"2023-12-19T16:15:24.583151+0000","last_undegraded":"2023-12-19T16:15:24.583151+0000","last_fullsized":"2023-12-19T16:15:24.583151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589332+0000","last_change":"2023-12-19T16:15:20.583886+0000","last_active":"2023-12-19T16:15:24.589332+0000","last_peered":"2023-12-19T16:15:24.589332+0000","last_clean":"2023-12-19T16:15:24.589332+0000","last_became_active":"2023-12-19T16:15:20.583709+0000","last_became_peered":"2023-12-19T16:15:20.583709+0000","last_unstale":"2023-12-19T16:15:24.589332+0000","last_undegraded":"2023-12-19T16:15:24.589332+0000","last_fullsized":"2023-12-19T16:15:24.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591040+0000","last_change":"2023-12-19T16:15:20.611237+0000","last_active":"2023-12-19T16:15:24.591040+0000","last_peered":"2023-12-19T16:15:24.591040+0000","last_clean":"2023-12-19T16:15:24.591040+0000","last_became_active":"2023-12-19T16:15:20.610946+0000","last_became_peered":"2023-12-19T16:15:20.610946+0000","last_unstale":"2023-12-19T16:15:24.591040+0000","last_undegraded":"2023-12-19T16:15:24.591040+0000","last_fullsized":"2023-12-19T16:15:24.591040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616066+0000","last_change":"2023-12-19T16:15:20.602585+0000","last_active":"2023-12-19T16:15:24.616066+0000","last_peered":"2023-12-19T16:15:24.616066+0000","last_clean":"2023-12-19T16:15:24.616066+0000","last_became_active":"2023-12-19T16:15:20.602278+0000","last_became_peered":"2023-12-19T16:15:20.602278+0000","last_unstale":"2023-12-19T16:15:24.616066+0000","last_undegraded":"2023-12-19T16:15:24.616066+0000","last_fullsized":"2023-12-19T16:15:24.616066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586325+0000","last_change":"2023-12-19T16:15:20.602226+0000","last_active":"2023-12-19T16:15:24.586325+0000","last_peered":"2023-12-19T16:15:24.586325+0000","last_clean":"2023-12-19T16:15:24.586325+0000","last_became_active":"2023-12-19T16:15:20.601928+0000","last_became_peered":"2023-12-19T16:15:20.601928+0000","last_unstale":"2023-12-19T16:15:24.586325+0000","last_undegraded":"2023-12-19T16:15:24.586325+0000","last_fullsized":"2023-12-19T16:15:24.586325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.584077+0000","last_change":"2023-12-19T16:15:20.584639+0000","last_active":"2023-12-19T16:15:24.584077+0000","last_peered":"2023-12-19T16:15:24.584077+0000","last_clean":"2023-12-19T16:15:24.584077+0000","last_became_active":"2023-12-19T16:15:20.584426+0000","last_became_peered":"2023-12-19T16:15:20.584426+0000","last_unstale":"2023-12-19T16:15:24.584077+0000","last_undegraded":"2023-12-19T16:15:24.584077+0000","last_fullsized":"2023-12-19T16:15:24.584077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582785+0000","last_change":"2023-12-19T16:15:20.575948+0000","last_active":"2023-12-19T16:15:24.582785+0000","last_peered":"2023-12-19T16:15:24.582785+0000","last_clean":"2023-12-19T16:15:24.582785+0000","last_became_active":"2023-12-19T16:15:20.573675+0000","last_became_peered":"2023-12-19T16:15:20.573675+0000","last_unstale":"2023-12-19T16:15:24.582785+0000","last_undegraded":"2023-12-19T16:15:24.582785+0000","last_fullsized":"2023-12-19T16:15:24.582785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:23.787433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607444+0000","last_change":"2023-12-19T16:15:20.588200+0000","last_active":"2023-12-19T16:15:24.607444+0000","last_peered":"2023-12-19T16:15:24.607444+0000","last_clean":"2023-12-19T16:15:24.607444+0000","last_became_active":"2023-12-19T16:15:20.587984+0000","last_became_peered":"2023-12-19T16:15:20.587984+0000","last_unstale":"2023-12-19T16:15:24.607444+0000","last_undegraded":"2023-12-19T16:15:24.607444+0000","last_fullsized":"2023-12-19T16:15:24.607444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588501+0000","last_change":"2023-12-19T16:15:20.588750+0000","last_active":"2023-12-19T16:15:24.588501+0000","last_peered":"2023-12-19T16:15:24.588501+0000","last_clean":"2023-12-19T16:15:24.588501+0000","last_became_active":"2023-12-19T16:15:20.588398+0000","last_became_peered":"2023-12-19T16:15:20.588398+0000","last_unstale":"2023-12-19T16:15:24.588501+0000","last_undegraded":"2023-12-19T16:15:24.588501+0000","last_fullsized":"2023-12-19T16:15:24.588501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580194+0000","last_change":"2023-12-19T16:15:20.604284+0000","last_active":"2023-12-19T16:15:24.580194+0000","last_peered":"2023-12-19T16:15:24.580194+0000","last_clean":"2023-12-19T16:15:24.580194+0000","last_became_active":"2023-12-19T16:15:20.603889+0000","last_became_peered":"2023-12-19T16:15:20.603889+0000","last_unstale":"2023-12-19T16:15:24.580194+0000","last_undegraded":"2023-12-19T16:15:24.580194+0000","last_fullsized":"2023-12-19T16:15:24.580194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589849+0000","last_change":"2023-12-19T16:15:20.611693+0000","last_active":"2023-12-19T16:15:24.589849+0000","last_peered":"2023-12-19T16:15:24.589849+0000","last_clean":"2023-12-19T16:15:24.589849+0000","last_became_active":"2023-12-19T16:15:20.611287+0000","last_became_peered":"2023-12-19T16:15:20.611287+0000","last_unstale":"2023-12-19T16:15:24.589849+0000","last_undegraded":"2023-12-19T16:15:24.589849+0000","last_fullsized":"2023-12-19T16:15:24.589849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592587+0000","last_change":"2023-12-19T16:15:20.603377+0000","last_active":"2023-12-19T16:15:24.592587+0000","last_peered":"2023-12-19T16:15:24.592587+0000","last_clean":"2023-12-19T16:15:24.592587+0000","last_became_active":"2023-12-19T16:15:20.603157+0000","last_became_peered":"2023-12-19T16:15:20.603157+0000","last_unstale":"2023-12-19T16:15:24.592587+0000","last_undegraded":"2023-12-19T16:15:24.592587+0000","last_fullsized":"2023-12-19T16:15:24.592587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592770+0000","last_change":"2023-12-19T16:15:20.599480+0000","last_active":"2023-12-19T16:15:24.592770+0000","last_peered":"2023-12-19T16:15:24.592770+0000","last_clean":"2023-12-19T16:15:24.592770+0000","last_became_active":"2023-12-19T16:15:20.599204+0000","last_became_peered":"2023-12-19T16:15:20.599204+0000","last_unstale":"2023-12-19T16:15:24.592770+0000","last_undegraded":"2023-12-19T16:15:24.592770+0000","last_fullsized":"2023-12-19T16:15:24.592770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616342+0000","last_change":"2023-12-19T16:15:20.609122+0000","last_active":"2023-12-19T16:15:24.616342+0000","last_peered":"2023-12-19T16:15:24.616342+0000","last_clean":"2023-12-19T16:15:24.616342+0000","last_became_active":"2023-12-19T16:15:20.608840+0000","last_became_peered":"2023-12-19T16:15:20.608840+0000","last_unstale":"2023-12-19T16:15:24.616342+0000","last_undegraded":"2023-12-19T16:15:24.616342+0000","last_fullsized":"2023-12-19T16:15:24.616342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:01.062348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579734+0000","last_change":"2023-12-19T16:15:20.589707+0000","last_active":"2023-12-19T16:15:24.579734+0000","last_peered":"2023-12-19T16:15:24.579734+0000","last_clean":"2023-12-19T16:15:24.579734+0000","last_became_active":"2023-12-19T16:15:20.589430+0000","last_became_peered":"2023-12-19T16:15:20.589430+0000","last_unstale":"2023-12-19T16:15:24.579734+0000","last_undegraded":"2023-12-19T16:15:24.579734+0000","last_fullsized":"2023-12-19T16:15:24.579734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611868+0000","last_change":"2023-12-19T16:15:20.594142+0000","last_active":"2023-12-19T16:15:24.611868+0000","last_peered":"2023-12-19T16:15:24.611868+0000","last_clean":"2023-12-19T16:15:24.611868+0000","last_became_active":"2023-12-19T16:15:20.593842+0000","last_became_peered":"2023-12-19T16:15:20.593842+0000","last_unstale":"2023-12-19T16:15:24.611868+0000","last_undegraded":"2023-12-19T16:15:24.611868+0000","last_fullsized":"2023-12-19T16:15:24.611868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583063+0000","last_change":"2023-12-19T16:15:20.574706+0000","last_active":"2023-12-19T16:15:24.583063+0000","last_peered":"2023-12-19T16:15:24.583063+0000","last_clean":"2023-12-19T16:15:24.583063+0000","last_became_active":"2023-12-19T16:15:20.574376+0000","last_became_peered":"2023-12-19T16:15:20.574376+0000","last_unstale":"2023-12-19T16:15:24.583063+0000","last_undegraded":"2023-12-19T16:15:24.583063+0000","last_fullsized":"2023-12-19T16:15:24.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612667+0000","last_change":"2023-12-19T16:15:20.605920+0000","last_active":"2023-12-19T16:15:24.612667+0000","last_peered":"2023-12-19T16:15:24.612667+0000","last_clean":"2023-12-19T16:15:24.612667+0000","last_became_active":"2023-12-19T16:15:20.605610+0000","last_became_peered":"2023-12-19T16:15:20.605610+0000","last_unstale":"2023-12-19T16:15:24.612667+0000","last_undegraded":"2023-12-19T16:15:24.612667+0000","last_fullsized":"2023-12-19T16:15:24.612667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581912+0000","last_change":"2023-12-19T16:15:20.594793+0000","last_active":"2023-12-19T16:15:24.581912+0000","last_peered":"2023-12-19T16:15:24.581912+0000","last_clean":"2023-12-19T16:15:24.581912+0000","last_became_active":"2023-12-19T16:15:20.593463+0000","last_became_peered":"2023-12-19T16:15:20.593463+0000","last_unstale":"2023-12-19T16:15:24.581912+0000","last_undegraded":"2023-12-19T16:15:24.581912+0000","last_fullsized":"2023-12-19T16:15:24.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588263+0000","last_change":"2023-12-19T16:15:20.590564+0000","last_active":"2023-12-19T16:15:24.588263+0000","last_peered":"2023-12-19T16:15:24.588263+0000","last_clean":"2023-12-19T16:15:24.588263+0000","last_became_active":"2023-12-19T16:15:20.590320+0000","last_became_peered":"2023-12-19T16:15:20.590320+0000","last_unstale":"2023-12-19T16:15:24.588263+0000","last_undegraded":"2023-12-19T16:15:24.588263+0000","last_fullsized":"2023-12-19T16:15:24.588263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609610+0000","last_change":"2023-12-19T16:15:20.603717+0000","last_active":"2023-12-19T16:15:24.609610+0000","last_peered":"2023-12-19T16:15:24.609610+0000","last_clean":"2023-12-19T16:15:24.609610+0000","last_became_active":"2023-12-19T16:15:20.603426+0000","last_became_peered":"2023-12-19T16:15:20.603426+0000","last_unstale":"2023-12-19T16:15:24.609610+0000","last_undegraded":"2023-12-19T16:15:24.609610+0000","last_fullsized":"2023-12-19T16:15:24.609610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616243+0000","last_change":"2023-12-19T16:15:20.614781+0000","last_active":"2023-12-19T16:15:24.616243+0000","last_peered":"2023-12-19T16:15:24.616243+0000","last_clean":"2023-12-19T16:15:24.616243+0000","last_became_active":"2023-12-19T16:15:20.614271+0000","last_became_peered":"2023-12-19T16:15:20.614271+0000","last_unstale":"2023-12-19T16:15:24.616243+0000","last_undegraded":"2023-12-19T16:15:24.616243+0000","last_fullsized":"2023-12-19T16:15:24.616243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:15:44.655 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T16:15:44.655 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T16:15:44.655 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T16:15:44.655 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T16:15:44.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.827+0000 7f591b866640 1 Processor -- start 2023-12-19T16:15:44.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f591b866640 1 -- start start 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f591b866640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59141570c0 0x7f591406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f591b866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59140ca000 0x7f5914070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f591b866640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59140c9460 con 0x7f591406c320 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f591b866640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591406c7a0 con 0x7f59141570c0 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f591b866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59141574a0 con 0x7f59140ca000 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5919602640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59141570c0 0x7f591406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5918e01640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f591406c320 0x7f59140c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59448/0 (socket says 172.21.15.119:59448) 2023-12-19T16:15:44.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5918e01640 1 -- 172.21.15.119:0/1964899163 learned_addr learned my addr 172.21.15.119:0/1964899163 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:44.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5919e03640 1 --2- 172.21.15.119:0/1964899163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59140ca000 0x7f5914070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5919602640 1 -- 172.21.15.119:0/1964899163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59140ca000 msgr2=0x7f5914070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f590bfff640 1 -- 172.21.15.119:0/1964899163 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186867940 0 0) 0x7f59140c9460 con 0x7f591406c320 2023-12-19T16:15:44.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5919602640 1 --2- 172.21.15.119:0/1964899163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59140ca000 0x7f5914070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5919602640 1 -- 172.21.15.119:0/1964899163 >> v1:172.21.15.119:6789/0 conn(0x7f591406c320 legacy=0x7f59140c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.831+0000 7f5919602640 1 -- 172.21.15.119:0/1964899163 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140c8b30 con 0x7f59141570c0 2023-12-19T16:15:44.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f5919602640 1 --2- 172.21.15.119:0/1964899163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59141570c0 0x7f591406bde0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f59100097c0 tx=0x7f591001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5948fc7628af45 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f590bfff640 1 -- 172.21.15.119:0/1964899163 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100ac620 con 0x7f59141570c0 2023-12-19T16:15:44.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f590bfff640 1 -- 172.21.15.119:0/1964899163 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59100ac780 con 0x7f59141570c0 2023-12-19T16:15:44.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f590bfff640 1 -- 172.21.15.119:0/1964899163 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100acb10 con 0x7f59141570c0 2023-12-19T16:15:44.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 -- 172.21.15.119:0/1964899163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59141570c0 msgr2=0x7f591406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 --2- 172.21.15.119:0/1964899163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59141570c0 0x7f591406bde0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f59100097c0 tx=0x7f591001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 -- 172.21.15.119:0/1964899163 shutdown_connections 2023-12-19T16:15:44.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 --2- 172.21.15.119:0/1964899163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59140ca000 0x7f5914070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 --2- 172.21.15.119:0/1964899163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59141570c0 0x7f591406bde0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 -- 172.21.15.119:0/1964899163 >> 172.21.15.119:0/1964899163 conn(0x7f591406a3e0 msgr2=0x7f59140afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 -- 172.21.15.119:0/1964899163 shutdown_connections 2023-12-19T16:15:44.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 -- 172.21.15.119:0/1964899163 wait complete. 2023-12-19T16:15:44.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.835+0000 7f591b866640 1 Processor -- start 2023-12-19T16:15:44.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- start start 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 0x7f5914147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59140ca000 0x7f59140caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59141570c0 0x7f59141460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59141581a0 con 0x7f591406c320 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5914158480 con 0x7f59140ca000 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5914158760 con 0x7f59141570c0 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 0x7f5914147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 0x7f5914147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56552/0 (socket says 172.21.15.119:56552) 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 -- 172.21.15.119:0/1252654896 learned_addr learned my addr 172.21.15.119:0/1252654896 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 -- 172.21.15.119:0/1252654896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59141570c0 msgr2=0x7f59141460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59141570c0 0x7f59141460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 -- 172.21.15.119:0/1252654896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59140ca000 msgr2=0x7f59140caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59140ca000 0x7f59140caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 -- 172.21.15.119:0/1252654896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910009420 con 0x7f591406c320 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5919602640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 0x7f5914147820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5910000c10 tx=0x7f591001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100ac620 con 0x7f591406c320 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910006e20 con 0x7f591406c320 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910004230 con 0x7f591406c320 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5914158a40 con 0x7f591406c320 2023-12-19T16:15:44.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5914146ae0 con 0x7f591406c320 2023-12-19T16:15:44.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.839+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59140735b0 con 0x7f591406c320 2023-12-19T16:15:44.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.843+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59100aa070 con 0x7f591406c320 2023-12-19T16:15:44.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.843+0000 7f5909ffb640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f58f8065a60 0x7f58f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.843+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f591011de30 con 0x7f591406c320 2023-12-19T16:15:44.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.843+0000 7f5918e01640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f58f8065a60 0x7f58f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.843+0000 7f5918e01640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f58f8065a60 0x7f58f8067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5914147f40 tx=0x7f5904007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:44.847+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f59100eb460 con 0x7f591406c320 2023-12-19T16:15:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.035+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f591404e000 con 0x7f591406c320 2023-12-19T16:15:45.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.039+0000 7f5909ffb640 1 -- 172.21.15.119:0/1252654896 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163369 (secure 0 0 0) 0x7f59100bb090 con 0x7f591406c320 2023-12-19T16:15:45.044 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f58f8065a60 msgr2=0x7f58f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f58f8065a60 0x7f58f8067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5914147f40 tx=0x7f5904007970 comp rx=0 tx=0).stop 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 msgr2=0x7f5914147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 0x7f5914147820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5910000c10 tx=0x7f591001ac00 comp rx=0 tx=0).stop 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 shutdown_connections 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f58f8065a60 0x7f58f8067f20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59140ca000 0x7f59140caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59141570c0 0x7f59141460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 --2- 172.21.15.119:0/1252654896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f591406c320 0x7f5914147820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 >> 172.21.15.119:0/1252654896 conn(0x7f591406a3e0 msgr2=0x7f591414c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 shutdown_connections 2023-12-19T16:15:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.043+0000 7f591b866640 1 -- 172.21.15.119:0/1252654896 wait complete. 2023-12-19T16:15:45.064 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":38078},{"type":"v1","addr":"172.21.15.119:6833","nonce":38078}]},"active_addr":"172.21.15.119:6833/38078","active_change":"2023-12-19T16:15:00.432975+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":305125021}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3665260130}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2930442789}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2625387627}]}]} 2023-12-19T16:15:45.068 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T16:15:45.068 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T16:15:45.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:45.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 Processor -- start 2023-12-19T16:15:45.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 -- start start 2023-12-19T16:15:45.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 0x7f9c940cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c941648d0 0x7f9c94166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940cfa70 con 0x7f9c9415ca40 2023-12-19T16:15:45.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c940d11c0 con 0x7f9c940cf0d0 2023-12-19T16:15:45.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9aad1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940d0310 con 0x7f9c941648d0 2023-12-19T16:15:45.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c93fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 0x7f9c940cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c93fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 0x7f9c940cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34074/0 (socket says 172.21.15.119:34074) 2023-12-19T16:15:45.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9906e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c941648d0 0x7f9c94166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c93fff640 1 -- 172.21.15.119:0/1623975110 learned_addr learned my addr 172.21.15.119:0/1623975110 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9906e640 1 -- 172.21.15.119:0/1623975110 >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 msgr2=0x7f9c940cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9906e640 1 --2- 172.21.15.119:0/1623975110 >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 0x7f9c940cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9906e640 1 -- 172.21.15.119:0/1623975110 >> v1:172.21.15.143:6789/0 conn(0x7f9c9415ca40 legacy=0x7f9c940cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c9906e640 1 -- 172.21.15.119:0/1623975110 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940d05b0 con 0x7f9c941648d0 2023-12-19T16:15:45.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.203+0000 7f9c93fff640 1 --2- 172.21.15.119:0/1623975110 >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 0x7f9c940cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:45.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.207+0000 7f9c9906e640 1 --2- 172.21.15.119:0/1623975110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c941648d0 0x7f9c94166cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0097c0 tx=0x7f9c8c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a905d908d9c5a2b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c937fe640 1 -- 172.21.15.119:0/1623975110 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0ab650 con 0x7f9c941648d0 2023-12-19T16:15:45.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c937fe640 1 -- 172.21.15.119:0/1623975110 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0ab7b0 con 0x7f9c941648d0 2023-12-19T16:15:45.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c937fe640 1 -- 172.21.15.119:0/1623975110 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0abb40 con 0x7f9c941648d0 2023-12-19T16:15:45.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 -- 172.21.15.119:0/1623975110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c941648d0 msgr2=0x7f9c94166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/1623975110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c941648d0 0x7f9c94166cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0097c0 tx=0x7f9c8c01c450 comp rx=0 tx=0).stop 2023-12-19T16:15:45.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 -- 172.21.15.119:0/1623975110 shutdown_connections 2023-12-19T16:15:45.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/1623975110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c941648d0 0x7f9c94166cc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/1623975110 >> v2:172.21.15.143:3300/0 conn(0x7f9c940cf0d0 0x7f9c940cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 -- 172.21.15.119:0/1623975110 >> 172.21.15.119:0/1623975110 conn(0x7f9c94089fb0 msgr2=0x7f9c940d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 -- 172.21.15.119:0/1623975110 shutdown_connections 2023-12-19T16:15:45.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.211+0000 7f9c9aad1640 1 -- 172.21.15.119:0/1623975110 wait complete. 2023-12-19T16:15:45.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 Processor -- start 2023-12-19T16:15:45.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- start start 2023-12-19T16:15:45.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c940cf0d0 0x7f9c94157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c9415ca40 0x7f9c941579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 0x7f9c9415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94164e50 con 0x7f9c941648d0 2023-12-19T16:15:45.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94165130 con 0x7f9c9415ca40 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94165410 con 0x7f9c940cf0d0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 0x7f9c9415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 0x7f9c9415eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56560/0 (socket says 172.21.15.119:56560) 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 -- 172.21.15.119:0/4212178714 learned_addr learned my addr 172.21.15.119:0/4212178714 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9886d640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c940cf0d0 0x7f9c94157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c93fff640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c9415ca40 0x7f9c941579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 -- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c940cf0d0 msgr2=0x7f9c94157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c940cf0d0 0x7f9c94157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 -- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c9415ca40 msgr2=0x7f9c941579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c9415ca40 0x7f9c941579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 -- 172.21.15.119:0/4212178714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009480 con 0x7f9c941648d0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9906e640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 0x7f9c9415eed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c01ab00 tx=0x7f9c8c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0abdf0 con 0x7f9c941648d0 2023-12-19T16:15:45.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0bf450 con 0x7f9c941648d0 2023-12-19T16:15:45.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0bf800 con 0x7f9c941648d0 2023-12-19T16:15:45.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c009420 con 0x7f9c941648d0 2023-12-19T16:15:45.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c94155eb0 con 0x7f9c941648d0 2023-12-19T16:15:45.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.215+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c941560a0 con 0x7f9c941648d0 2023-12-19T16:15:45.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.219+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c8c0bf960 con 0x7f9c941648d0 2023-12-19T16:15:45.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.219+0000 7f9c917fa640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9c78065a60 0x7f9c78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.219+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c8c11df00 con 0x7f9c941648d0 2023-12-19T16:15:45.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.219+0000 7f9c9886d640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9c78065a60 0x7f9c78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.219+0000 7f9c9886d640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9c78065a60 0x7f9c78067f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9c88001340 tx=0x7f9c88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.223+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9c8c0eb7a0 con 0x7f9c941648d0 2023-12-19T16:15:45.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.375+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c94164f90 con 0x7f9c941648d0 2023-12-19T16:15:45.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c917fa640 1 -- 172.21.15.119:0/4212178714 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f9c94164f90 con 0x7f9c941648d0 2023-12-19T16:15:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:45.381 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9c78065a60 msgr2=0x7f9c78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9c78065a60 0x7f9c78067f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9c88001340 tx=0x7f9c88009040 comp rx=0 tx=0).stop 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 msgr2=0x7f9c9415eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 0x7f9c9415eed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c01ab00 tx=0x7f9c8c0191f0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 shutdown_connections 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9c78065a60 0x7f9c78067f20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c9415ca40 0x7f9c941579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c941648d0 0x7f9c9415eed0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 --2- 172.21.15.119:0/4212178714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c940cf0d0 0x7f9c94157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 >> 172.21.15.119:0/4212178714 conn(0x7f9c94089fb0 msgr2=0x7f9c9415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 shutdown_connections 2023-12-19T16:15:45.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.379+0000 7f9c9aad1640 1 -- 172.21.15.119:0/4212178714 wait complete. 2023-12-19T16:15:45.402 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T16:15:45.402 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.535+0000 7f45b216d640 1 Processor -- start 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.535+0000 7f45b216d640 1 -- start start 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45b216d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac0cb180 0x7f45ac070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45b216d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac070b80 con 0x7f45ac158c20 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45b216d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac070e60 con 0x7f45ac15c800 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45b216d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac071140 con 0x7f45ac0cb180 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45ab7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f45ac158c20 0x7f45ac0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59454/0 (socket says 172.21.15.119:59454) 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45ab7fe640 1 -- 172.21.15.119:0/148905748 learned_addr learned my addr 172.21.15.119:0/148905748 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aaffd640 1 --2- 172.21.15.119:0/148905748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac0cb180 0x7f45ac070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aa7fc640 1 -- 172.21.15.119:0/148905748 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192765832 0 0) 0x7f45ac070b80 con 0x7f45ac158c20 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aa7fc640 1 -- 172.21.15.119:0/148905748 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4594003450 con 0x7f45ac158c20 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aaffd640 1 -- 172.21.15.119:0/148905748 >> v1:172.21.15.143:6789/0 conn(0x7f45ac15c800 legacy=0x7f45ac0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aa7fc640 1 -- 172.21.15.119:0/148905748 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436825931 0 0) 0x7f45ac070e60 con 0x7f45ac15c800 2023-12-19T16:15:45.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aaffd640 1 -- 172.21.15.119:0/148905748 >> v1:172.21.15.119:6789/0 conn(0x7f45ac158c20 legacy=0x7f45ac0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.539+0000 7f45aaffd640 1 -- 172.21.15.119:0/148905748 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac071420 con 0x7f45ac0cb180 2023-12-19T16:15:45.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45aaffd640 1 --2- 172.21.15.119:0/148905748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac0cb180 0x7f45ac070510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f45a00097f0 tx=0x7f45a001ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd86ad8633bdd292 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45aa7fc640 1 -- 172.21.15.119:0/148905748 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00ac600 con 0x7f45ac0cb180 2023-12-19T16:15:45.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45aa7fc640 1 -- 172.21.15.119:0/148905748 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a00a8050 con 0x7f45ac0cb180 2023-12-19T16:15:45.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45aa7fc640 1 -- 172.21.15.119:0/148905748 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00ac980 con 0x7f45ac0cb180 2023-12-19T16:15:45.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 -- 172.21.15.119:0/148905748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac0cb180 msgr2=0x7f45ac070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 --2- 172.21.15.119:0/148905748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac0cb180 0x7f45ac070510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f45a00097f0 tx=0x7f45a001ce60 comp rx=0 tx=0).stop 2023-12-19T16:15:45.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 -- 172.21.15.119:0/148905748 shutdown_connections 2023-12-19T16:15:45.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 --2- 172.21.15.119:0/148905748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac0cb180 0x7f45ac070510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 -- 172.21.15.119:0/148905748 >> 172.21.15.119:0/148905748 conn(0x7f45ac06a3e0 msgr2=0x7f45ac0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 -- 172.21.15.119:0/148905748 shutdown_connections 2023-12-19T16:15:45.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 -- 172.21.15.119:0/148905748 wait complete. 2023-12-19T16:15:45.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 Processor -- start 2023-12-19T16:15:45.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.543+0000 7f45b216d640 1 -- start start 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45ac0cb180 0x7f45ac0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac158c20 0x7f45ac1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 0x7f45ac14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac159a70 con 0x7f45ac15c800 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0af930 con 0x7f45ac0cb180 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac15c0b0 con 0x7f45ac158c20 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 0x7f45ac14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 0x7f45ac14d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56574/0 (socket says 172.21.15.119:56574) 2023-12-19T16:15:45.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 -- 172.21.15.119:0/4163170016 learned_addr learned my addr 172.21.15.119:0/4163170016 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45ab7fe640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45ac0cb180 0x7f45ac0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45aaffd640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac158c20 0x7f45ac1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 -- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac158c20 msgr2=0x7f45ac1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac158c20 0x7f45ac1520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 -- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45ac0cb180 msgr2=0x7f45ac0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45ac0cb180 0x7f45ac0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 -- 172.21.15.119:0/4163170016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009420 con 0x7f45ac15c800 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45abfff640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 0x7f45ac14d970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f45a4002240 tx=0x7f45a400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4003db0 con 0x7f45ac15c800 2023-12-19T16:15:45.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a400ce30 con 0x7f45ac15c800 2023-12-19T16:15:45.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0c8800 con 0x7f45ac15c800 2023-12-19T16:15:45.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4005270 con 0x7f45ac15c800 2023-12-19T16:15:45.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac1593b0 con 0x7f45ac15c800 2023-12-19T16:15:45.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0735b0 con 0x7f45ac15c800 2023-12-19T16:15:45.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.547+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45a40053d0 con 0x7f45ac15c800 2023-12-19T16:15:45.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.551+0000 7f4593fff640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4598065a60 0x7f4598067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.551+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45a4082b60 con 0x7f45ac15c800 2023-12-19T16:15:45.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.551+0000 7f45ab7fe640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4598065a60 0x7f4598067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.551+0000 7f45ab7fe640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4598065a60 0x7f4598067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f459c007fd0 tx=0x7f459c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.551+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45a40502d0 con 0x7f45ac15c800 2023-12-19T16:15:45.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.703+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45ac159bb0 con 0x7f45ac15c800 2023-12-19T16:15:45.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f4593fff640 1 -- 172.21.15.119:0/4163170016 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f45ac159bb0 con 0x7f45ac15c800 2023-12-19T16:15:45.709 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:45.709 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:45.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4598065a60 msgr2=0x7f4598067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4598065a60 0x7f4598067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f459c007fd0 tx=0x7f459c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:45.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 msgr2=0x7f45ac14d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 0x7f45ac14d970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f45a4002240 tx=0x7f45a400cbe0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 shutdown_connections 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4598065a60 0x7f4598067f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45ac15c800 0x7f45ac14d970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45ac158c20 0x7f45ac1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 --2- 172.21.15.119:0/4163170016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45ac0cb180 0x7f45ac0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 >> 172.21.15.119:0/4163170016 conn(0x7f45ac06a3e0 msgr2=0x7f45ac156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 shutdown_connections 2023-12-19T16:15:45.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.707+0000 7f45b216d640 1 -- 172.21.15.119:0/4163170016 wait complete. 2023-12-19T16:15:45.731 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T16:15:45.732 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T16:15:45.732 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T16:15:45.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T16:15:45.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T16:15:45.734 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T16:15:45.734 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T16:15:45.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T16:15:45.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 Processor -- start 2023-12-19T16:15:45.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 -- start start 2023-12-19T16:15:45.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbbd00c17e0 0x7fbbd00ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbbd00cd050 0x7fbbd006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd00c9530 con 0x7fbbd00c9150 2023-12-19T16:15:45.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd0164d30 con 0x7fbbd00c17e0 2023-12-19T16:15:45.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbd48fc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd01654e0 con 0x7fbbd00cd050 2023-12-19T16:15:45.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbced9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbbd00cd050 0x7fbbd006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbced9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbbd00cd050 0x7fbbd006fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34112/0 (socket says 172.21.15.119:34112) 2023-12-19T16:15:45.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbced9d640 1 -- 172.21.15.119:0/15676854 learned_addr learned my addr 172.21.15.119:0/15676854 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.971+0000 7fbbcdd9b640 1 --2- 172.21.15.119:0/15676854 >> v2:172.21.15.119:3300/0 conn(0x7fbbd00c17e0 0x7fbbd00ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299628233 0 0) 0x7fbbc4001120 con 0x7fbbd00c9150 2023-12-19T16:15:45.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb8003530 con 0x7fbbd00c9150 2023-12-19T16:15:45.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088561730 0 0) 0x7fbbb8003530 con 0x7fbbd00c9150 2023-12-19T16:15:45.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 >> v2:172.21.15.143:3300/0 conn(0x7fbbd00cd050 msgr2=0x7fbbd006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 --2- 172.21.15.119:0/15676854 >> v2:172.21.15.143:3300/0 conn(0x7fbbd00cd050 0x7fbbd006fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 >> v2:172.21.15.119:3300/0 conn(0x7fbbd00c17e0 msgr2=0x7fbbd00ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 --2- 172.21.15.119:0/15676854 >> v2:172.21.15.119:3300/0 conn(0x7fbbd00c17e0 0x7fbbd00ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0164f20 con 0x7fbbd00c9150 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcdd9b640 1 --2- 172.21.15.119:0/15676854 >> v2:172.21.15.119:3300/0 conn(0x7fbbd00c17e0 0x7fbbd00ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fbbc4001810 con 0x7fbbd00c9150 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 >> v1:172.21.15.119:6789/0 conn(0x7fbbd00c9150 legacy=0x7fbbd0164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbb8003980 0x7fbbb8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb80047d0 0x7fbbb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb8005190 0x7fbbb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01654e0 con 0x7fbbb8005190 2023-12-19T16:15:45.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb800bed0 con 0x7fbbb8003980 2023-12-19T16:15:45.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb800c060 con 0x7fbbb80047d0 2023-12-19T16:15:45.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbced9d640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb8005190 0x7fbbb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbcdd9b640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb80047d0 0x7fbbb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fa7de266640 1 Processor -- start 2023-12-19T16:15:45.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fa7de266640 1 -- start start 2023-12-19T16:15:45.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbced9d640 1 -- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb80047d0 msgr2=0x7fbbb8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbced9d640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb80047d0 0x7fbbb8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbced9d640 1 -- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbb8003980 msgr2=0x7fbbb8003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T16:15:45.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbced9d640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbb8003980 0x7fbbb8003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.975+0000 7fbbced9d640 1 -- 172.21.15.119:0/15676854 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8003530 con 0x7fbbb8005190 2023-12-19T16:15:45.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7de266640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7d80c9190 0x7fa7d806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7de266640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d80703a0 con 0x7fa7d80cd000 2023-12-19T16:15:45.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7de266640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d80cdaa0 con 0x7fa7d80b0770 2023-12-19T16:15:45.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7de266640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d80cdd80 con 0x7fa7d80c9190 2023-12-19T16:15:45.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7f660062d640 1 Processor -- start 2023-12-19T16:15:45.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7d77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7d80c9190 0x7fa7d806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7d77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7d80c9190 0x7fa7d806fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34124/0 (socket says 172.21.15.119:34124) 2023-12-19T16:15:45.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7d77fe640 1 -- 172.21.15.119:0/1201906092 learned_addr learned my addr 172.21.15.119:0/1201906092 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7f660062d640 1 -- start start 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fbbced9d640 1 -- 172.21.15.119:0/15676854 reap_dead start 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fbbced9d640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb8005190 0x7fbbb800b990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800e1c0 tx=0x7fbbc801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982f161315ea8223 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7f660062d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65f80c1280 0x7f65f80cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7f660062d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f806fdb0 con 0x7f65f8160cc0 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7f660062d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f8164820 con 0x7f65f80cb340 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7f660062d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f81654a0 con 0x7f65f80c1280 2023-12-19T16:15:45.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f65f80cb340 0x7f65f80cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:35380/0 (socket says 172.21.15.119:35380) 2023-12-19T16:15:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 -- 172.21.15.119:0/241930481 learned_addr learned my addr 172.21.15.119:0/241930481 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7d77fe640 1 -- 172.21.15.119:0/1201906092 >> v1:172.21.15.143:6789/0 conn(0x7fa7d80b0770 legacy=0x7fa7d80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7d77fe640 1 -- 172.21.15.119:0/1201906092 >> v1:172.21.15.119:6789/0 conn(0x7fa7d80cd000 legacy=0x7fa7d80c8a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:15:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.979+0000 7fa7d77fe640 1 -- 172.21.15.119:0/1201906092 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d806da30 con 0x7fa7d80c9190 2023-12-19T16:15:45.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80a5b50 con 0x7fbbb8005190 2023-12-19T16:15:45.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800f040 con 0x7fbbb8005190 2023-12-19T16:15:45.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbcd59a640 1 -- 172.21.15.119:0/15676854 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80039a0 con 0x7fbbb8005190 2023-12-19T16:15:45.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388933570 0 0) 0x7f65f8164820 con 0x7f65f80cb340 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e4003530 con 0x7f65f80cb340 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587412209 0 0) 0x7f65e4003530 con 0x7f65f80cb340 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 -- 172.21.15.119:0/15676854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb8005190 msgr2=0x7fbbb800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb8005190 0x7fbbb800b990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800e1c0 tx=0x7fbbc801cd60 comp rx=0 tx=0).stop 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 >> v2:172.21.15.119:3300/0 conn(0x7f65f80c1280 msgr2=0x7f65f80cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 --2- 172.21.15.119:0/241930481 >> v2:172.21.15.119:3300/0 conn(0x7f65f80c1280 0x7f65f80cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 >> v1:172.21.15.119:6789/0 conn(0x7f65f8160cc0 legacy=0x7f65f80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8164b00 con 0x7f65f80cb340 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f65f0001a00 con 0x7f65f80cb340 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 >> v1:172.21.15.143:6789/0 conn(0x7f65f80cb340 legacy=0x7f65f80cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4003980 0x7f65e4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e40047d0 0x7f65e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65e4005390 0x7f65e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81654a0 con 0x7f65e4003980 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e400c230 con 0x7f65e4005390 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e400c3f0 con 0x7f65e40047d0 2023-12-19T16:15:45.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 -- 172.21.15.119:0/15676854 shutdown_connections 2023-12-19T16:15:45.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 --2- 172.21.15.119:0/15676854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb8005190 0x7fbbb800b990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 -- 172.21.15.119:0/15676854 >> 172.21.15.119:0/15676854 conn(0x7fbbd006a2a0 msgr2=0x7fbbd00cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65e4005390 0x7f65e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 -- 172.21.15.119:0/15676854 shutdown_connections 2023-12-19T16:15:45.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 -- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e40047d0 msgr2=0x7f65e4004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T16:15:45.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e40047d0 0x7f65e4004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 -- 172.21.15.119:0/241930481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4003980 msgr2=0x7f65e4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65e4003980 0x7f65e4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7f65febca640 1 -- 172.21.15.119:0/241930481 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8164b00 con 0x7f65e4005390 2023-12-19T16:15:45.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.983+0000 7fbbd48fc640 1 -- 172.21.15.119:0/15676854 wait complete. 2023-12-19T16:15:45.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7d77fe640 1 --2- 172.21.15.119:0/1201906092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d806fe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009870 tx=0x7fa7c801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76b5e9e167790b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fd4ef16d640 1 Processor -- start 2023-12-19T16:15:45.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 Processor -- start 2023-12-19T16:15:45.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7d6ffd640 1 -- 172.21.15.119:0/1201906092 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80ab610 con 0x7fa7d80c9190 2023-12-19T16:15:45.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7d6ffd640 1 -- 172.21.15.119:0/1201906092 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80ab770 con 0x7fa7d80c9190 2023-12-19T16:15:45.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7d6ffd640 1 -- 172.21.15.119:0/1201906092 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80abb00 con 0x7fa7d80c9190 2023-12-19T16:15:45.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 -- start start 2023-12-19T16:15:45.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fd4ef16d640 1 -- start start 2023-12-19T16:15:45.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7f457e56d640 1 Processor -- start 2023-12-19T16:15:45.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7f457e56d640 1 -- start start 2023-12-19T16:15:45.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb8005190 0x7fbbd00b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd01429f0 0x7fbbd00c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7de266640 1 -- 172.21.15.119:0/1201906092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 msgr2=0x7fa7d806fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7de266640 1 --2- 172.21.15.119:0/1201906092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d806fe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009870 tx=0x7fa7c801c520 comp rx=0 tx=0).stop 2023-12-19T16:15:45.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd0142e70 0x7fbbd00c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00b3e20 con 0x7fbbd0142e70 2023-12-19T16:15:45.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0070520 con 0x7fbbd01429f0 2023-12-19T16:15:45.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fbbd48fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00b1280 con 0x7fbbb8005190 2023-12-19T16:15:45.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fd4ef16d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 0x7fd4e80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fd4ef16d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4e80ce3f0 0x7fd4e80cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7f65febca640 1 -- 172.21.15.119:0/241930481 reap_dead start 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7de266640 1 -- 172.21.15.119:0/1201906092 shutdown_connections 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7de266640 1 --2- 172.21.15.119:0/1201906092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d806fe60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.987+0000 7fa7de266640 1 -- 172.21.15.119:0/1201906092 >> 172.21.15.119:0/1201906092 conn(0x7fa7d80afc80 msgr2=0x7fa7d80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd01429f0 0x7fbbd00c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbce59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb8005190 0x7fbbd00b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd01429f0 0x7fbbd00c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34144/0 (socket says 172.21.15.119:34144) 2023-12-19T16:15:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 -- 172.21.15.119:0/1587419880 learned_addr learned my addr 172.21.15.119:0/1587419880 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f65febca640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65e4005390 0x7f65e400b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65f000a8b0 tx=0x7f65f001d3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e65d26f44540d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbced9d640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd0142e70 0x7fbbd00c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00ac620 con 0x7f65e4005390 2023-12-19T16:15:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ef16d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80cfa70 con 0x7fd4e80cf610 2023-12-19T16:15:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 0x7fd4e80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 0x7fd4e80cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51258/0 (socket says 172.21.15.119:51258) 2023-12-19T16:15:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3829376164 learned_addr learned my addr 172.21.15.119:0/3829376164 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f00a8070 con 0x7f65e4005390 2023-12-19T16:15:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80d11c0 con 0x7fd4e80ce3f0 2023-12-19T16:15:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80d0310 con 0x7fd4e815ca40 2023-12-19T16:15:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 -- 172.21.15.119:0/1587419880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb8005190 msgr2=0x7fbbd00b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb8005190 0x7fbbd00b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 -- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd0142e70 msgr2=0x7fbbd00c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457e56d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 0x7f4578070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd0142e70 0x7fbbd00c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 -- 172.21.15.119:0/1587419880 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0071060 con 0x7fbbd01429f0 2023-12-19T16:15:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbced9d640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd0142e70 0x7fbbd00c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457e56d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f457815c800 0x7f45780ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbce59c640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbb8005190 0x7fbbd00b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457e56d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4578070b80 con 0x7f4578158c20 2023-12-19T16:15:46.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457e56d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4578070e60 con 0x7f457815c800 2023-12-19T16:15:46.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457e56d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4578071140 con 0x7f45780cb180 2023-12-19T16:15:46.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fa7de266640 1 -- 172.21.15.119:0/1201906092 shutdown_connections 2023-12-19T16:15:46.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fa7de266640 1 -- 172.21.15.119:0/1201906092 wait complete. 2023-12-19T16:15:46.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbcdd9b640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd01429f0 0x7fbbd00c3c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0011930 tx=0x7fbbc0011df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f65fd3c7640 1 -- 172.21.15.119:0/241930481 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00aca00 con 0x7f65e4005390 2023-12-19T16:15:46.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4e7fff640 1 --2- 172.21.15.119:0/3829376164 >> v2:172.21.15.119:3300/0 conn(0x7fd4e80ce3f0 0x7fd4e80cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3829376164 >> v2:172.21.15.119:3300/0 conn(0x7fd4e80ce3f0 msgr2=0x7fd4e80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 0x7f4578070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 0x7f4578070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51270/0 (socket says 172.21.15.119:51270) 2023-12-19T16:15:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 -- 172.21.15.119:0/107578768 learned_addr learned my addr 172.21.15.119:0/107578768 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457cb0a640 1 --2- 172.21.15.119:0/107578768 >> v2:172.21.15.143:3300/0 conn(0x7f457815c800 0x7f45780ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fa7de266640 1 Processor -- start 2023-12-19T16:15:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 -- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65e4005390 msgr2=0x7f65e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65e4005390 0x7f65e400b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65f000a8b0 tx=0x7f65f001d3a0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0009650 con 0x7fbbd01429f0 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000fbd0 con 0x7fbbd01429f0 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0015460 con 0x7fbbd01429f0 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 -- 172.21.15.119:0/241930481 shutdown_connections 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 --2- 172.21.15.119:0/241930481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65e4005390 0x7f65e400b990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 -- 172.21.15.119:0/241930481 >> 172.21.15.119:0/241930481 conn(0x7f65f806a3e0 msgr2=0x7f65f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 -- 172.21.15.119:0/107578768 >> v2:172.21.15.143:3300/0 conn(0x7f457815c800 msgr2=0x7f45780ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 --2- 172.21.15.119:0/107578768 >> v2:172.21.15.143:3300/0 conn(0x7f457815c800 0x7f45780ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 -- 172.21.15.119:0/107578768 >> v1:172.21.15.119:6789/0 conn(0x7f4578158c20 legacy=0x7f45780caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 -- 172.21.15.119:0/241930481 shutdown_connections 2023-12-19T16:15:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f45777fe640 1 -- 172.21.15.119:0/107578768 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4578071420 con 0x7f45780cb180 2023-12-19T16:15:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f660062d640 1 -- 172.21.15.119:0/241930481 wait complete. 2023-12-19T16:15:46.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fa7de266640 1 -- start start 2023-12-19T16:15:46.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7f457cb0a640 1 --2- 172.21.15.119:0/107578768 >> v2:172.21.15.143:3300/0 conn(0x7f457815c800 0x7f45780ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd0070730 con 0x7fbbd01429f0 2023-12-19T16:15:46.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd0070cf0 con 0x7fbbd01429f0 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80b0770 0x7fa7d80b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbd00cc310 con 0x7fbbd01429f0 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d80b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7d80cd000 0x7fa7d80b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81501b0 con 0x7fa7d80b0770 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d815b000 con 0x7fa7d80c9190 2023-12-19T16:15:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d815b2e0 con 0x7fa7d80cd000 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 Processor -- start 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80b0770 0x7fa7d80b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80b0770 0x7fa7d80b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56674/0 (socket says 172.21.15.119:56674) 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d7fff640 1 -- 172.21.15.119:0/2969159442 learned_addr learned my addr 172.21.15.119:0/2969159442 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7dc803640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7d80cd000 0x7fa7d80b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d80b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 --2- 172.21.15.119:0/3829376164 >> v2:172.21.15.119:3300/0 conn(0x7fd4e80ce3f0 0x7fd4e80cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3829376164 >> v1:172.21.15.119:6789/0 conn(0x7fd4e80cf610 legacy=0x7fd4e81605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.991+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3829376164 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80d05b0 con 0x7fd4e815ca40 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 -- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7d80cd000 msgr2=0x7fa7d80b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7d80cd000 0x7fa7d80b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 -- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80b0770 msgr2=0x7fa7d80b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80b0770 0x7fa7d80b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 -- 172.21.15.119:0/2969159442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80094d0 con 0x7fa7d80c9190 2023-12-19T16:15:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7dc803640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7d80cd000 0x7fa7d80b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fd4e7fff640 1 --2- 172.21.15.119:0/3829376164 >> v2:172.21.15.119:3300/0 conn(0x7fd4e80ce3f0 0x7fd4e80cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fcaf090a640 1 Processor -- start 2023-12-19T16:15:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f660062d640 1 Processor -- start 2023-12-19T16:15:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f660062d640 1 -- start start 2023-12-19T16:15:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d77fe640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d80b3b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80ac000 tx=0x7fa7c801ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fcaf090a640 1 -- start start 2023-12-19T16:15:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbbc00155c0 con 0x7fbbd01429f0 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80b4800 con 0x7fa7d80c9190 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 -- start start 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e1806bde0 0x7f7e180c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e18070190 0x7f7e180c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1806c270 con 0x7f7e18158900 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1806cdf0 con 0x7f7e18070190 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7f7e1e52c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e180cb8b0 con 0x7f7e1806bde0 2023-12-19T16:15:46.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fd4ecf09640 1 --2- 172.21.15.119:0/3829376164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 0x7fd4e80cdeb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009ea0 tx=0x7fd4e001ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee0f4dbea55b9c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d815b5c0 con 0x7fa7d80c9190 2023-12-19T16:15:46.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.995+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d815bb80 con 0x7fa7d80c9190 2023-12-19T16:15:46.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80b4960 con 0x7fa7d80c9190 2023-12-19T16:15:46.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80b4d10 con 0x7fa7d80c9190 2023-12-19T16:15:46.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbbeffd640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb0065ae0 0x7fbbb0067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbc00840c0 con 0x7fbbd01429f0 2023-12-19T16:15:46.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e1cac9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e18070190 0x7f7e180c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e1cac9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e18070190 0x7f7e180c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56682/0 (socket says 172.21.15.119:56682) 2023-12-19T16:15:46.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e1cac9640 1 -- 172.21.15.119:0/795499627 learned_addr learned my addr 172.21.15.119:0/795499627 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7b8000fd0 con 0x7fa7d80c9190 2023-12-19T16:15:46.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f45777fe640 1 --2- 172.21.15.119:0/107578768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 0x7f4578070510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f456c009870 tx=0x7f456c01cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d36c9509b06acb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f660062d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e4005390 0x7f65f8155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f660062d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65f815b7c0 0x7f65f8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f660062d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f8157010 0x7f65f8157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f660062d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80c2dc0 con 0x7f65f8157010 2023-12-19T16:15:46.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f660062d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81579d0 con 0x7f65f815b7c0 2023-12-19T16:15:46.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f660062d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80c21b0 con 0x7f65e4005390 2023-12-19T16:15:46.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e177fe640 1 --2- 172.21.15.119:0/795499627 >> v2:172.21.15.143:3300/0 conn(0x7f7e1806bde0 0x7f7e180c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4e77fe640 1 -- 172.21.15.119:0/3829376164 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00a5830 con 0x7fd4e815ca40 2023-12-19T16:15:46.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4e77fe640 1 -- 172.21.15.119:0/3829376164 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e00a5990 con 0x7fd4e815ca40 2023-12-19T16:15:46.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4e77fe640 1 -- 172.21.15.119:0/3829376164 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00a5d20 con 0x7fd4e815ca40 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbce59c640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb0065ae0 0x7fbbb0067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbbeffd640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7fbbb006f120 0x7fbbb0071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 --> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbb0071c30 con 0x7fbbb006f120 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbc0084430 con 0x7fbbd01429f0 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbced9d640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7fbbb006f120 0x7fbbb0071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fbbced9d640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7fbbb006f120 0x7fbbb0071560 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f65fe3c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e4005390 0x7f65f8155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f65fdbc8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65f815b7c0 0x7f65f8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f65fdbc8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65f815b7c0 0x7f65f8156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34176/0 (socket says 172.21.15.119:34176) 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f65fdbc8640 1 -- 172.21.15.119:0/3245218095 learned_addr learned my addr 172.21.15.119:0/3245218095 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 msgr2=0x7fd4e80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 --2- 172.21.15.119:0/3829376164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 0x7fd4e80cdeb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009ea0 tx=0x7fd4e001ca90 comp rx=0 tx=0).stop 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e177fe640 1 -- 172.21.15.119:0/795499627 >> v2:172.21.15.119:3300/0 conn(0x7f7e18070190 msgr2=0x7f7e180c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e177fe640 1 --2- 172.21.15.119:0/795499627 >> v2:172.21.15.119:3300/0 conn(0x7f7e18070190 0x7f7e180c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e177fe640 1 -- 172.21.15.119:0/795499627 >> v1:172.21.15.143:6789/0 conn(0x7f7e18158900 legacy=0x7f7e180cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f7e177fe640 1 -- 172.21.15.119:0/795499627 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1806c550 con 0x7f7e1806bde0 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaf090a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec160cc0 0x7fcaec0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaf090a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcaec0c1280 0x7fcaec0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaf090a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcaec0c17d0 0x7fcaec06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaf090a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec1654a0 con 0x7fcaec0c1280 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaf090a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec1610a0 con 0x7fcaec0c17d0 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaf090a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec06fdb0 con 0x7fcaec160cc0 2023-12-19T16:15:46.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f65febca640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f8157010 0x7f65f8157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 shutdown_connections 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 --2- 172.21.15.119:0/3829376164 >> v2:172.21.15.119:3300/0 conn(0x7fd4e80ce3f0 0x7fd4e80cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 --2- 172.21.15.119:0/3829376164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e815ca40 0x7fd4e80cdeb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 >> 172.21.15.119:0/3829376164 conn(0x7fd4e8089fb0 msgr2=0x7fd4e80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f4576ffd640 1 -- 172.21.15.119:0/107578768 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0ac640 con 0x7f45780cb180 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f4576ffd640 1 -- 172.21.15.119:0/107578768 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c0ac7a0 con 0x7f45780cb180 2023-12-19T16:15:46.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7f4576ffd640 1 -- 172.21.15.119:0/107578768 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0acb30 con 0x7f45780cb180 2023-12-19T16:15:46.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7c80c7390 con 0x7fa7d80c9190 2023-12-19T16:15:46.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaead9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcaec0c17d0 0x7fcaec06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcae9d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcaec0c1280 0x7fcaec0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcae9d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcaec0c1280 0x7fcaec0cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56688/0 (socket says 172.21.15.119:56688) 2023-12-19T16:15:46.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcae9d9b640 1 -- 172.21.15.119:0/755845581 learned_addr learned my addr 172.21.15.119:0/755845581 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 shutdown_connections 2023-12-19T16:15:46.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fcaea59c640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec160cc0 0x7fcaec0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:45.999+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3829376164 wait complete. 2023-12-19T16:15:46.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fbbce59c640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb0065ae0 0x7fbbb0067fa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40019c0 tx=0x7fbbc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 Processor -- start 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d4ff9640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7c4065b30 0x7fa7c4067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7c811dd40 con 0x7fa7d80c9190 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65fdbc8640 1 -- 172.21.15.119:0/3245218095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e4005390 msgr2=0x7f65f8155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65fdbc8640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65e4005390 0x7f65f8155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65fdbc8640 1 -- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f8157010 msgr2=0x7f65f8157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65fdbc8640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f8157010 0x7f65f8157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65fdbc8640 1 -- 172.21.15.119:0/3245218095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80c2490 con 0x7f65f815b7c0 2023-12-19T16:15:46.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 -- 172.21.15.119:0/107578768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 msgr2=0x7f4578070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 --2- 172.21.15.119:0/107578768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 0x7f4578070510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f456c009870 tx=0x7f456c01cee0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcae9d9b640 1 -- 172.21.15.119:0/755845581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec160cc0 msgr2=0x7fcaec0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 -- start start 2023-12-19T16:15:46.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d7fff640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7c4065b30 0x7fa7c4067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d4ff9640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7fa7c406f170 0x7fa7c40715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 --> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7c4071c80 con 0x7fa7c406f170 2023-12-19T16:15:46.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c8122030 con 0x7fa7d80c9190 2023-12-19T16:15:46.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== osd.0 v2:172.21.15.119:6800/38164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbbb0071c30 con 0x7fbbb006f120 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcae9d9b640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec160cc0 0x7fcaec0cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcae9d9b640 1 -- 172.21.15.119:0/755845581 >> v2:172.21.15.143:3300/0 conn(0x7fcaec0c17d0 msgr2=0x7fcaec06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcae9d9b640 1 --2- 172.21.15.119:0/755845581 >> v2:172.21.15.143:3300/0 conn(0x7fcaec0c17d0 0x7fcaec06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcae9d9b640 1 -- 172.21.15.119:0/755845581 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0cb6b0 con 0x7fcaec0c1280 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcaea59c640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec160cc0 0x7fcaec0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fcaead9d640 1 --2- 172.21.15.119:0/755845581 >> v2:172.21.15.143:3300/0 conn(0x7fcaec0c17d0 0x7fcaec06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7dc803640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7fa7c406f170 0x7fa7c40715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7dc803640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7fa7c406f170 0x7fa7c40715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 -- 172.21.15.119:0/107578768 shutdown_connections 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 --2- 172.21.15.119:0/107578768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45780cb180 0x7f4578070510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 --2- 172.21.15.119:0/107578768 >> v2:172.21.15.143:3300/0 conn(0x7f457815c800 0x7f45780ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 -- 172.21.15.119:0/107578768 >> 172.21.15.119:0/107578768 conn(0x7f457806a3e0 msgr2=0x7f45780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 -- 172.21.15.119:0/107578768 shutdown_connections 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f457e56d640 1 -- 172.21.15.119:0/107578768 wait complete. 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fa7d7fff640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7c4065b30 0x7fa7c4067ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e270 tx=0x7fa7d000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65fdbc8640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65f815b7c0 0x7f65f8156700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65f400b390 tx=0x7f65f400b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73406e2d0 0x7fb734070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb73406d020 0x7fb734071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73406d520 con 0x7fb7341595a0 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb734159980 con 0x7fb73406d020 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb738bf3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73406d800 con 0x7fb73406e2d0 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb73259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb7341595a0 0x7fb73415d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:35396/0 (socket says 172.21.15.119:35396) 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb73259c640 1 -- 172.21.15.119:0/3715763064 learned_addr learned my addr 172.21.15.119:0/3715763064 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb732d9d640 1 --2- 172.21.15.119:0/3715763064 >> v2:172.21.15.119:3300/0 conn(0x7fb73406d020 0x7fb734071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7fb72bfff640 1 --2- 172.21.15.119:0/3715763064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73406e2d0 0x7fb734070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011830 con 0x7f65f815b7c0 2023-12-19T16:15:46.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4011990 con 0x7f65f815b7c0 2023-12-19T16:15:46.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.003+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011d40 con 0x7f65f815b7c0 2023-12-19T16:15:46.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== osd.1 v2:172.21.15.119:6808/38165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa7c4071c80 con 0x7fa7c406f170 2023-12-19T16:15:46.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f80c2770 con 0x7f65f815b7c0 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f80c1e40 con 0x7f65f815b7c0 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f457e56d640 1 Processor -- start 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f457e56d640 1 -- start start 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e177fe640 1 --2- 172.21.15.119:0/795499627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e1806bde0 0x7f7e180c91a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e180cf400 tx=0x7f7e0801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769ec14d06d0092d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e16ffd640 1 -- 172.21.15.119:0/795499627 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080ad660 con 0x7f7e1806bde0 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e16ffd640 1 -- 172.21.15.119:0/795499627 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e080ad7c0 con 0x7f7e1806bde0 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e16ffd640 1 -- 172.21.15.119:0/795499627 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080adb50 con 0x7f7e1806bde0 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fb72bfff640 1 -- 172.21.15.119:0/3715763064 >> v2:172.21.15.119:3300/0 conn(0x7fb73406d020 msgr2=0x7fb734071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fb72bfff640 1 --2- 172.21.15.119:0/3715763064 >> v2:172.21.15.119:3300/0 conn(0x7fb73406d020 0x7fb734071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fb72bfff640 1 -- 172.21.15.119:0/3715763064 >> v1:172.21.15.143:6789/0 conn(0x7fb7341595a0 legacy=0x7fb73415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fb72bfff640 1 -- 172.21.15.119:0/3715763064 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73406dae0 con 0x7fb73406e2d0 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fd4ef16d640 1 Processor -- start 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fd4ef16d640 1 -- start start 2023-12-19T16:15:46.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 -- 172.21.15.119:0/795499627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e1806bde0 msgr2=0x7f7e180c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 --2- 172.21.15.119:0/795499627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e1806bde0 0x7f7e180c91a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e180cf400 tx=0x7f7e0801c360 comp rx=0 tx=0).stop 2023-12-19T16:15:46.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65f80b0c70 con 0x7f65f815b7c0 2023-12-19T16:15:46.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 -- 172.21.15.119:0/795499627 shutdown_connections 2023-12-19T16:15:46.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 --2- 172.21.15.119:0/795499627 >> v2:172.21.15.119:3300/0 conn(0x7f7e18070190 0x7f7e180c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 --2- 172.21.15.119:0/795499627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e1806bde0 0x7f7e180c91a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 -- 172.21.15.119:0/795499627 >> 172.21.15.119:0/795499627 conn(0x7f7e180afe90 msgr2=0x7f7e180b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 -- 172.21.15.119:0/795499627 shutdown_connections 2023-12-19T16:15:46.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f7e1e52c640 1 -- 172.21.15.119:0/795499627 wait complete. 2023-12-19T16:15:46.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fd4ef16d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e80ce3f0 0x7fd4e815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fcae9d9b640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec0c1280 0x7fcaec0cb170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcae00098a0 tx=0x7fcae001c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65f024235a22b84 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fd4ef16d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e80cf610 0x7fd4e80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fd4ecf09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e80ce3f0 0x7fd4e815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7fd4ef16d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e815ca40 0x7fd4e80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.007+0000 7f457e56d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45780cb180 0x7f4578152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e80ce3f0 0x7fd4e815be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56706/0 (socket says 172.21.15.119:56706) 2023-12-19T16:15:46.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4e7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e80cf610 0x7fd4e80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4578158c20 0x7f45781fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f457815c800 0x7f45781fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578154e30 con 0x7f4578158c20 2023-12-19T16:15:46.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578153d90 con 0x7f45780cb180 2023-12-19T16:15:46.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4578153180 con 0x7f457815c800 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ed70a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e815ca40 0x7fd4e80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ed70a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e815ca40 0x7fd4e80c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34208/0 (socket says 172.21.15.119:34208) 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ef16d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c6c60 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ef16d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c7500 con 0x7fd4e815ca40 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ef16d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c8f20 con 0x7fd4e80cf610 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3108586818 learned_addr learned my addr 172.21.15.119:0/3108586818 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcae959a640 1 -- 172.21.15.119:0/755845581 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00ab600 con 0x7fcaec0c1280 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcae959a640 1 -- 172.21.15.119:0/755845581 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00a7050 con 0x7fcaec0c1280 2023-12-19T16:15:46.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcae959a640 1 -- 172.21.15.119:0/755845581 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00ab980 con 0x7fcaec0c1280 2023-12-19T16:15:46.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f457815c800 0x7f45781fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f457815c800 0x7f45781fd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51318/0 (socket says 172.21.15.119:51318) 2023-12-19T16:15:46.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 -- 172.21.15.119:0/262750633 learned_addr learned my addr 172.21.15.119:0/262750633 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f65f401a400 con 0x7f65f815b7c0 2023-12-19T16:15:46.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f4577fff640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45780cb180 0x7f4578152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f45777fe640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4578158c20 0x7f45781fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 -- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45780cb180 msgr2=0x7f4578152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45780cb180 0x7f4578152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 -- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4578158c20 msgr2=0x7f45781fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3108586818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e80cf610 msgr2=0x7fd4e80c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4e80cf610 0x7fd4e80c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3108586818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e815ca40 msgr2=0x7fd4e80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e815ca40 0x7fd4e80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 -- 172.21.15.119:0/3108586818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009b30 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 -- 172.21.15.119:0/755845581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec0c1280 msgr2=0x7fcaec0cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec0c1280 0x7fcaec0cb170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcae00098a0 tx=0x7fcae001c160 comp rx=0 tx=0).stop 2023-12-19T16:15:46.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4578158c20 0x7f45781fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 -- 172.21.15.119:0/262750633 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0094d0 con 0x7f457815c800 2023-12-19T16:15:46.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f45777fe640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4578158c20 0x7f45781fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4ecf09640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e80ce3f0 0x7fd4e815be30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00af040 tx=0x7fd4e0019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457cb0a640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f457815c800 0x7f45781fd2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f456800d800 tx=0x7f456800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 -- 172.21.15.119:0/755845581 shutdown_connections 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 --2- 172.21.15.119:0/755845581 >> v2:172.21.15.143:3300/0 conn(0x7fcaec0c17d0 0x7fcaec06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec0c1280 0x7fcaec0cb170 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 --2- 172.21.15.119:0/755845581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec160cc0 0x7fcaec0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 -- 172.21.15.119:0/755845581 >> 172.21.15.119:0/755845581 conn(0x7fcaec06a3e0 msgr2=0x7fcaec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 -- 172.21.15.119:0/755845581 shutdown_connections 2023-12-19T16:15:46.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fcaf090a640 1 -- 172.21.15.119:0/755845581 wait complete. 2023-12-19T16:15:46.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fb72bfff640 1 --2- 172.21.15.119:0/3715763064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73406e2d0 0x7fb734070c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb72400ba60 tx=0x7fb72401eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fecb97c9d595a01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f65eeffd640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f65dc065b30 0x7f65dc067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456800b6c0 con 0x7f457815c800 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456800b820 con 0x7f457815c800 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456800bbd0 con 0x7f457815c800 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45780c8800 con 0x7f457815c800 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4578153740 con 0x7f457815c800 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fb731d9b640 1 -- 172.21.15.119:0/3715763064 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240a7bf0 con 0x7fb73406e2d0 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fb731d9b640 1 -- 172.21.15.119:0/3715763064 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240a7d50 con 0x7fb73406e2d0 2023-12-19T16:15:46.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fb731d9b640 1 -- 172.21.15.119:0/3715763064 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240af660 con 0x7fb73406e2d0 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 Processor -- start 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 -- start start 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e18070190 0x7f7e180b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e18158900 0x7f7e180c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e180b2a90 0x7f7e180b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18156350 con 0x7f7e180b2a90 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180c88c0 con 0x7f7e18158900 2023-12-19T16:15:46.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f7e1e52c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180c9290 con 0x7f7e18070190 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00b8880 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.011+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65f4083b50 con 0x7f65f815b7c0 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f65eeffd640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f65dc06f170 0x7f65dc0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f65fe3c9640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f65dc065b30 0x7f65dc067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80c6eb0 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e00b8a20 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00b8dd0 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80c8c40 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45780c8680 con 0x7f457815c800 2023-12-19T16:15:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e1cac9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e180b2a90 0x7f7e180b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e18070190 0x7f7e180b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e1cac9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e180b2a90 0x7f7e180b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56724/0 (socket says 172.21.15.119:56724) 2023-12-19T16:15:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e1cac9640 1 -- 172.21.15.119:0/450452815 learned_addr learned my addr 172.21.15.119:0/450452815 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 Processor -- start 2023-12-19T16:15:46.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 -- start start 2023-12-19T16:15:46.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fb738bf3640 1 -- 172.21.15.119:0/3715763064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73406e2d0 msgr2=0x7fb734070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fb738bf3640 1 --2- 172.21.15.119:0/3715763064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73406e2d0 0x7fb734070c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb72400ba60 tx=0x7fb72401eb20 comp rx=0 tx=0).stop 2023-12-19T16:15:46.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4e815ce20 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e177fe640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e18158900 0x7f7e180c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f65febca640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f65dc06f170 0x7f65dc0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaec0c1280 0x7fcaec1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec0c17d0 0x7fcaec0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec160cc0 0x7fcaec157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c23e0 con 0x7fcaec160cc0 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c2960 con 0x7fcaec0c1280 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaf090a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec155e10 con 0x7fcaec0c17d0 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 --> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65dc071c80 con 0x7f65dc06f170 2023-12-19T16:15:46.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65f4083f00 con 0x7f65f815b7c0 2023-12-19T16:15:46.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec0c17d0 0x7fcaec0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e177fe640 1 -- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e18070190 msgr2=0x7f7e180b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcaead9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec160cc0 0x7fcaec157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec0c17d0 0x7fcaec0c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51348/0 (socket says 172.21.15.119:51348) 2023-12-19T16:15:46.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 -- 172.21.15.119:0/1076456822 learned_addr learned my addr 172.21.15.119:0/1076456822 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e177fe640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e18070190 0x7f7e180b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e177fe640 1 -- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e180b2a90 msgr2=0x7f7e180b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e177fe640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e180b2a90 0x7f7e180b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f456800bd30 con 0x7f457815c800 2023-12-19T16:15:46.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e177fe640 1 -- 172.21.15.119:0/450452815 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009420 con 0x7f7e18158900 2023-12-19T16:15:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 -- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaec0c1280 msgr2=0x7fcaec1558d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T16:15:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaec0c1280 0x7fcaec1558d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd4e0006d50 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fb738bf3640 1 -- 172.21.15.119:0/3715763064 shutdown_connections 2023-12-19T16:15:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fb738bf3640 1 --2- 172.21.15.119:0/3715763064 >> v2:172.21.15.119:3300/0 conn(0x7fb73406d020 0x7fb734071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fb738bf3640 1 --2- 172.21.15.119:0/3715763064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73406e2d0 0x7fb734070c20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fb738bf3640 1 -- 172.21.15.119:0/3715763064 >> 172.21.15.119:0/3715763064 conn(0x7fb7340afc80 msgr2=0x7fb7340b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 -- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec160cc0 msgr2=0x7fcaec157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f65febca640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f65dc06f170 0x7f65dc0715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f65fe3c9640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f65dc065b30 0x7f65dc067ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65e8007fd0 tx=0x7f65e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e1cac9640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e180b2a90 0x7f7e180b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f4574ff9640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4564065ab0 0x7f4564067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7f7e17fff640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e18070190 0x7f7e180b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4568083a40 con 0x7f457815c800 2023-12-19T16:15:46.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f4574ff9640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7f456406f0f0 0x7f4564071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 --> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4564071c00 con 0x7f456406f0f0 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45680882a0 con 0x7f457815c800 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f7e177fe640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e18158900 0x7f7e180c8d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e080ac000 tx=0x7f7e08019100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcaec160cc0 0x7fcaec157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.015+0000 7fcae9d9b640 1 -- 172.21.15.119:0/1076456822 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4009a70 con 0x7fcaec0c17d0 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcae9d9b640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec0c17d0 0x7fcaec0c5430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcae001a810 tx=0x7fcae0018f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00b4420 con 0x7fcaec0c17d0 2023-12-19T16:15:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00b4580 con 0x7fcaec0c17d0 2023-12-19T16:15:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00b4930 con 0x7fcaec0c17d0 2023-12-19T16:15:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcaf090a640 1 -- 172.21.15.119:0/1076456822 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae00094d0 con 0x7fcaec0c17d0 2023-12-19T16:15:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fb738bf3640 1 -- 172.21.15.119:0/3715763064 shutdown_connections 2023-12-19T16:15:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fb738bf3640 1 -- 172.21.15.119:0/3715763064 wait complete. 2023-12-19T16:15:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080b6610 con 0x7f7e18158900 2023-12-19T16:15:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcaf090a640 1 -- 172.21.15.119:0/1076456822 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec0c7ef0 con 0x7fcaec0c17d0 2023-12-19T16:15:46.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f45777fe640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7f456406f0f0 0x7f4564071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e080b6770 con 0x7f7e18158900 2023-12-19T16:15:46.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080b6b20 con 0x7f7e18158900 2023-12-19T16:15:46.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f7e1e52c640 1 -- 172.21.15.119:0/450452815 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e180c7140 con 0x7f7e18158900 2023-12-19T16:15:46.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f7e1e52c640 1 -- 172.21.15.119:0/450452815 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e180c68a0 con 0x7f7e18158900 2023-12-19T16:15:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== osd.2 v2:172.21.15.119:6816/38166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f65dc071c80 con 0x7f65dc06f170 2023-12-19T16:15:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcac4000fd0 con 0x7fcaec0c17d0 2023-12-19T16:15:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.019+0000 7f4577fff640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4564065ab0 0x7f4564067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e57fa640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd4d4065a60 0x7fd4d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e180ccab0 con 0x7f7e18158900 2023-12-19T16:15:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fb738bf3640 1 Processor -- start 2023-12-19T16:15:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f45777fe640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7f456406f0f0 0x7f4564071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fb738bf3640 1 -- start start 2023-12-19T16:15:46.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4e011ea10 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e7fff640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd4d4065a60 0x7fd4d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f4577fff640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4564065ab0 0x7f4564067f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45700012f0 tx=0x7f4570009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== osd.4 v2:172.21.15.143:6807/38338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4564071c00 con 0x7f456406f0f0 2023-12-19T16:15:46.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e080b4040 con 0x7f7e18158900 2023-12-19T16:15:46.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e57fa640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7fd4d406f020 0x7fd4d4071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 --> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4d4071b30 con 0x7fd4d406f020 2023-12-19T16:15:46.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4e011ee60 con 0x7fd4e80ce3f0 2023-12-19T16:15:46.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcae00b2070 con 0x7fcaec0c17d0 2023-12-19T16:15:46.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4e7fff640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd4d4065a60 0x7fd4d4067f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80d3710 tx=0x7fd4d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e14ff9640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7e04065a90 0x7f7e04067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e0811c840 con 0x7f7e18158900 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e14ff9640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7f7e0406f050 0x7f7e04071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 --> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e04071b60 con 0x7f7e0406f050 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e0811cbc0 con 0x7f7e18158900 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fd4ed70a640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7fd4d406f020 0x7fd4d4071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e17fff640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7e04065a90 0x7f7e04067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7f7e1cac9640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7f7e0406f050 0x7f7e04071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.023+0000 7fcadaffd640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcacc065ab0 0x7fcacc067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcae011cd40 con 0x7fcaec0c17d0 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcadaffd640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7fcacc06f0f0 0x7fcacc071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 --> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcacc071c00 con 0x7fcacc06f0f0 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae011d0b0 con 0x7fcaec0c17d0 2023-12-19T16:15:46.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcaea59c640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcacc065ab0 0x7fcacc067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fd4ed70a640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7fd4d406f020 0x7fd4d4071460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcaead9d640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7fcacc06f0f0 0x7fcacc071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb738bf3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb73406d020 0x7fb734204ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb738bf3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb73406e2d0 0x7fb734205530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb738bf3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7341595a0 0x7fb7341f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb738bf3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73415cf20 con 0x7fb73406d020 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb738bf3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340c41f0 con 0x7fb73406e2d0 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb738bf3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb734205e50 con 0x7fb7341595a0 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7341595a0 0x7fb7341f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7341595a0 0x7fb7341f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51362/0 (socket says 172.21.15.119:51362) 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 -- 172.21.15.119:0/4095912548 learned_addr learned my addr 172.21.15.119:0/4095912548 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb72bfff640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb73406e2d0 0x7fb734205530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb73259c640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb73406d020 0x7fb734204ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 -- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb73406e2d0 msgr2=0x7fb734205530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb73406e2d0 0x7fb734205530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== osd.3 v2:172.21.15.119:6824/38170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd4d4071b30 con 0x7fd4d406f020 2023-12-19T16:15:46.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 -- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb73406d020 msgr2=0x7fb734204ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb73406d020 0x7fb734204ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7f7e17fff640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7e04065a90 0x7f7e04067f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009cd0 tx=0x7f7e0c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcaead9d640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7fcacc06f0f0 0x7fcacc071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb732d9d640 1 -- 172.21.15.119:0/4095912548 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72400b6c0 con 0x7fb7341595a0 2023-12-19T16:15:46.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fcaea59c640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcacc065ab0 0x7fcacc067f70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00b810 tx=0x7fcadc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7fb73259c640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb73406d020 0x7fb734204ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.027+0000 7f7e1cac9640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7f7e0406f050 0x7f7e04071490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== osd.6 v2:172.21.15.143:6819/38347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcacc071c00 con 0x7fcacc06f0f0 2023-12-19T16:15:46.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 --> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbd0165200 con 0x7fbbb006f120 2023-12-19T16:15:46.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7fb732d9d640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7341595a0 0x7fb7341f7f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009e30 tx=0x7fb72c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c009ca0 con 0x7fb7341595a0 2023-12-19T16:15:46.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00f040 con 0x7fb7341595a0 2023-12-19T16:15:46.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0146c0 con 0x7fb7341595a0 2023-12-19T16:15:46.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.031+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== osd.5 v2:172.21.15.143:6804/38339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7e04071b60 con 0x7f7e0406f050 2023-12-19T16:15:46.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.035+0000 7fbbbeffd640 1 -- 172.21.15.119:0/1587419880 <== osd.0 v2:172.21.15.119:6800/38164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbc80a5b50 con 0x7fbbb006f120 2023-12-19T16:15:46.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.035+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7340c35e0 con 0x7fb7341595a0 2023-12-19T16:15:46.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.035+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7340c3ba0 con 0x7fb7341595a0 2023-12-19T16:15:46.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.035+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7fbbb006f120 msgr2=0x7fbbb0071560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.035+0000 7fbbd48fc640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7fbbb006f120 0x7fbbb0071560 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.035+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7340cbd60 con 0x7fb7341595a0 2023-12-19T16:15:46.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb72c014820 con 0x7fb7341595a0 2023-12-19T16:15:46.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb0065ae0 msgr2=0x7fbbb0067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb0065ae0 0x7fbbb0067fa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40019c0 tx=0x7fbbc4009040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd01429f0 msgr2=0x7fbbd00c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 --2- 172.21.15.119:0/1587419880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd01429f0 0x7fbbd00c3c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0011930 tx=0x7fbbc0011df0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbced9d640 1 -- 172.21.15.119:0/1587419880 reap_dead start 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 shutdown_connections 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 >> 172.21.15.119:0/1587419880 conn(0x7fbbd006a2a0 msgr2=0x7fbbd01634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 shutdown_connections 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72affd640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb714065b30 0x7fb714067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fbbd48fc640 1 -- 172.21.15.119:0/1587419880 wait complete. 2023-12-19T16:15:46.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb72c0843e0 con 0x7fb7341595a0 2023-12-19T16:15:46.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72affd640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7fb71406f170 0x7fb7140715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 --> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb714071c80 con 0x7fb71406f170 2023-12-19T16:15:46.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb72c086a00 con 0x7fb7341595a0 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb73259c640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb714065b30 0x7fb714067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72bfff640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7fb71406f170 0x7fb7140715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.039+0000 7fb72bfff640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7fb71406f170 0x7fb7140715b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.043+0000 7fb73259c640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb714065b30 0x7fb714067ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb71c005890 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.043+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== osd.7 v2:172.21.15.143:6800/38348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb714071c80 con 0x7fb71406f170 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.043+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 --> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7b8002cc0 con 0x7fa7c406f170 2023-12-19T16:15:46.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.043+0000 7fa7d4ff9640 1 -- 172.21.15.119:0/2969159442 <== osd.1 v2:172.21.15.119:6808/38165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7b8002cc0 con 0x7fa7c406f170 2023-12-19T16:15:46.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.043+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 --> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f45780cd150 con 0x7f456406f0f0 2023-12-19T16:15:46.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.043+0000 7f4574ff9640 1 -- 172.21.15.119:0/262750633 <== osd.4 v2:172.21.15.143:6807/38338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f456c004040 con 0x7f456406f0f0 2023-12-19T16:15:46.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7f456406f0f0 msgr2=0x7f4564071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7f456406f0f0 0x7f4564071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7fa7c406f170 msgr2=0x7fa7c40715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7fa7c406f170 0x7fa7c40715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7c4065b30 msgr2=0x7fa7c4067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4564065ab0 msgr2=0x7f4564067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4564065ab0 0x7f4564067f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45700012f0 tx=0x7f4570009040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f457815c800 msgr2=0x7f45781fd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 --2- 172.21.15.119:0/262750633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f457815c800 0x7f45781fd2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f456800d800 tx=0x7f456800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7c4065b30 0x7fa7c4067ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e270 tx=0x7fa7d000b040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 msgr2=0x7fa7d80b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 --2- 172.21.15.119:0/2969159442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7d80c9190 0x7fa7d80b3b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80ac000 tx=0x7fa7c801ad60 comp rx=0 tx=0).stop 2023-12-19T16:15:46.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7dc803640 1 -- 172.21.15.119:0/2969159442 reap_dead start 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457cb0a640 1 -- 172.21.15.119:0/262750633 reap_dead start 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 shutdown_connections 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 >> 172.21.15.119:0/262750633 conn(0x7f457806a3e0 msgr2=0x7f4578155010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 shutdown_connections 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f457e56d640 1 -- 172.21.15.119:0/262750633 wait complete. 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 shutdown_connections 2023-12-19T16:15:46.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 --> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65f80c2c20 con 0x7f65dc06f170 2023-12-19T16:15:46.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.047+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 >> 172.21.15.119:0/2969159442 conn(0x7fa7d80afc80 msgr2=0x7fa7d80c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 shutdown_connections 2023-12-19T16:15:46.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7fa7de266640 1 -- 172.21.15.119:0/2969159442 wait complete. 2023-12-19T16:15:46.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f65eeffd640 1 -- 172.21.15.119:0/3245218095 <== osd.2 v2:172.21.15.119:6816/38166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65f0001700 con 0x7f65dc06f170 2023-12-19T16:15:46.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f65dc06f170 msgr2=0x7f65dc0715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f65dc06f170 0x7f65dc0715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f65dc065b30 msgr2=0x7f65dc067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f65dc065b30 0x7f65dc067ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65e8007fd0 tx=0x7f65e8009040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65f815b7c0 msgr2=0x7f65f8156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 --2- 172.21.15.119:0/3245218095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65f815b7c0 0x7f65f8156700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65f400b390 tx=0x7f65f400b850 comp rx=0 tx=0).stop 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f65febca640 1 -- 172.21.15.119:0/3245218095 reap_dead start 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 shutdown_connections 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 >> 172.21.15.119:0/3245218095 conn(0x7f65f806a3e0 msgr2=0x7f65f80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 shutdown_connections 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.051+0000 7f660062d640 1 -- 172.21.15.119:0/3245218095 wait complete. 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.055+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 --> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcac4002cc0 con 0x7fcacc06f0f0 2023-12-19T16:15:46.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcadaffd640 1 -- 172.21.15.119:0/1076456822 <== osd.6 v2:172.21.15.143:6819/38347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcac4002cc0 con 0x7fcacc06f0f0 2023-12-19T16:15:46.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 --> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e1804e000 con 0x7f7e0406f050 2023-12-19T16:15:46.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7fcacc06f0f0 msgr2=0x7fcacc071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7fcacc06f0f0 0x7fcacc071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcacc065ab0 msgr2=0x7fcacc067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcacc065ab0 0x7fcacc067f70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00b810 tx=0x7fcadc008040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec0c17d0 msgr2=0x7fcaec0c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 --2- 172.21.15.119:0/1076456822 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaec0c17d0 0x7fcaec0c5430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcae001a810 tx=0x7fcae0018f00 comp rx=0 tx=0).stop 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcaead9d640 1 -- 172.21.15.119:0/1076456822 reap_dead start 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 shutdown_connections 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 >> 172.21.15.119:0/1076456822 conn(0x7fcaec06a3e0 msgr2=0x7fcaec0ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 shutdown_connections 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7fcad8ff9640 1 -- 172.21.15.119:0/1076456822 wait complete. 2023-12-19T16:15:46.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.059+0000 7f7e14ff9640 1 -- 172.21.15.119:0/450452815 <== osd.5 v2:172.21.15.143:6804/38339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e1804e000 con 0x7f7e0406f050 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7f7e0406f050 msgr2=0x7f7e04071490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7dfe7fc640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7f7e0406f050 0x7f7e04071490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7e04065a90 msgr2=0x7f7e04067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7dfe7fc640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7e04065a90 0x7f7e04067f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009cd0 tx=0x7f7e0c009060 comp rx=0 tx=0).stop 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e18158900 msgr2=0x7f7e180c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7dfe7fc640 1 --2- 172.21.15.119:0/450452815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e18158900 0x7f7e180c8d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e080ac000 tx=0x7f7e08019100 comp rx=0 tx=0).stop 2023-12-19T16:15:46.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7f7e1cac9640 1 -- 172.21.15.119:0/450452815 reap_dead start 2023-12-19T16:15:46.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.063+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 --> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4e80d0e50 con 0x7fd4d406f020 2023-12-19T16:15:46.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 shutdown_connections 2023-12-19T16:15:46.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 >> 172.21.15.119:0/450452815 conn(0x7f7e180afe90 msgr2=0x7f7e18159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 --> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7340c43a0 con 0x7fb71406f170 2023-12-19T16:15:46.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 shutdown_connections 2023-12-19T16:15:46.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7f7dfe7fc640 1 -- 172.21.15.119:0/450452815 wait complete. 2023-12-19T16:15:46.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb72affd640 1 -- 172.21.15.119:0/4095912548 <== osd.7 v2:172.21.15.143:6800/38348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7340c43a0 con 0x7fb71406f170 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7fb71406f170 msgr2=0x7fb7140715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7fb71406f170 0x7fb7140715b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb714065b30 msgr2=0x7fb714067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb714065b30 0x7fb714067ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb71c005890 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7341595a0 msgr2=0x7fb7341f7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 --2- 172.21.15.119:0/4095912548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7341595a0 0x7fb7341f7f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009e30 tx=0x7fb72c00c490 comp rx=0 tx=0).stop 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb732d9d640 1 -- 172.21.15.119:0/4095912548 reap_dead start 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 shutdown_connections 2023-12-19T16:15:46.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 >> 172.21.15.119:0/4095912548 conn(0x7fb7340afc80 msgr2=0x7fb7340b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fd4e57fa640 1 -- 172.21.15.119:0/3108586818 <== osd.3 v2:172.21.15.119:6824/38170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4dc001390 con 0x7fd4d406f020 2023-12-19T16:15:46.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 shutdown_connections 2023-12-19T16:15:46.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fb738bf3640 1 -- 172.21.15.119:0/4095912548 wait complete. 2023-12-19T16:15:46.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7fd4d406f020 msgr2=0x7fd4d4071460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fd4ef16d640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7fd4d406f020 0x7fd4d4071460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd4d4065a60 msgr2=0x7fd4d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.067+0000 7fd4ef16d640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd4d4065a60 0x7fd4d4067f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80d3710 tx=0x7fd4d8008040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.071+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e80ce3f0 msgr2=0x7fd4e815be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.071+0000 7fd4ef16d640 1 --2- 172.21.15.119:0/3108586818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e80ce3f0 0x7fd4e815be30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00af040 tx=0x7fd4e0019830 comp rx=0 tx=0).stop 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.071+0000 7fd4ed70a640 1 -- 172.21.15.119:0/3108586818 reap_dead start 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.071+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 shutdown_connections 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.071+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 >> 172.21.15.119:0/3108586818 conn(0x7fd4e8089fb0 msgr2=0x7fd4e8072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.075+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 shutdown_connections 2023-12-19T16:15:46.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.075+0000 7fd4ef16d640 1 -- 172.21.15.119:0/3108586818 wait complete. 2023-12-19T16:15:46.092 INFO:teuthology.orchestra.run.smithi119.stdout:55834574860 2023-12-19T16:15:46.092 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T16:15:46.093 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:46.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T16:15:46.097 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:46.098 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T16:15:46.102 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2023-12-19T16:15:46.102 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T16:15:46.110 INFO:teuthology.orchestra.run.smithi119.stdout:55834574860 2023-12-19T16:15:46.110 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2023-12-19T16:15:46.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T16:15:46.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T16:15:46.112 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:46.112 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T16:15:46.114 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2023-12-19T16:15:46.114 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.299+0000 7f61b295a640 1 Processor -- start 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.299+0000 7f61b295a640 1 -- start start 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b295a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61a403c080 0x7f61a4053d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b295a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61a40542a0 0x7f61a4057df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b295a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a4054680 con 0x7f61a40e3200 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b295a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a40e35e0 con 0x7f61a40542a0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b295a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a40075d0 con 0x7f61a403c080 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1157640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61a403c080 0x7f61a4053d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1958640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f61a40e3200 0x7f61a4006b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:35410/0 (socket says 172.21.15.119:35410) 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1958640 1 -- 172.21.15.119:0/1418473551 learned_addr learned my addr 172.21.15.119:0/1418473551 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b2159640 1 --2- 172.21.15.119:0/1418473551 >> v2:172.21.15.119:3300/0 conn(0x7f61a40542a0 0x7f61a4057df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b0956640 1 -- 172.21.15.119:0/1418473551 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582419352 0 0) 0x7f61a4054680 con 0x7f61a40e3200 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b0956640 1 -- 172.21.15.119:0/1418473551 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6198003530 con 0x7f61a40e3200 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1157640 1 -- 172.21.15.119:0/1418473551 >> v2:172.21.15.119:3300/0 conn(0x7f61a40542a0 msgr2=0x7f61a4057df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1157640 1 --2- 172.21.15.119:0/1418473551 >> v2:172.21.15.119:3300/0 conn(0x7f61a40542a0 0x7f61a4057df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1157640 1 -- 172.21.15.119:0/1418473551 >> v1:172.21.15.143:6789/0 conn(0x7f61a40e3200 legacy=0x7f61a4006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b1157640 1 -- 172.21.15.119:0/1418473551 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40078b0 con 0x7f61a403c080 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.303+0000 7f61b2159640 1 --2- 172.21.15.119:0/1418473551 >> v2:172.21.15.119:3300/0 conn(0x7f61a40542a0 0x7f61a4057df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.307+0000 7f06412e5640 1 Processor -- start 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.307+0000 7f06412e5640 1 -- start start 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b1157640 1 --2- 172.21.15.119:0/1418473551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 0x7f61a4053d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61a4056a30 tx=0x7f619c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684b2fd99f39d498 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f06412e5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f063c0cf530 0x7f063c168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f06412e5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d11c0 con 0x7f063c0cf0d0 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f06412e5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d0310 con 0x7f063c15ca40 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f06412e5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0d05b0 con 0x7f063c0cf530 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b0956640 1 -- 172.21.15.119:0/1418473551 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0a8850 con 0x7f61a403c080 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b0956640 1 -- 172.21.15.119:0/1418473551 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0a89b0 con 0x7f61a403c080 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b0956640 1 -- 172.21.15.119:0/1418473551 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0a8d40 con 0x7f61a403c080 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f063a7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f063c0cf0d0 0x7f063c1648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59496/0 (socket says 172.21.15.119:59496) 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f063a7fc640 1 -- 172.21.15.119:0/1742837686 learned_addr learned my addr 172.21.15.119:0/1742837686 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897069822 0 0) 0x7f063c0d0310 con 0x7f063c15ca40 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0624003530 con 0x7f063c15ca40 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858360984 0 0) 0x7f063c0d11c0 con 0x7f063c0cf0d0 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f063c0d0310 con 0x7f063c0cf0d0 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7fef7a862640 1 Processor -- start 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 -- 172.21.15.119:0/1418473551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 msgr2=0x7f61a4053d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 --2- 172.21.15.119:0/1418473551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 0x7f61a4053d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61a4056a30 tx=0x7f619c01ec70 comp rx=0 tx=0).stop 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541039467 0 0) 0x7f063c0d0310 con 0x7f063c0cf0d0 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 >> v2:172.21.15.119:3300/0 conn(0x7f063c0cf530 msgr2=0x7f063c168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 --2- 172.21.15.119:0/1742837686 >> v2:172.21.15.119:3300/0 conn(0x7f063c0cf530 0x7f063c168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 >> v1:172.21.15.143:6789/0 conn(0x7f063c15ca40 legacy=0x7f063c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0d0890 con 0x7f063c0cf0d0 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 -- 172.21.15.119:0/1418473551 shutdown_connections 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 --2- 172.21.15.119:0/1418473551 >> v2:172.21.15.119:3300/0 conn(0x7f61a40542a0 0x7f61a4057df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 --2- 172.21.15.119:0/1418473551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 0x7f61a4053d60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 -- 172.21.15.119:0/1418473551 >> 172.21.15.119:0/1418473551 conn(0x7f61a4055aa0 msgr2=0x7f61a4055eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f0634001980 con 0x7f063c0cf0d0 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7fef7a862640 1 -- start start 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 -- 172.21.15.119:0/1418473551 shutdown_connections 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f61b295a640 1 -- 172.21.15.119:0/1418473551 wait complete. 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.311+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 >> v1:172.21.15.119:6789/0 conn(0x7f063c0cf0d0 legacy=0x7f063c1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f0639ffb640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f0624004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f0639ffb640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0624003770 0x7f0624003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f0639ffb640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0624004250 0x7f062400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063affd640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f0624004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630001290 con 0x7f0624004250 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0d05b0 con 0x7f0624003770 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062400c1e0 con 0x7f0624004ba0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063b7fe640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0624004250 0x7f062400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 Processor -- start 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 -- start start 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f61b295a640 1 Processor -- start 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fef7a862640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 0x7fef740ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fef7a862640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef74159940 0x7fef740c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063a7fc640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0624003770 0x7f0624003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f61b295a640 1 -- start start 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fef79860640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 0x7fef740ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fef79860640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 0x7fef740ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51376/0 (socket says 172.21.15.119:51376) 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc940158860 0x7fc9400cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc9400cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fef79860640 1 -- 172.21.15.119:0/2535211862 learned_addr learned my addr 172.21.15.119:0/2535211862 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9400cc2d0 con 0x7fc9400cd510 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9400cce50 con 0x7fc940158860 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fc945cc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc940158c40 con 0x7fc9400700d0 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740cc740 con 0x7fef740afd10 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740ca030 con 0x7fef74159940 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740cd110 con 0x7fef741587f0 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc9400cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc9400cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51382/0 (socket says 172.21.15.119:51382) 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 -- 172.21.15.119:0/3596847577 learned_addr learned my addr 172.21.15.119:0/3596847577 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b295a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 0x7f61a40d52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b295a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61a40542a0 0x7f61a41745f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b295a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a40e3200 0x7f61a40deff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef7905f640 1 --2- 172.21.15.119:0/2535211862 >> v2:172.21.15.119:3300/0 conn(0x7fef74159940 0x7fef740c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 -- 172.21.15.119:0/3596847577 >> v2:172.21.15.143:3300/0 conn(0x7fc940158860 msgr2=0x7fc9400cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93f7fe640 1 --2- 172.21.15.119:0/3596847577 >> v2:172.21.15.143:3300/0 conn(0x7fc940158860 0x7fc9400cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 --2- 172.21.15.119:0/3596847577 >> v2:172.21.15.143:3300/0 conn(0x7fc940158860 0x7fc9400cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 -- 172.21.15.119:0/3596847577 >> v1:172.21.15.119:6789/0 conn(0x7fc9400cd510 legacy=0x7fc9400cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93effd640 1 -- 172.21.15.119:0/3596847577 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400cc520 con 0x7fc9400700d0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fc93f7fe640 1 --2- 172.21.15.119:0/3596847577 >> v2:172.21.15.143:3300/0 conn(0x7fc940158860 0x7fc9400cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b1157640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61a40542a0 0x7f61a41745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b1157640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61a40542a0 0x7f61a41745f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51386/0 (socket says 172.21.15.119:51386) 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a40e3200 0x7f61a40deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b1157640 1 -- 172.21.15.119:0/2239750834 learned_addr learned my addr 172.21.15.119:0/2239750834 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4175590 con 0x7f61a40e3200 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4174cf0 con 0x7f61a403c080 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4174fd0 con 0x7f61a40542a0 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063affd640 1 -- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0624003770 msgr2=0x7f0624003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063affd640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0624003770 0x7f0624003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063affd640 1 -- 172.21.15.119:0/1742837686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0624004250 msgr2=0x7f062400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063affd640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0624004250 0x7f062400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.315+0000 7f063affd640 1 -- 172.21.15.119:0/1742837686 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624003530 con 0x7f0624004ba0 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f063b7fe640 1 -- 172.21.15.119:0/1742837686 reap_dead start 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef79860640 1 -- 172.21.15.119:0/2535211862 >> v2:172.21.15.119:3300/0 conn(0x7fef74159940 msgr2=0x7fef740c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef79860640 1 --2- 172.21.15.119:0/2535211862 >> v2:172.21.15.119:3300/0 conn(0x7fef74159940 0x7fef740c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef79860640 1 -- 172.21.15.119:0/2535211862 >> v1:172.21.15.119:6789/0 conn(0x7fef740afd10 legacy=0x7fef740c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7fef79860640 1 -- 172.21.15.119:0/2535211862 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740cbe10 con 0x7fef741587f0 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 -- 172.21.15.119:0/2239750834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61a40542a0 msgr2=0x7f61a41745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61a40542a0 0x7f61a41745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 -- 172.21.15.119:0/2239750834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 msgr2=0x7f61a40d52d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 0x7f61a40d52d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c009420 con 0x7f61a40e3200 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.319+0000 7f61b2159640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a40e3200 0x7f61a40deff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61ac000b70 tx=0x7f61ac073770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac072a80 con 0x7f61a40e3200 2023-12-19T16:15:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f063affd640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f0624004f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06300018c0 tx=0x7f063001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c127794308ea83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac072be0 con 0x7f61a40e3200 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac072a80 con 0x7f61a40e3200 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a41752b0 con 0x7f61a40e3200 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a4053180 con 0x7f61a40e3200 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7fc93effd640 1 --2- 172.21.15.119:0/3596847577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc9400cb150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098a0 tx=0x7fc93001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=835b4b93b012a56b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300a8bf0 con 0x7f0624004ba0 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f0639ffb640 1 -- 172.21.15.119:0/1742837686 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06300a8d70 con 0x7f0624004ba0 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f06412e5640 1 -- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 msgr2=0x7f0624004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f06412e5640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f0624004f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06300018c0 tx=0x7f063001f210 comp rx=0 tx=0).stop 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f06412e5640 1 -- 172.21.15.119:0/1742837686 shutdown_connections 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a40d5850 con 0x7f61a40e3200 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f06412e5640 1 --2- 172.21.15.119:0/1742837686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f0624004f80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.323+0000 7f06412e5640 1 -- 172.21.15.119:0/1742837686 >> 172.21.15.119:0/1742837686 conn(0x7f063c089fb0 msgr2=0x7f063c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7f06412e5640 1 -- 172.21.15.119:0/1742837686 shutdown_connections 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef79860640 1 --2- 172.21.15.119:0/2535211862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 0x7fef740ccbd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef700091e0 tx=0x7fef7001d790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e89a23ba9cda8423 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7f06412e5640 1 -- 172.21.15.119:0/1742837686 wait complete. 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc93e7fc640 1 -- 172.21.15.119:0/3596847577 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300ab670 con 0x7fc9400700d0 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc93e7fc640 1 -- 172.21.15.119:0/3596847577 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9300ab7d0 con 0x7fc9400700d0 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc93e7fc640 1 -- 172.21.15.119:0/3596847577 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300abb60 con 0x7fc9400700d0 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7885e640 1 -- 172.21.15.119:0/2535211862 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700a6820 con 0x7fef741587f0 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7885e640 1 -- 172.21.15.119:0/2535211862 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700a6980 con 0x7fef741587f0 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7885e640 1 -- 172.21.15.119:0/2535211862 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700a6d10 con 0x7fef741587f0 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 -- 172.21.15.119:0/3596847577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 msgr2=0x7fc9400cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 --2- 172.21.15.119:0/3596847577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc9400cb150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098a0 tx=0x7fc93001c4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 msgr2=0x7fef740ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 --2- 172.21.15.119:0/2535211862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 0x7fef740ccbd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef700091e0 tx=0x7fef7001d790 comp rx=0 tx=0).stop 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 -- 172.21.15.119:0/3596847577 shutdown_connections 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 --2- 172.21.15.119:0/3596847577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc9400cb150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 --2- 172.21.15.119:0/3596847577 >> v2:172.21.15.143:3300/0 conn(0x7fc940158860 0x7fc9400cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 -- 172.21.15.119:0/3596847577 >> 172.21.15.119:0/3596847577 conn(0x7fc94006a2a0 msgr2=0x7fc9400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 shutdown_connections 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 --2- 172.21.15.119:0/2535211862 >> v2:172.21.15.119:3300/0 conn(0x7fef74159940 0x7fef740c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 --2- 172.21.15.119:0/2535211862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef741587f0 0x7fef740ccbd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 >> 172.21.15.119:0/2535211862 conn(0x7fef740ce130 msgr2=0x7fef740ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 -- 172.21.15.119:0/3596847577 shutdown_connections 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61ac072d50 con 0x7f61a40e3200 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7f61a27fc640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6190065ac0 0x7f6190067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61ac10d360 con 0x7f61a40e3200 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7f61b1958640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6190065ac0 0x7f6190067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 shutdown_connections 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fef7a862640 1 -- 172.21.15.119:0/2535211862 wait complete. 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f06412e5640 1 Processor -- start 2023-12-19T16:15:46.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f61b1958640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6190065ac0 0x7f6190067f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61a8007fd0 tx=0x7f61a8007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f06412e5640 1 -- start start 2023-12-19T16:15:46.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.327+0000 7fc945cc4640 1 -- 172.21.15.119:0/3596847577 wait complete. 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7fc945cc4640 1 Processor -- start 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7fc945cc4640 1 -- start start 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f06412e5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f063c15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f06412e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15a950 0x7f063c1f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f06412e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f063c15adb0 0x7f063c1f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7fef7a862640 1 Processor -- start 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7fef7a862640 1 -- start start 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f063affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f063c15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.331+0000 7f063affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f063c15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51402/0 (socket says 172.21.15.119:51402) 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f06412e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c146060 con 0x7f063c15adb0 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f06412e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ca790 con 0x7f063c15a950 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f06412e5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c9e60 con 0x7f0624004ba0 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 -- 172.21.15.119:0/4240075250 learned_addr learned my addr 172.21.15.119:0/4240075250 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063a7fc640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15a950 0x7f063c1f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063b7fe640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f063c15adb0 0x7f063c1f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 -- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15a950 msgr2=0x7f063c1f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15a950 0x7f063c1f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 -- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f063c15adb0 msgr2=0x7f063c1f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f063c15adb0 0x7f063c1f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 -- 172.21.15.119:0/4240075250 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0ca140 con 0x7f0624004ba0 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7a862640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 0x7fef740b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f063affd640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f063c15d090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae040 tx=0x7f0624005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7a862640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef74159940 0x7fef740ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef79860640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 0x7fef740b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7a862640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef7414de00 0x7fef74142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef79860640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 0x7fef740b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56814/0 (socket says 172.21.15.119:56814) 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef79860640 1 -- 172.21.15.119:0/3714062158 learned_addr learned my addr 172.21.15.119:0/3714062158 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740714d0 con 0x7fef740afd10 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef74071a50 con 0x7fef7414de00 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7905f640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef74159940 0x7fef740ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc945cc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc94014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fef7a061640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef7414de00 0x7fef74142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc945cc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9400cd510 0x7fc94015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc945cc4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc940158860 0x7fc9400ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300016d0 con 0x7f0624004ba0 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06300a8bf0 con 0x7f0624004ba0 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc93f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc94014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc93f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc94014f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51428/0 (socket says 172.21.15.119:51428) 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc945cc4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94014fec0 con 0x7fc940158860 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc945cc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc940153960 con 0x7fc9400cd510 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc945cc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401598f0 con 0x7fc9400700d0 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.335+0000 7fc93f7fe640 1 -- 172.21.15.119:0/2086129517 learned_addr learned my addr 172.21.15.119:0/2086129517 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93ffff640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc940158860 0x7fc9400ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef74071770 con 0x7fef74159940 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef79860640 1 -- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef74159940 msgr2=0x7fef740ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef79860640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef74159940 0x7fef740ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef79860640 1 -- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef7414de00 msgr2=0x7fef74142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef79860640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef7414de00 0x7fef74142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef79860640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009d60 con 0x7fef740afd10 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fef7a061640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef7414de00 0x7fef74142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93effd640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9400cd510 0x7fc94015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93f7fe640 1 -- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9400cd510 msgr2=0x7fc94015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93f7fe640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9400cd510 0x7fc94015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93f7fe640 1 -- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc940158860 msgr2=0x7fc9400ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93f7fe640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc940158860 0x7fc9400ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93f7fe640 1 -- 172.21.15.119:0/2086129517 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300094d0 con 0x7fc9400700d0 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93effd640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9400cd510 0x7fc94015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc93f7fe640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc94014f980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc93400af70 tx=0x7fc93400cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9340119e0 con 0x7fc9400700d0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0ca420 con 0x7f0624004ba0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c1f1ec0 con 0x7f0624004ba0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300bc690 con 0x7f0624004ba0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f61a40d5850 con 0x7f61a40e3200 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934011b40 con 0x7fc9400700d0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc940159bd0 con 0x7fc9400700d0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93400ce20 con 0x7fc9400700d0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94015a190 con 0x7fc9400700d0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06300050d0 con 0x7f0624004ba0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.339+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94004e000 con 0x7fc9400700d0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc9340075c0 con 0x7fc9400700d0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7f06237fe640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0628065b60 0x7f0628068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06300b7030 con 0x7f0624004ba0 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c04e000 con 0x7f0624004ba0 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fef79860640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 0x7fef740b0e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef700b1040 tx=0x7fef7001a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700ae850 con 0x7fef740afd10 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700ae9d0 con 0x7fef740afd10 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700aed80 con 0x7fef740afd10 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7414d320 con 0x7fef740afd10 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7414d8e0 con 0x7fef740afd10 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fc927fff640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc92c065a90 0x7fc92c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.343+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9340871d0 con 0x7fc9400700d0 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c005260 con 0x7fef740afd10 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fef700c2460 con 0x7fef740afd10 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fc93effd640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc92c065a90 0x7fc92c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fef6a7fc640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fef58065ab0 0x7fef58067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef700efad0 con 0x7fef740afd10 2023-12-19T16:15:46.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fc93effd640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc92c065a90 0x7fc92c067f50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9300af000 tx=0x7fc9300a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fef7905f640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fef58065ab0 0x7fef58067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc9340548b0 con 0x7fc9400700d0 2023-12-19T16:15:46.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7f063a7fc640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0628065b60 0x7f0628068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.347+0000 7f063a7fc640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0628065b60 0x7f0628068020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0634001360 tx=0x7f0634001990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.351+0000 7fef7905f640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fef58065ab0 0x7fef58067f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef74070d40 tx=0x7fef6c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.351+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f06300c1080 con 0x7f0624004ba0 2023-12-19T16:15:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.359+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fef700ebea0 con 0x7fef740afd10 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.395+0000 7f1afa204640 1 Processor -- start 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1afa204640 1 -- start start 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1afa204640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af40c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1afa204640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af4070180 con 0x7f1af4158c10 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1afa204640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af4070460 con 0x7f1af406d730 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1afa204640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4070e00 con 0x7f1af4158830 2023-12-19T16:15:46.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1af9202640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af40c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1af9a03640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1af406d730 0x7f1af40cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:35432/0 (socket says 172.21.15.119:35432) 2023-12-19T16:15:46.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.399+0000 7f1af9a03640 1 -- 172.21.15.119:0/798181125 learned_addr learned my addr 172.21.15.119:0/798181125 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 Processor -- start 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 -- start start 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f1aebfff640 1 -- 172.21.15.119:0/798181125 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210180687 0 0) 0x7f1af4070460 con 0x7f1af406d730 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f1aebfff640 1 -- 172.21.15.119:0/798181125 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae0005740 con 0x7f1af406d730 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f1af9202640 1 -- 172.21.15.119:0/798181125 >> v1:172.21.15.143:6789/0 conn(0x7f1af406d730 legacy=0x7f1af40cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f1af9202640 1 -- 172.21.15.119:0/798181125 >> v1:172.21.15.119:6789/0 conn(0x7f1af4158c10 legacy=0x7f1af406d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f1af9202640 1 -- 172.21.15.119:0/798181125 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4070740 con 0x7f1af4158830 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f638415a7e0 0x7f63840cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f638415b5e0 0x7f63840cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638a3f1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f638406d020 0x7f638406d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:35436/0 (socket says 172.21.15.119:35436) 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638a3f1640 1 -- 172.21.15.119:0/4028137122 learned_addr learned my addr 172.21.15.119:0/4028137122 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63840706c0 con 0x7f638406d020 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638415bb30 con 0x7f638415a7e0 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.403+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638406fe20 con 0x7f638415b5e0 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464851497 0 0) 0x7f63840706c0 con 0x7f638406d020 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6370003530 con 0x7f638406d020 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558023512 0 0) 0x7f6370003530 con 0x7f638406d020 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 >> v2:172.21.15.143:3300/0 conn(0x7f638415b5e0 msgr2=0x7f63840cc610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 --2- 172.21.15.119:0/4028137122 >> v2:172.21.15.143:3300/0 conn(0x7f638415b5e0 0x7f63840cc610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 >> v2:172.21.15.119:3300/0 conn(0x7f638415a7e0 msgr2=0x7f63840cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f6389bf0640 1 --2- 172.21.15.119:0/4028137122 >> v2:172.21.15.119:3300/0 conn(0x7f638415a7e0 0x7f63840cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 --2- 172.21.15.119:0/4028137122 >> v2:172.21.15.119:3300/0 conn(0x7f638415a7e0 0x7f63840cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384070100 con 0x7f638406d020 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f6380001680 con 0x7f638406d020 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 >> v1:172.21.15.143:6789/0 conn(0x7f638406d020 legacy=0x7f638406d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6370003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63700047d0 0x7f6370004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6370005390 0x7f6370014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638415bb30 con 0x7f6370003980 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638406fe20 con 0x7f6370005390 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6370014b00 con 0x7f63700047d0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638a3f1640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6370003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f6389bf0640 1 --2- 172.21.15.119:0/4028137122 >> v2:172.21.15.119:3300/0 conn(0x7f638415a7e0 0x7f63840cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638abf2640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6370005390 0x7f6370014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f1af9202640 1 --2- 172.21.15.119:0/798181125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af40c93e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c210 tx=0x7f1af001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae91536bd3b52179 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f6389bf0640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63700047d0 0x7f6370004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638a3f1640 1 -- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63700047d0 msgr2=0x7f6370004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f1aebfff640 1 -- 172.21.15.119:0/798181125 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0008be0 con 0x7f1af4158830 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f1aebfff640 1 -- 172.21.15.119:0/798181125 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af00a6040 con 0x7f1af4158830 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f1aebfff640 1 -- 172.21.15.119:0/798181125 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af000a0d0 con 0x7f1af4158830 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638a3f1640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63700047d0 0x7f6370004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638a3f1640 1 -- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6370005390 msgr2=0x7f6370014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638a3f1640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6370005390 0x7f6370014590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638a3f1640 1 -- 172.21.15.119:0/4028137122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384070100 con 0x7f6370003980 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f638abf2640 1 -- 172.21.15.119:0/4028137122 reap_dead start 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f1afa204640 1 -- 172.21.15.119:0/798181125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 msgr2=0x7f1af40c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.407+0000 7f1afa204640 1 --2- 172.21.15.119:0/798181125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af40c93e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c210 tx=0x7f1af001c380 comp rx=0 tx=0).stop 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f24983ce640 1 Processor -- start 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 -- 172.21.15.119:0/798181125 shutdown_connections 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 --2- 172.21.15.119:0/798181125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af40c93e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 -- 172.21.15.119:0/798181125 >> 172.21.15.119:0/798181125 conn(0x7f1af40cabf0 msgr2=0x7f1af40cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f24983ce640 1 -- start start 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 -- 172.21.15.119:0/798181125 shutdown_connections 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 -- 172.21.15.119:0/798181125 wait complete. 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f24983ce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 0x7f24900cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f24983ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f249015d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f249616a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 0x7f24900cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f249616a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 0x7f24900cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56848/0 (socket says 172.21.15.119:56848) 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 Processor -- start 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f249616a640 1 -- 172.21.15.119:0/3271138465 learned_addr learned my addr 172.21.15.119:0/3271138465 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.411+0000 7f1afa204640 1 -- start start 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f2495969640 1 --2- 172.21.15.119:0/3271138465 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f249015d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f638a3f1640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6370003da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f638000c310 tx=0x7f638001ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6e2cf118d9f7b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249006bde0 con 0x7f249015da60 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24900cb650 con 0x7f24900cad30 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2490160810 con 0x7f24900ab8a0 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f2495969640 1 -- 172.21.15.119:0/3271138465 >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 msgr2=0x7f24900cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f2495969640 1 --2- 172.21.15.119:0/3271138465 >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 0x7f24900cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f2495969640 1 -- 172.21.15.119:0/3271138465 >> v1:172.21.15.119:6789/0 conn(0x7f249015da60 legacy=0x7f249006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1afa204640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 0x7f1af40b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1afa204640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af4149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9202640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 0x7f1af40b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800058e0 con 0x7f6370003980 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380005a40 con 0x7f6370003980 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f63893ef640 1 -- 172.21.15.119:0/4028137122 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380005e30 con 0x7f6370003980 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 msgr2=0x7f6370003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f638c655640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6370003da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f638000c310 tx=0x7f638001ccf0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f2495969640 1 -- 172.21.15.119:0/3271138465 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490160af0 con 0x7f24900ab8a0 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f249616a640 1 --2- 172.21.15.119:0/3271138465 >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 0x7f24900cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1afa204640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 0x7f1af414d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9202640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 0x7f1af40b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56862/0 (socket says 172.21.15.119:56862) 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1afa204640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40b3320 con 0x7f1af406d730 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 0x7f1af414d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 0x7f1af414d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34294/0 (socket says 172.21.15.119:34294) 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 -- 172.21.15.119:0/833266786 learned_addr learned my addr 172.21.15.119:0/833266786 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af8a01640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af4149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1afa204640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af414a2f0 con 0x7f1af4158c10 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1afa204640 1 -- 172.21.15.119:0/833266786 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40b3040 con 0x7f1af4158830 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 -- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 msgr2=0x7f1af4149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af4149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 -- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 msgr2=0x7f1af40b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 0x7f1af40b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 -- 172.21.15.119:0/833266786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af000ae50 con 0x7f1af4158c10 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9202640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 0x7f1af40b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.415+0000 7f1af9a03640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 0x7f1af414d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40010f0 tx=0x7f1ae400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4005cf0 con 0x7f1af4158c10 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4005e50 con 0x7f1af4158c10 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1afa204640 1 -- 172.21.15.119:0/833266786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af414a720 con 0x7f1af4158c10 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 shutdown_connections 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f638c655640 1 --2- 172.21.15.119:0/4028137122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6370003da0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 >> 172.21.15.119:0/4028137122 conn(0x7f63840afc80 msgr2=0x7f63840b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40072d0 con 0x7f1af4158c10 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1afa204640 1 -- 172.21.15.119:0/833266786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af414ace0 con 0x7f1af4158c10 2023-12-19T16:15:46.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 shutdown_connections 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f638c655640 1 -- 172.21.15.119:0/4028137122 wait complete. 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f2495969640 1 --2- 172.21.15.119:0/3271138465 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f249015d520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2488009d90 tx=0x7f248801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87adb7c71d444b3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f2495168640 1 -- 172.21.15.119:0/3271138465 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880a5900 con 0x7f24900ab8a0 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f2495168640 1 -- 172.21.15.119:0/3271138465 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24880a5a60 con 0x7f24900ab8a0 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 msgr2=0x7f249015d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 --2- 172.21.15.119:0/3271138465 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f249015d520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2488009d90 tx=0x7f248801c950 comp rx=0 tx=0).stop 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 shutdown_connections 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 --2- 172.21.15.119:0/3271138465 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f249015d520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 --2- 172.21.15.119:0/3271138465 >> v2:172.21.15.119:3300/0 conn(0x7f24900cad30 0x7f24900cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 >> 172.21.15.119:0/3271138465 conn(0x7f24900afe90 msgr2=0x7f24900b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af404e000 con 0x7f1af4158c10 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.419+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ae4017020 con 0x7f1af4158c10 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f1ae9ffb640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ad8065b30 0x7f1ad8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f638c655640 1 Processor -- start 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f638c655640 1 -- start start 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f1af9202640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ad8065b30 0x7f1ad8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ae4086910 con 0x7f1af4158c10 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f1af9202640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ad8065b30 0x7f1ad8067ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1af00ae000 tx=0x7f1af00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 shutdown_connections 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.423+0000 7f24983ce640 1 -- 172.21.15.119:0/3271138465 wait complete. 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638c655640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6384158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638c655640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6384159180 0x7f63840aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638c655640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 0x7f63840c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638c655640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63840c4ac0 con 0x7f6370003980 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638c655640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63840c1c80 con 0x7f6384159180 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638c655640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63841589b0 con 0x7f63840c4100 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638abf2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 0x7f63840c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638abf2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 0x7f63840c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51482/0 (socket says 172.21.15.119:51482) 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638abf2640 1 -- 172.21.15.119:0/3394106581 learned_addr learned my addr 172.21.15.119:0/3394106581 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6384159180 0x7f63840aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ae4054100 con 0x7f1af4158c10 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 -- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 msgr2=0x7f63840c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f24983ce640 1 Processor -- start 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 0x7f63840c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f24983ce640 1 -- start start 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 -- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 msgr2=0x7f6384158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6384158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 -- 172.21.15.119:0/3394106581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63841e4930 con 0x7f6384159180 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f638abf2640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 0x7f63840c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.427+0000 7f6389bf0640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6384159180 0x7f63840aec70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f637400e5c0 tx=0x7f637400ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f24983ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f2490158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f24983ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24900cad30 0x7f249015f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f24983ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f249015da60 0x7f249015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f24983ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c9310 con 0x7f249015da60 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f24983ce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c45e0 con 0x7f24900cad30 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f24983ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c48c0 con 0x7f24900ab8a0 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374015690 con 0x7f6384159180 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63740157f0 con 0x7f6384159180 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374015ba0 con 0x7f6384159180 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63841e4bd0 con 0x7f6384159180 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f2495969640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24900cad30 0x7f249015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f2490158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f2495969640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24900cad30 0x7f249015f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34310/0 (socket says 172.21.15.119:34310) 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f2495969640 1 -- 172.21.15.119:0/3128479074 learned_addr learned my addr 172.21.15.119:0/3128479074 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63840c1ed0 con 0x7f6384159180 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 -- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24900cad30 msgr2=0x7f249015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24900cad30 0x7f249015f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 -- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f249015da60 msgr2=0x7f249015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f249015da60 0x7f249015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 -- 172.21.15.119:0/3128479074 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800094d0 con 0x7f24900ab8a0 2023-12-19T16:15:46.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f249616a640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f2490158900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f248000e8e0 tx=0x7f248000eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000ca00 con 0x7f24900ab8a0 2023-12-19T16:15:46.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248000cb60 con 0x7f24900ab8a0 2023-12-19T16:15:46.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.431+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2480013470 con 0x7f24900ab8a0 2023-12-19T16:15:46.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2488009a70 con 0x7f24900ab8a0 2023-12-19T16:15:46.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638404e000 con 0x7f6384159180 2023-12-19T16:15:46.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6374015d00 con 0x7f6384159180 2023-12-19T16:15:46.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24900c4e80 con 0x7f24900ab8a0 2023-12-19T16:15:46.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f637affd640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6368065b30 0x7f6368067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6374083d90 con 0x7f6384159180 2023-12-19T16:15:46.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24800135d0 con 0x7f24900ab8a0 2023-12-19T16:15:46.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.435+0000 7f638a3f1640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6368065b30 0x7f6368067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f2486ffd640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2474065b30 0x7f2474067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249004e000 con 0x7f24900ab8a0 2023-12-19T16:15:46.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2480083630 con 0x7f24900ab8a0 2023-12-19T16:15:46.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f2495969640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2474065b30 0x7f2474067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f638a3f1640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6368065b30 0x7f6368067ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63800aa000 tx=0x7f6380001940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f63740514d0 con 0x7f6384159180 2023-12-19T16:15:46.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.439+0000 7f2495969640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2474065b30 0x7f2474067ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2488009d90 tx=0x7f24880a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.443+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2480050e20 con 0x7f24900ab8a0 2023-12-19T16:15:46.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 Processor -- start 2023-12-19T16:15:46.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 -- start start 2023-12-19T16:15:46.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feecc15c7e0 0x7feecc0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0ab8a0 0x7feecc0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc06dff0 con 0x7feecc0cd9a0 2023-12-19T16:15:46.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0cc4c0 con 0x7feecc15c7e0 2023-12-19T16:15:46.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.463+0000 7feecb59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc06da30 con 0x7feecc0ab8a0 2023-12-19T16:15:46.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feecc15c7e0 0x7feecc0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feecc15c7e0 0x7feecc0c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34320/0 (socket says 172.21.15.119:34320) 2023-12-19T16:15:46.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 -- 172.21.15.119:0/2727884722 learned_addr learned my addr 172.21.15.119:0/2727884722 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feec9d9b640 1 --2- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0ab8a0 0x7feecc0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 -- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0ab8a0 msgr2=0x7feecc0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 --2- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0ab8a0 0x7feecc0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 -- 172.21.15.119:0/2727884722 >> v1:172.21.15.143:6789/0 conn(0x7feecc0cd9a0 legacy=0x7feecc160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.467+0000 7feeca59c640 1 -- 172.21.15.119:0/2727884722 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc06dd10 con 0x7feecc15c7e0 2023-12-19T16:15:46.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.471+0000 7feeca59c640 1 --2- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c87c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feec0009870 tx=0x7feec001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f95aa0e774a5ece server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.471+0000 7feec959a640 1 -- 172.21.15.119:0/2727884722 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00ab600 con 0x7feecc15c7e0 2023-12-19T16:15:46.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.471+0000 7feec959a640 1 -- 172.21.15.119:0/2727884722 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00a7050 con 0x7feecc15c7e0 2023-12-19T16:15:46.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 -- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 msgr2=0x7feecc0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feec959a640 1 -- 172.21.15.119:0/2727884722 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00ab600 con 0x7feecc15c7e0 2023-12-19T16:15:46.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 --2- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c87c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feec0009870 tx=0x7feec001c460 comp rx=0 tx=0).stop 2023-12-19T16:15:46.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 -- 172.21.15.119:0/2727884722 shutdown_connections 2023-12-19T16:15:46.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 --2- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0ab8a0 0x7feecc0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 --2- 172.21.15.119:0/2727884722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c87c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 -- 172.21.15.119:0/2727884722 >> 172.21.15.119:0/2727884722 conn(0x7feecc0cabf0 msgr2=0x7feecc0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 -- 172.21.15.119:0/2727884722 shutdown_connections 2023-12-19T16:15:46.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.475+0000 7feecb59e640 1 -- 172.21.15.119:0/2727884722 wait complete. 2023-12-19T16:15:46.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.479+0000 7feecb59e640 1 Processor -- start 2023-12-19T16:15:46.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.479+0000 7feecb59e640 1 -- start start 2023-12-19T16:15:46.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecb59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 0x7feecc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecb59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0cd9a0 0x7feecc150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecb59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecb59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc159330 con 0x7feecc0ab8a0 2023-12-19T16:15:46.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecb59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc159610 con 0x7feecc15c7e0 2023-12-19T16:15:46.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecb59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc1598f0 con 0x7feecc0cd9a0 2023-12-19T16:15:46.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 0x7feecc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 0x7feecc15bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56886/0 (socket says 172.21.15.119:56886) 2023-12-19T16:15:46.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 -- 172.21.15.119:0/2074598270 learned_addr learned my addr 172.21.15.119:0/2074598270 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:46.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecad9d640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feec9d9b640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0cd9a0 0x7feecc150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 -- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0cd9a0 msgr2=0x7feecc150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0cd9a0 0x7feecc150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 -- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 msgr2=0x7feecc0c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feeca59c640 1 -- 172.21.15.119:0/2074598270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00094d0 con 0x7feecc0ab8a0 2023-12-19T16:15:46.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.483+0000 7feecad9d640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.487+0000 7feeca59c640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 0x7feecc15bb40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feec001ab10 tx=0x7feec0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.487+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0003e60 con 0x7feecc0ab8a0 2023-12-19T16:15:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.487+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc159bd0 con 0x7feecc0ab8a0 2023-12-19T16:15:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.491+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc151020 con 0x7feecc0ab8a0 2023-12-19T16:15:46.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.491+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00be460 con 0x7feecc0ab8a0 2023-12-19T16:15:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.491+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00be7d0 con 0x7feecc0ab8a0 2023-12-19T16:15:46.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.495+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0005260 con 0x7feecc0ab8a0 2023-12-19T16:15:46.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.495+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feec00b2040 con 0x7feecc0ab8a0 2023-12-19T16:15:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.495+0000 7feebaffd640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feeac065a60 0x7feeac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.495+0000 7feec9d9b640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feeac065a60 0x7feeac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.499+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feec00ee780 con 0x7feecc0ab8a0 2023-12-19T16:15:46.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.503+0000 7feec9d9b640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feeac065a60 0x7feeac067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feecc15fe50 tx=0x7feebc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.507+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feec00eb250 con 0x7feecc0ab8a0 2023-12-19T16:15:46.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.675+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f61a40d5c30 con 0x7f61a40e3200 2023-12-19T16:15:46.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.675+0000 7f61a27fc640 1 -- 172.21.15.119:0/2239750834 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61a40d5c30 con 0x7f61a40e3200 2023-12-19T16:15:46.679 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2023-12-19T16:15:46.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.679+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6190065ac0 msgr2=0x7f6190067f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.679+0000 7f61b295a640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6190065ac0 0x7f6190067f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61a8007fd0 tx=0x7f61a8007900 comp rx=0 tx=0).stop 2023-12-19T16:15:46.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.679+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a40e3200 msgr2=0x7f61a40deff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.679+0000 7f61b295a640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a40e3200 0x7f61a40deff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61ac000b70 tx=0x7f61ac073770 comp rx=0 tx=0).stop 2023-12-19T16:15:46.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.679+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 shutdown_connections 2023-12-19T16:15:46.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.679+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f063c0cff10 con 0x7f0624004ba0 2023-12-19T16:15:46.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6190065ac0 0x7f6190067f80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a40e3200 0x7f61a40deff0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61a40542a0 0x7f61a41745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 --2- 172.21.15.119:0/2239750834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61a403c080 0x7f61a40d52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06237fe640 1 -- 172.21.15.119:0/4240075250 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06300edf20 con 0x7f0624004ba0 2023-12-19T16:15:46.686 INFO:teuthology.orchestra.run.smithi119.stdout:55834574856 2023-12-19T16:15:46.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 >> 172.21.15.119:0/2239750834 conn(0x7f61a4055aa0 msgr2=0x7f61a40d9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 shutdown_connections 2023-12-19T16:15:46.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0628065b60 msgr2=0x7f0628068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0628065b60 0x7f0628068020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0634001360 tx=0x7f0634001990 comp rx=0 tx=0).stop 2023-12-19T16:15:46.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 msgr2=0x7f063c15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f063c15d090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae040 tx=0x7f0624005800 comp rx=0 tx=0).stop 2023-12-19T16:15:46.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 shutdown_connections 2023-12-19T16:15:46.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f61b295a640 1 -- 172.21.15.119:0/2239750834 wait complete. 2023-12-19T16:15:46.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0628065b60 0x7f0628068020 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f063c15a950 0x7f063c1f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f063c15adb0 0x7f063c1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 --2- 172.21.15.119:0/4240075250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0624004ba0 0x7f063c15d090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.683+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 >> 172.21.15.119:0/4240075250 conn(0x7f063c089fb0 msgr2=0x7f063c0b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.687+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 shutdown_connections 2023-12-19T16:15:46.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.687+0000 7f06412e5640 1 -- 172.21.15.119:0/4240075250 wait complete. 2023-12-19T16:15:46.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.687+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc940159a30 con 0x7fc9400700d0 2023-12-19T16:15:46.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.691+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef5c0057e0 con 0x7fef740afd10 2023-12-19T16:15:46.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.691+0000 7fc927fff640 1 -- 172.21.15.119:0/2086129517 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc93401e020 con 0x7fc9400700d0 2023-12-19T16:15:46.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.691+0000 7fef6a7fc640 1 -- 172.21.15.119:0/3714062158 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef700b3030 con 0x7fef740afd10 2023-12-19T16:15:46.695 INFO:teuthology.orchestra.run.smithi119.stdout:55834574856 2023-12-19T16:15:46.698 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:46.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fef58065ab0 msgr2=0x7fef58067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fef58065ab0 0x7fef58067f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef74070d40 tx=0x7fef6c00b040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 msgr2=0x7fef740b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 0x7fef740b0e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef700b1040 tx=0x7fef7001a530 comp rx=0 tx=0).stop 2023-12-19T16:15:46.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 shutdown_connections 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fef58065ab0 0x7fef58067f70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef7414de00 0x7fef74142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef74159940 0x7fef740ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 --2- 172.21.15.119:0/3714062158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef740afd10 0x7fef740b0e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 >> 172.21.15.119:0/3714062158 conn(0x7fef740ce130 msgr2=0x7fef740c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 shutdown_connections 2023-12-19T16:15:46.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fef7a862640 1 -- 172.21.15.119:0/3714062158 wait complete. 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc92c065a90 msgr2=0x7fc92c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc92c065a90 0x7fc92c067f50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9300af000 tx=0x7fc9300a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 msgr2=0x7fc94014f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc94014f980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc93400af70 tx=0x7fc93400cbd0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 shutdown_connections 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc92c065a90 0x7fc92c067f50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9400cd510 0x7fc94015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc940158860 0x7fc9400ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 --2- 172.21.15.119:0/2086129517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400700d0 0x7fc94014f980 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.695+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 >> 172.21.15.119:0/2086129517 conn(0x7fc94006a2a0 msgr2=0x7fc9400caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.699+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 shutdown_connections 2023-12-19T16:15:46.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.699+0000 7fc945cc4640 1 -- 172.21.15.119:0/2086129517 wait complete. 2023-12-19T16:15:46.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-12-19T16:15:46.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-12-19T16:15:46.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-12-19T16:15:46.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1af40cb2f0 con 0x7f1af4158c10 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1ae9ffb640 1 -- 172.21.15.119:0/833266786 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ae401f090 con 0x7f1af4158c10 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2023-12-19T16:15:46.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f24900b2580 con 0x7f24900ab8a0 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ad8065b30 msgr2=0x7f1ad8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ad8065b30 0x7f1ad8067ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1af00ae000 tx=0x7f1af00a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 msgr2=0x7f1af414d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 0x7f1af414d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40010f0 tx=0x7f1ae400c890 comp rx=0 tx=0).stop 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 shutdown_connections 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ad8065b30 0x7f1ad8067ff0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1af4158c10 0x7f1af414d360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1af4158830 0x7f1af4149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 --2- 172.21.15.119:0/833266786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af406d730 0x7f1af40b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 >> 172.21.15.119:0/833266786 conn(0x7f1af40cabf0 msgr2=0x7f1af40af360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 shutdown_connections 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f1adf7fe640 1 -- 172.21.15.119:0/833266786 wait complete. 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stdout:55834574856 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.747+0000 7f2486ffd640 1 -- 172.21.15.119:0/3128479074 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2480054440 con 0x7f24900ab8a0 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2474065b30 msgr2=0x7f2474067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2474065b30 0x7f2474067ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2488009d90 tx=0x7f24880a7070 comp rx=0 tx=0).stop 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 msgr2=0x7f2490158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f2490158900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f248000e8e0 tx=0x7f248000eda0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 shutdown_connections 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2474065b30 0x7f2474067ff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24900cad30 0x7f249015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f249015da60 0x7f249015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 --2- 172.21.15.119:0/3128479074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24900ab8a0 0x7f2490158900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 >> 172.21.15.119:0/3128479074 conn(0x7f24900afe90 msgr2=0x7f24900b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 shutdown_connections 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.751+0000 7f24983ce640 1 -- 172.21.15.119:0/3128479074 wait complete. 2023-12-19T16:15:46.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.767+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63840b09a0 con 0x7f6384159180 2023-12-19T16:15:46.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.767+0000 7f637affd640 1 -- 172.21.15.119:0/3394106581 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6374054af0 con 0x7f6384159180 2023-12-19T16:15:46.771 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6368065b30 msgr2=0x7f6368067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6368065b30 0x7f6368067ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63800aa000 tx=0x7f6380001940 comp rx=0 tx=0).stop 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6384159180 msgr2=0x7f63840aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6384159180 0x7f63840aec70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f637400e5c0 tx=0x7f637400ea80 comp rx=0 tx=0).stop 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 shutdown_connections 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6368065b30 0x7f6368067ff0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6384159180 0x7f63840aec70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63840c4100 0x7f63840c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 --2- 172.21.15.119:0/3394106581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6370003980 0x7f6384158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 >> 172.21.15.119:0/3394106581 conn(0x7f63840afc80 msgr2=0x7f63840cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 shutdown_connections 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.771+0000 7f638c655640 1 -- 172.21.15.119:0/3394106581 wait complete. 2023-12-19T16:15:46.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-12-19T16:15:46.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-12-19T16:15:46.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.3 2023-12-19T16:15:46.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feeb00057e0 con 0x7feecc0ab8a0 2023-12-19T16:15:46.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feebaffd640 1 -- 172.21.15.119:0/2074598270 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feec00eb250 con 0x7feecc0ab8a0 2023-12-19T16:15:46.814 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feeac065a60 msgr2=0x7feeac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feeac065a60 0x7feeac067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feecc15fe50 tx=0x7feebc009190 comp rx=0 tx=0).stop 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 msgr2=0x7feecc15bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 0x7feecc15bb40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feec001ab10 tx=0x7feec0019200 comp rx=0 tx=0).stop 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 shutdown_connections 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feeac065a60 0x7feeac067f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feecc15c7e0 0x7feecc0c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feecc0cd9a0 0x7feecc150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 --2- 172.21.15.119:0/2074598270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feecc0ab8a0 0x7feecc15bb40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 >> 172.21.15.119:0/2074598270 conn(0x7feecc0cabf0 msgr2=0x7feecc0ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 shutdown_connections 2023-12-19T16:15:46.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:46.811+0000 7feecb59e640 1 -- 172.21.15.119:0/2074598270 wait complete. 2023-12-19T16:15:46.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-12-19T16:15:47.730 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T16:15:47.731 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T16:15:47.738 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T16:15:47.743 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T16:15:47.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T16:15:47.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T16:15:47.802 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T16:15:47.836 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T16:15:47.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.927+0000 7f0073fff640 1 Processor -- start 2023-12-19T16:15:47.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.927+0000 7f0073fff640 1 -- start start 2023-12-19T16:15:47.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.927+0000 7f46081ce640 1 Processor -- start 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0073fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f00740cb6e0 0x7f00740c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0073fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0074071500 0x7f00741585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0073fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 0x7f007406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0073fff640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0074070e00 con 0x7f0074071500 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0073fff640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007406d9d0 con 0x7f00740cb6e0 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0073fff640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007415f860 con 0x7f007406d020 2023-12-19T16:15:47.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 -- start start 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f00737fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 0x7f007406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f00737fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 0x7f007406d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51514/0 (socket says 172.21.15.119:51514) 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f00737fe640 1 -- 172.21.15.119:0/2649750018 learned_addr learned my addr 172.21.15.119:0/2649750018 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f0072ffd640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.143:3300/0 conn(0x7f00740cb6e0 0x7f00740c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f46000cd380 0x7f460006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f46001649a0 0x7f46000cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f4605f6a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f46000cd380 0x7f460006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f4605f6a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f46000cd380 0x7f460006c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34338/0 (socket says 172.21.15.119:34338) 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4600165180 con 0x7f46001649a0 2023-12-19T16:15:47.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4600165460 con 0x7f46000cd380 2023-12-19T16:15:47.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f46081ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4600165740 con 0x7f46000cc710 2023-12-19T16:15:47.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f4605f6a640 1 -- 172.21.15.119:0/3920112539 learned_addr learned my addr 172.21.15.119:0/3920112539 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:47.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.931+0000 7f460676b640 1 --2- 172.21.15.119:0/3920112539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.935+0000 7f00727fc640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.119:3300/0 conn(0x7f0074071500 0x7f00741585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.935+0000 7f460676b640 1 -- 172.21.15.119:0/3920112539 >> v2:172.21.15.143:3300/0 conn(0x7f46000cd380 msgr2=0x7f460006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.935+0000 7f460676b640 1 --2- 172.21.15.119:0/3920112539 >> v2:172.21.15.143:3300/0 conn(0x7f46000cd380 0x7f460006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.935+0000 7f460676b640 1 -- 172.21.15.119:0/3920112539 >> v2:172.21.15.119:3300/0 conn(0x7f46001649a0 msgr2=0x7f46000cc1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.935+0000 7f460676b640 1 --2- 172.21.15.119:0/3920112539 >> v2:172.21.15.119:3300/0 conn(0x7f46001649a0 0x7f46000cc1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.935+0000 7f460676b640 1 -- 172.21.15.119:0/3920112539 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46001616f0 con 0x7f46000cc710 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f00737fe640 1 -- 172.21.15.119:0/2649750018 >> v2:172.21.15.143:3300/0 conn(0x7f00740cb6e0 msgr2=0x7f00740c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f00737fe640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.143:3300/0 conn(0x7f00740cb6e0 0x7f00740c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f00737fe640 1 -- 172.21.15.119:0/2649750018 >> v2:172.21.15.119:3300/0 conn(0x7f0074071500 msgr2=0x7f00741585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f00737fe640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.119:3300/0 conn(0x7f0074071500 0x7f00741585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f00737fe640 1 -- 172.21.15.119:0/2649750018 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074070180 con 0x7f007406d020 2023-12-19T16:15:47.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f00727fc640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.119:3300/0 conn(0x7f0074071500 0x7f00741585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:47.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f460676b640 1 --2- 172.21.15.119:0/3920112539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600161c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f460006d0a0 tx=0x7f45fc01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1385fd5b373b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:47.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f4604f68640 1 -- 172.21.15.119:0/3920112539 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0ab660 con 0x7f46000cc710 2023-12-19T16:15:47.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f4604f68640 1 -- 172.21.15.119:0/3920112539 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc0ab7c0 con 0x7f46000cc710 2023-12-19T16:15:47.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f4604f68640 1 -- 172.21.15.119:0/3920112539 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0abb50 con 0x7f46000cc710 2023-12-19T16:15:47.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f46081ce640 1 -- 172.21.15.119:0/3920112539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 msgr2=0x7f4600161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.939+0000 7f46081ce640 1 --2- 172.21.15.119:0/3920112539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600161c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f460006d0a0 tx=0x7f45fc01c460 comp rx=0 tx=0).stop 2023-12-19T16:15:47.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 -- 172.21.15.119:0/3920112539 shutdown_connections 2023-12-19T16:15:47.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 --2- 172.21.15.119:0/3920112539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600161c10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 --2- 172.21.15.119:0/3920112539 >> v2:172.21.15.119:3300/0 conn(0x7f46001649a0 0x7f46000cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 --2- 172.21.15.119:0/3920112539 >> v2:172.21.15.143:3300/0 conn(0x7f46000cd380 0x7f460006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 -- 172.21.15.119:0/3920112539 >> 172.21.15.119:0/3920112539 conn(0x7f46000afe90 msgr2=0x7f46000b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 -- 172.21.15.119:0/3920112539 shutdown_connections 2023-12-19T16:15:47.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f46081ce640 1 -- 172.21.15.119:0/3920112539 wait complete. 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f00737fe640 1 --2- 172.21.15.119:0/2649750018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 0x7f007406d490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f007406e030 tx=0x7f006c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02c4ec1d91f701a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f0071ffb640 1 -- 172.21.15.119:0/2649750018 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0a89b0 con 0x7f007406d020 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f0071ffb640 1 -- 172.21.15.119:0/2649750018 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0a8b10 con 0x7f007406d020 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f0073fff640 1 -- 172.21.15.119:0/2649750018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 msgr2=0x7f007406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f0071ffb640 1 -- 172.21.15.119:0/2649750018 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0a89b0 con 0x7f007406d020 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.943+0000 7f0073fff640 1 --2- 172.21.15.119:0/2649750018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 0x7f007406d490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f007406e030 tx=0x7f006c01ed10 comp rx=0 tx=0).stop 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 -- 172.21.15.119:0/2649750018 shutdown_connections 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 --2- 172.21.15.119:0/2649750018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f007406d020 0x7f007406d490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.119:3300/0 conn(0x7f0074071500 0x7f00741585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 --2- 172.21.15.119:0/2649750018 >> v2:172.21.15.143:3300/0 conn(0x7f00740cb6e0 0x7f00740c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 -- 172.21.15.119:0/2649750018 >> 172.21.15.119:0/2649750018 conn(0x7f00740cabf0 msgr2=0x7f00740cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 -- 172.21.15.119:0/2649750018 shutdown_connections 2023-12-19T16:15:47.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 -- 172.21.15.119:0/2649750018 wait complete. 2023-12-19T16:15:47.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f46081ce640 1 Processor -- start 2023-12-19T16:15:47.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f46081ce640 1 -- start start 2023-12-19T16:15:47.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 Processor -- start 2023-12-19T16:15:47.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.947+0000 7f0073fff640 1 -- start start 2023-12-19T16:15:47.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0073fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f007406d020 0x7f007414bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46000cd380 0x7f46001639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46001649a0 0x7f4600163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000c7010 con 0x7f46000cd380 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0073fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 0x7f00740b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0073fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740cb6e0 0x7f00740c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0073fff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740b1410 con 0x7f00740cb6e0 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0073fff640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007414c050 con 0x7f007406d020 2023-12-19T16:15:47.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0073fff640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007415bf70 con 0x7f0074071500 2023-12-19T16:15:47.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51524/0 (socket says 172.21.15.119:51524) 2023-12-19T16:15:47.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 -- 172.21.15.119:0/4256741247 learned_addr learned my addr 172.21.15.119:0/4256741247 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:47.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000c72f0 con 0x7f46001649a0 2023-12-19T16:15:47.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46000c75d0 con 0x7f46000cc710 2023-12-19T16:15:47.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f0072ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f007406d020 0x7f007414bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 0x7f00740b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 0x7f00740b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51534/0 (socket says 172.21.15.119:51534) 2023-12-19T16:15:47.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 -- 172.21.15.119:0/1140597022 learned_addr learned my addr 172.21.15.119:0/1140597022 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:47.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00737fe640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740cb6e0 0x7f00740c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 -- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46001649a0 msgr2=0x7f4600163f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46001649a0 0x7f4600163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 -- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46000cd380 msgr2=0x7f46001639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605769640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46000cd380 0x7f46001639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46000cd380 0x7f46001639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009420 con 0x7f46000cc710 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605769640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46000cd380 0x7f46001639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f4605f6a640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600159170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f45f800efc0 tx=0x7f45f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800cda0 con 0x7f46000cc710 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f800f040 con 0x7f46000cc710 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80146a0 con 0x7f46000cc710 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f46081ce640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46000c78b0 con 0x7f46000cc710 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f46081ce640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46000c7c20 con 0x7f46000cc710 2023-12-19T16:15:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 -- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f007406d020 msgr2=0x7f007414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f007406d020 0x7f007414bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 -- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740cb6e0 msgr2=0x7f00740c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740cb6e0 0x7f00740c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 -- 172.21.15.119:0/1140597022 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0094d0 con 0x7f0074071500 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.951+0000 7f00727fc640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 0x7f00740b1830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f005c00e810 tx=0x7f005c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c004030 con 0x7f0074071500 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c004190 con 0x7f0074071500 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c004520 con 0x7f0074071500 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f0073fff640 1 -- 172.21.15.119:0/1140597022 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007414e190 con 0x7f0074071500 2023-12-19T16:15:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f0073fff640 1 -- 172.21.15.119:0/1140597022 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00740b1030 con 0x7f0074071500 2023-12-19T16:15:47.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45f8014800 con 0x7f46000cc710 2023-12-19T16:15:47.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f46081ce640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460004e000 con 0x7f46000cc710 2023-12-19T16:15:47.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.955+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00740b1550 con 0x7f0074071500 2023-12-19T16:15:47.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f45f67fc640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e4065a90 0x7f45e4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45f8083db0 con 0x7f46000cc710 2023-12-19T16:15:47.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f4605769640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e4065a90 0x7f45e4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f005c00c6d0 con 0x7f0074071500 2023-12-19T16:15:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f006b7fe640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0054065ab0 0x7f0054067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f4605769640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e4065a90 0x7f45e4067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46000afae0 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f005c054340 con 0x7f0074071500 2023-12-19T16:15:47.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.959+0000 7f0072ffd640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0054065ab0 0x7f0054067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:47.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.963+0000 7f0072ffd640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0054065ab0 0x7f0054067f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0074143360 tx=0x7f006400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.967+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45f8088070 con 0x7f46000cc710 2023-12-19T16:15:47.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:47.971+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f005c050e10 con 0x7f0074071500 2023-12-19T16:15:48.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.007+0000 7fbbfa611640 1 Processor -- start 2023-12-19T16:15:48.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.007+0000 7fbbfa611640 1 -- start start 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.007+0000 7fbbfa611640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbbf4158880 0x7fbbf40ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbfa611640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 0x7fbbf40c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbfa611640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40cc880 con 0x7fbbf406d0b0 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbfa611640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40cbc70 con 0x7fbbf4158880 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbfa611640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40cbf50 con 0x7fbbf40c96c0 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 0x7fbbf40c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 0x7fbbf40c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51540/0 (socket says 172.21.15.119:51540) 2023-12-19T16:15:48.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1054360214 learned_addr learned my addr 172.21.15.119:0/1054360214 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7f15f5a97640 1 Processor -- start 2023-12-19T16:15:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7f15f5a97640 1 -- start start 2023-12-19T16:15:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1054360214 >> v2:172.21.15.119:3300/0 conn(0x7fbbf4158880 msgr2=0x7fbbf40ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 --2- 172.21.15.119:0/1054360214 >> v2:172.21.15.119:3300/0 conn(0x7fbbf4158880 0x7fbbf40ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1054360214 >> v1:172.21.15.119:6789/0 conn(0x7fbbf406d0b0 legacy=0x7fbbf406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.011+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1054360214 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40cc230 con 0x7fbbf40c96c0 2023-12-19T16:15:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f5a97640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f00cc8b0 0x7f15f014f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f5a97640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15f014f8c0 0x7f15f00c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f5a97640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00c2ff0 con 0x7f15f00c49e0 2023-12-19T16:15:48.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f5a97640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f0159440 con 0x7f15f014f8c0 2023-12-19T16:15:48.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f5a97640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00ccd80 con 0x7f15f00cc8b0 2023-12-19T16:15:48.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f4a95640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f15f00c49e0 0x7f15f00cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:35442/0 (socket says 172.21.15.119:35442) 2023-12-19T16:15:48.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f4a95640 1 -- 172.21.15.119:0/2593058058 learned_addr learned my addr 172.21.15.119:0/2593058058 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:48.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15effff640 1 --2- 172.21.15.119:0/2593058058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f00cc8b0 0x7f15f014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15f5296640 1 --2- 172.21.15.119:0/2593058058 >> v2:172.21.15.119:3300/0 conn(0x7f15f014f8c0 0x7f15f00c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7fbbf8e0e640 1 --2- 172.21.15.119:0/1054360214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 0x7fbbf40c9b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00091e0 tx=0x7fbbf001d740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47adf5db3d19726d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15effff640 1 -- 172.21.15.119:0/2593058058 >> v2:172.21.15.119:3300/0 conn(0x7f15f014f8c0 msgr2=0x7f15f00c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15effff640 1 --2- 172.21.15.119:0/2593058058 >> v2:172.21.15.119:3300/0 conn(0x7f15f014f8c0 0x7f15f00c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15effff640 1 -- 172.21.15.119:0/2593058058 >> v1:172.21.15.143:6789/0 conn(0x7f15f00c49e0 legacy=0x7f15f00cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.015+0000 7f15effff640 1 -- 172.21.15.119:0/2593058058 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00cd060 con 0x7f15f00cc8b0 2023-12-19T16:15:48.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbebfff640 1 -- 172.21.15.119:0/1054360214 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00a6740 con 0x7fbbf40c96c0 2023-12-19T16:15:48.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbebfff640 1 -- 172.21.15.119:0/1054360214 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf00a68a0 con 0x7fbbf40c96c0 2023-12-19T16:15:48.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbebfff640 1 -- 172.21.15.119:0/1054360214 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00a6c30 con 0x7fbbf40c96c0 2023-12-19T16:15:48.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 -- 172.21.15.119:0/1054360214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 msgr2=0x7fbbf40c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1054360214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 0x7fbbf40c9b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00091e0 tx=0x7fbbf001d740 comp rx=0 tx=0).stop 2023-12-19T16:15:48.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 -- 172.21.15.119:0/1054360214 shutdown_connections 2023-12-19T16:15:48.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1054360214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf40c96c0 0x7fbbf40c9b20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1054360214 >> v2:172.21.15.119:3300/0 conn(0x7fbbf4158880 0x7fbbf40ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 -- 172.21.15.119:0/1054360214 >> 172.21.15.119:0/1054360214 conn(0x7fbbf40afd80 msgr2=0x7fbbf40b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 -- 172.21.15.119:0/1054360214 shutdown_connections 2023-12-19T16:15:48.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.019+0000 7fbbfa611640 1 -- 172.21.15.119:0/1054360214 wait complete. 2023-12-19T16:15:48.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15effff640 1 --2- 172.21.15.119:0/2593058058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f00cc8b0 0x7f15f014f380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15e80097c0 tx=0x7f15e801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d843fdd1ce8d4307 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15ef7fe640 1 -- 172.21.15.119:0/2593058058 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80ad660 con 0x7f15f00cc8b0 2023-12-19T16:15:48.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15ef7fe640 1 -- 172.21.15.119:0/2593058058 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80ad7c0 con 0x7f15f00cc8b0 2023-12-19T16:15:48.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15ef7fe640 1 -- 172.21.15.119:0/2593058058 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80adb50 con 0x7f15f00cc8b0 2023-12-19T16:15:48.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 Processor -- start 2023-12-19T16:15:48.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 -- start start 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 -- 172.21.15.119:0/2593058058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f00cc8b0 msgr2=0x7f15f014f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 --2- 172.21.15.119:0/2593058058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f00cc8b0 0x7f15f014f380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15e80097c0 tx=0x7f15e801c470 comp rx=0 tx=0).stop 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 -- 172.21.15.119:0/2593058058 shutdown_connections 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 --2- 172.21.15.119:0/2593058058 >> v2:172.21.15.119:3300/0 conn(0x7f15f014f8c0 0x7f15f00c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 --2- 172.21.15.119:0/2593058058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f00cc8b0 0x7f15f014f380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 -- 172.21.15.119:0/2593058058 >> 172.21.15.119:0/2593058058 conn(0x7f15f00afd80 msgr2=0x7f15f00b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 -- 172.21.15.119:0/2593058058 shutdown_connections 2023-12-19T16:15:48.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf406d0b0 0x7fbbf41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 0x7fbbf4156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbf4158880 0x7fbbf41574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40b1940 con 0x7fbbf40c96c0 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40c7220 con 0x7fbbf4158880 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f1f78ff3640 1 Processor -- start 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f1f78ff3640 1 -- start start 2023-12-19T16:15:48.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f78ff3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f740cb480 0x7f1f740cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f78ff3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f740cdba0 0x7f1f74158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f78ff3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f740cbf30 con 0x7f1f74158790 2023-12-19T16:15:48.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f78ff3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7415a0c0 con 0x7f1f740cdba0 2023-12-19T16:15:48.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f78ff3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7415d090 con 0x7f1f740cb480 2023-12-19T16:15:48.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7fbbfa611640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4157b20 con 0x7fbbf406d0b0 2023-12-19T16:15:48.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.023+0000 7f15f5a97640 1 -- 172.21.15.119:0/2593058058 wait complete. 2023-12-19T16:15:48.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f740cdba0 0x7f1f74158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f740cdba0 0x7f1f74158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34370/0 (socket says 172.21.15.119:34370) 2023-12-19T16:15:48.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 -- 172.21.15.119:0/3736020917 learned_addr learned my addr 172.21.15.119:0/3736020917 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 Processor -- start 2023-12-19T16:15:48.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 0x7fbbf4156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 0x7fbbf4156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56958/0 (socket says 172.21.15.119:56958) 2023-12-19T16:15:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf9e10640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbf4158880 0x7fbbf41574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1688453359 learned_addr learned my addr 172.21.15.119:0/1688453359 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 -- start start 2023-12-19T16:15:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f71d9b640 1 --2- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f740cb480 0x7f1f740cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 -- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f740cb480 msgr2=0x7f1f740cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 --2- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f740cb480 0x7f1f740cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 -- 172.21.15.119:0/3736020917 >> v1:172.21.15.119:6789/0 conn(0x7f1f74158790 legacy=0x7f1f740cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f1f72d9d640 1 -- 172.21.15.119:0/3736020917 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7415c4c0 con 0x7f1f740cdba0 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1688453359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf406d0b0 msgr2=0x7fbbf41530e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf406d0b0 0x7fbbf41530e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1688453359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbf4158880 msgr2=0x7fbbf41574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbf4158880 0x7fbbf41574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7fbbf8e0e640 1 -- 172.21.15.119:0/1688453359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0009d60 con 0x7fbbf40c96c0 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 0x7f15f00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00cc8b0 0x7f15f00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f014f8c0 0x7f15f02020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00b3990 con 0x7f15f00cc8b0 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00b0db0 con 0x7f15f00c49e0 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.027+0000 7f15f5a97640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00b1090 con 0x7f15f014f8c0 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 0x7f15f00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 0x7f15f00b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34394/0 (socket says 172.21.15.119:34394) 2023-12-19T16:15:48.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 -- 172.21.15.119:0/254908872 learned_addr learned my addr 172.21.15.119:0/254908872 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fbbf8e0e640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 0x7fbbf4156fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00b1040 tx=0x7fbbf001a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f5296640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f014f8c0 0x7f15f02020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 -- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f014f8c0 msgr2=0x7f15f02020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f014f8c0 0x7f15f02020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 -- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00cc8b0 msgr2=0x7f15f00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00cc8b0 0x7f15f00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 -- 172.21.15.119:0/254908872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009420 con 0x7f15f00c49e0 2023-12-19T16:15:48.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f4a95640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 0x7f15f00b2d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15e000cba0 tx=0x7f15e000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00ae990 con 0x7fbbf40c96c0 2023-12-19T16:15:48.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf00aeaf0 con 0x7fbbf40c96c0 2023-12-19T16:15:48.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00aeea0 con 0x7fbbf40c96c0 2023-12-19T16:15:48.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf406da50 con 0x7fbbf40c96c0 2023-12-19T16:15:48.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000ad40 con 0x7f15f00c49e0 2023-12-19T16:15:48.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e0012400 con 0x7f15f00c49e0 2023-12-19T16:15:48.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000aea0 con 0x7f15f00c49e0 2023-12-19T16:15:48.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf40b1280 con 0x7fbbf40c96c0 2023-12-19T16:15:48.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f15f5a97640 1 -- 172.21.15.119:0/254908872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00b1370 con 0x7f15f00c49e0 2023-12-19T16:15:48.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fcb8b266640 1 Processor -- start 2023-12-19T16:15:48.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f1f72d9d640 1 --2- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cdba0 0x7f1f74158b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009870 tx=0x7f1f6801e710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95030b20a1953d49 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7fcb8b266640 1 -- start start 2023-12-19T16:15:48.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.031+0000 7f1f7159a640 1 -- 172.21.15.119:0/3736020917 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f680a8680 con 0x7f1f740cdba0 2023-12-19T16:15:48.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f1f7159a640 1 -- 172.21.15.119:0/3736020917 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f680a87e0 con 0x7f1f740cdba0 2023-12-19T16:15:48.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f1f7159a640 1 -- 172.21.15.119:0/3736020917 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f680a8680 con 0x7f1f740cdba0 2023-12-19T16:15:48.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f15f5a97640 1 -- 172.21.15.119:0/254908872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f00b1930 con 0x7f15f00c49e0 2023-12-19T16:15:48.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40b1a80 con 0x7fbbf40c96c0 2023-12-19T16:15:48.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbbf00c2460 con 0x7fbbf40c96c0 2023-12-19T16:15:48.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb8b266640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcb840cad30 0x7fcb840cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb8b266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 0x7fcb8406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb8b266640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8406bde0 con 0x7fcb840ab8a0 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb8b266640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb840cb650 con 0x7fcb840cad30 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb8b266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84160810 con 0x7fcb840abd30 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 0x7fcb8406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 0x7fcb8406c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:51588/0 (socket says 172.21.15.119:51588) 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 -- 172.21.15.119:0/3594799209 learned_addr learned my addr 172.21.15.119:0/3594799209 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89002640 1 --2- 172.21.15.119:0/3594799209 >> v2:172.21.15.119:3300/0 conn(0x7fcb840cad30 0x7fcb840cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 -- 172.21.15.119:0/3594799209 >> v2:172.21.15.119:3300/0 conn(0x7fcb840cad30 msgr2=0x7fcb840cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f1f78ff3640 1 -- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cdba0 msgr2=0x7f1f74158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cdba0 0x7f1f74158b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009870 tx=0x7f1f6801e710 comp rx=0 tx=0).stop 2023-12-19T16:15:48.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 --2- 172.21.15.119:0/3594799209 >> v2:172.21.15.119:3300/0 conn(0x7fcb840cad30 0x7fcb840cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 -- 172.21.15.119:0/3594799209 >> v1:172.21.15.143:6789/0 conn(0x7fcb840ab8a0 legacy=0x7fcb8415d520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T16:15:48.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89803640 1 -- 172.21.15.119:0/3594799209 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84160af0 con 0x7fcb840abd30 2023-12-19T16:15:48.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fcb89002640 1 --2- 172.21.15.119:0/3594799209 >> v2:172.21.15.119:3300/0 conn(0x7fcb840cad30 0x7fcb840cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:48.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f1f78ff3640 1 -- 172.21.15.119:0/3736020917 shutdown_connections 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f740cb480 0x7f1f740cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/3736020917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cdba0 0x7f1f74158b70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f1f78ff3640 1 -- 172.21.15.119:0/3736020917 >> 172.21.15.119:0/3736020917 conn(0x7f1f7406a3e0 msgr2=0x7f1f740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f1f78ff3640 1 -- 172.21.15.119:0/3736020917 shutdown_connections 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f1f78ff3640 1 -- 172.21.15.119:0/3736020917 wait complete. 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f15e0012770 con 0x7f15f00c49e0 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f004e850 con 0x7f15f00c49e0 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f15ed7fa640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f15dc065a60 0x7f15dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15e00831f0 con 0x7f15f00c49e0 2023-12-19T16:15:48.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fbbe9ffb640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbd8065a60 0x7fbbd8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbf00efec0 con 0x7fbbf40c96c0 2023-12-19T16:15:48.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.035+0000 7fbbf960f640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbd8065a60 0x7fbbd8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7fbbf960f640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbd8065a60 0x7fbbd8067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40096b0 tx=0x7fbbe4006c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f15effff640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f15dc065a60 0x7f15dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.039+0000 7f15effff640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f15dc065a60 0x7f15dc067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f15e80af000 tx=0x7f15e8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb89803640 1 --2- 172.21.15.119:0/3594799209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 0x7fcb8406c270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb740098a0 tx=0x7fcb7401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7b936096260ea5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb7bfff640 1 -- 172.21.15.119:0/3594799209 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740ad640 con 0x7fcb840abd30 2023-12-19T16:15:48.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7f1f78ff3640 1 Processor -- start 2023-12-19T16:15:48.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb7bfff640 1 -- 172.21.15.119:0/3594799209 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740ad7a0 con 0x7fcb840abd30 2023-12-19T16:15:48.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb7bfff640 1 -- 172.21.15.119:0/3594799209 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740adb30 con 0x7fcb840abd30 2023-12-19T16:15:48.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb8b266640 1 -- 172.21.15.119:0/3594799209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 msgr2=0x7fcb8406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3594799209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 0x7fcb8406c270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb740098a0 tx=0x7fcb7401c4e0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7f1f78ff3640 1 -- start start 2023-12-19T16:15:48.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb8b266640 1 -- 172.21.15.119:0/3594799209 shutdown_connections 2023-12-19T16:15:48.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3594799209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840abd30 0x7fcb8406c270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3594799209 >> v2:172.21.15.119:3300/0 conn(0x7fcb840cad30 0x7fcb840cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7fcb8b266640 1 -- 172.21.15.119:0/3594799209 >> 172.21.15.119:0/3594799209 conn(0x7fcb840afe90 msgr2=0x7fcb840b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f15e0088060 con 0x7f15f00c49e0 2023-12-19T16:15:48.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.043+0000 7f1f78ff3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cb480 0x7f1f7414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f78ff3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 0x7f1f740ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f78ff3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f74158790 0x7f1f7415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f78ff3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740aef40 con 0x7f1f740cdba0 2023-12-19T16:15:48.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f78ff3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740af220 con 0x7f1f740cb480 2023-12-19T16:15:48.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f78ff3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740af500 con 0x7f1f74158790 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 0x7f1f740ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 0x7f1f740ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56992/0 (socket says 172.21.15.119:56992) 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 -- 172.21.15.119:0/1292852285 learned_addr learned my addr 172.21.15.119:0/1292852285 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f72d9d640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f74158790 0x7f1f7415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f7259c640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cb480 0x7f1f7414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7fcb8b266640 1 -- 172.21.15.119:0/3594799209 shutdown_connections 2023-12-19T16:15:48.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7fcb8b266640 1 -- 172.21.15.119:0/3594799209 wait complete. 2023-12-19T16:15:48.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 -- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f74158790 msgr2=0x7f1f7415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f74158790 0x7f1f7415a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 -- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cb480 msgr2=0x7f1f7414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cb480 0x7f1f7414a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 -- 172.21.15.119:0/1292852285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680094d0 con 0x7f1f740cdba0 2023-12-19T16:15:48.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f71d9b640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 0x7f1f740ae6e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400d800 tx=0x7f1f6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400b6c0 con 0x7f1f740cdba0 2023-12-19T16:15:48.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400b820 con 0x7f1f740cdba0 2023-12-19T16:15:48.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400bb90 con 0x7f1f740cdba0 2023-12-19T16:15:48.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f740ce1d0 con 0x7f1f740cdba0 2023-12-19T16:15:48.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f740aec20 con 0x7f1f740cdba0 2023-12-19T16:15:48.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.047+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbbf00ec290 con 0x7fbbf40c96c0 2023-12-19T16:15:48.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb8b266640 1 Processor -- start 2023-12-19T16:15:48.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb8b266640 1 -- start start 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb8b266640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb840ab8a0 0x7fcb8415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb89002640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb840ab8a0 0x7fcb8415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb89002640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb840ab8a0 0x7fcb8415c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57002/0 (socket says 172.21.15.119:57002) 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb89002640 1 -- 172.21.15.119:0/3265193701 learned_addr learned my addr 172.21.15.119:0/3265193701 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb840abd30 0x7fcb840b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840cad30 0x7fcb840b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb88801640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb840abd30 0x7fcb840b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840cad30 0x7fcb840b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8414c8e0 con 0x7fcb840ab8a0 2023-12-19T16:15:48.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8414bd40 con 0x7fcb840abd30 2023-12-19T16:15:48.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8414bfb0 con 0x7fcb840cad30 2023-12-19T16:15:48.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.051+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f6400bcf0 con 0x7f1f740cdba0 2023-12-19T16:15:48.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7f1f62ffd640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f54065ab0 0x7f1f54067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 -- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb840abd30 msgr2=0x7fcb840b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb840abd30 0x7fcb840b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f64054b50 con 0x7f1f740cdba0 2023-12-19T16:15:48.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 -- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb840ab8a0 msgr2=0x7fcb8415c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb840ab8a0 0x7fcb8415c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c009a70 con 0x7fcb840cad30 2023-12-19T16:15:48.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb89803640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840cad30 0x7fcb840b2510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb740ac000 tx=0x7fcb74019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740ba070 con 0x7fcb840cad30 2023-12-19T16:15:48.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740a6050 con 0x7fcb840cad30 2023-12-19T16:15:48.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740b6660 con 0x7fcb840cad30 2023-12-19T16:15:48.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb740094d0 con 0x7fcb840cad30 2023-12-19T16:15:48.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.055+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f740735b0 con 0x7f1f740cdba0 2023-12-19T16:15:48.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.059+0000 7f1f7259c640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f54065ab0 0x7f1f54067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.059+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8414c570 con 0x7fcb840cad30 2023-12-19T16:15:48.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.059+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcb740b4070 con 0x7fcb840cad30 2023-12-19T16:15:48.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.063+0000 7f1f7259c640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f54065ab0 0x7f1f54067f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c007dc0 tx=0x7f1f6c0072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.063+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8414ca90 con 0x7fcb840cad30 2023-12-19T16:15:48.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.063+0000 7fcb79ffb640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb68065b30 0x7fcb68067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.063+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb7411ce00 con 0x7fcb840cad30 2023-12-19T16:15:48.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.063+0000 7fcb89002640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb68065b30 0x7fcb68067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.063+0000 7fcb89002640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb68065b30 0x7fcb68067ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb8406c2e0 tx=0x7fcb7c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.067+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f64050790 con 0x7f1f740cdba0 2023-12-19T16:15:48.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.067+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcb8414ca90 con 0x7fcb840cad30 2023-12-19T16:15:48.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 Processor -- start 2023-12-19T16:15:48.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 -- start start 2023-12-19T16:15:48.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf00cad30 0x7fdcf00cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcf00ab8a0 0x7fdcf015d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdcf015da60 0x7fdcf006c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf006bde0 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf00cb650 con 0x7fdcf015da60 2023-12-19T16:15:48.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf7020640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0160810 con 0x7fdcf00cad30 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdcf015da60 0x7fdcf006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdcf015da60 0x7fdcf006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34414/0 (socket says 172.21.15.119:34414) 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 -- 172.21.15.119:0/512946290 learned_addr learned my addr 172.21.15.119:0/512946290 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdceffff640 1 --2- 172.21.15.119:0/512946290 >> v2:172.21.15.119:3300/0 conn(0x7fdcf00ab8a0 0x7fdcf015d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 -- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf00cad30 msgr2=0x7fdcf00cb110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 --2- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf00cad30 0x7fdcf00cb110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 -- 172.21.15.119:0/512946290 >> v2:172.21.15.119:3300/0 conn(0x7fdcf00ab8a0 msgr2=0x7fdcf015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 --2- 172.21.15.119:0/512946290 >> v2:172.21.15.119:3300/0 conn(0x7fdcf00ab8a0 0x7fdcf015d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.111+0000 7fdcf55bd640 1 -- 172.21.15.119:0/512946290 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0160af0 con 0x7fdcf015da60 2023-12-19T16:15:48.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.115+0000 7f4cdba1f640 1 Processor -- start 2023-12-19T16:15:48.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cdba1f640 1 -- start start 2023-12-19T16:15:48.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7fdcf55bd640 1 --2- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf015da60 0x7fdcf006c270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00cba10 tx=0x7fdce401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beee5ff92c073ba9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7fdcef7fe640 1 -- 172.21.15.119:0/512946290 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab600 con 0x7fdcf015da60 2023-12-19T16:15:48.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7fdcef7fe640 1 -- 172.21.15.119:0/512946290 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce40a7050 con 0x7fdcf015da60 2023-12-19T16:15:48.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7fdcef7fe640 1 -- 172.21.15.119:0/512946290 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab600 con 0x7fdcf015da60 2023-12-19T16:15:48.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cdba1f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4cd40cb340 0x7f4cd40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7fdcf7020640 1 -- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf015da60 msgr2=0x7fdcf006c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7fdcf7020640 1 --2- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf015da60 0x7fdcf006c270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00cba10 tx=0x7fdce401c520 comp rx=0 tx=0).stop 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cdba1f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd406fdb0 con 0x7f4cd4160cc0 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cdba1f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd4164820 con 0x7f4cd40c1280 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cdba1f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd41654a0 con 0x7f4cd40cb340 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cd97bb640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4cd4160cc0 0x7f4cd40cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59552/0 (socket says 172.21.15.119:59552) 2023-12-19T16:15:48.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.119+0000 7f4cd97bb640 1 -- 172.21.15.119:0/2973738360 learned_addr learned my addr 172.21.15.119:0/2973738360 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:48.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841752825 0 0) 0x7f4cd4164820 con 0x7f4cd40c1280 2023-12-19T16:15:48.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc0003530 con 0x7f4cd40c1280 2023-12-19T16:15:48.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765888828 0 0) 0x7f4cd406fdb0 con 0x7f4cd4160cc0 2023-12-19T16:15:48.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd4164820 con 0x7f4cd4160cc0 2023-12-19T16:15:48.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605000910 0 0) 0x7f4cc0003530 con 0x7f4cd40c1280 2023-12-19T16:15:48.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 >> v2:172.21.15.119:3300/0 conn(0x7f4cd40cb340 msgr2=0x7f4cd40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 --2- 172.21.15.119:0/2973738360 >> v2:172.21.15.119:3300/0 conn(0x7f4cd40cb340 0x7f4cd40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 >> v1:172.21.15.119:6789/0 conn(0x7f4cd4160cc0 legacy=0x7f4cd40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4164b00 con 0x7f4cd40c1280 2023-12-19T16:15:48.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f4ccc001a00 con 0x7f4cd40c1280 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 >> v1:172.21.15.143:6789/0 conn(0x7f4cd40c1280 legacy=0x7f4cd40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc0003b10 0x7f4cc0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cc0005390 0x7f4cc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41654a0 con 0x7f4cc0003b10 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc000c230 con 0x7f4cc00047d0 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc000c3f0 con 0x7f4cc0005390 2023-12-19T16:15:48.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4cd8fba640 1 -- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cc0005390 msgr2=0x7f4cc000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:15:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cc0005390 0x7f4cc000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4cd8fba640 1 -- 172.21.15.119:0/2973738360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc0003b10 msgr2=0x7f4cc0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc0003b10 0x7f4cc0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.123+0000 7f4cd8fba640 1 -- 172.21.15.119:0/2973738360 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4164b00 con 0x7f4cc00047d0 2023-12-19T16:15:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 -- 172.21.15.119:0/512946290 shutdown_connections 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 --2- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf015da60 0x7fdcf006c270 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 --2- 172.21.15.119:0/512946290 >> v2:172.21.15.119:3300/0 conn(0x7fdcf00ab8a0 0x7fdcf015d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 --2- 172.21.15.119:0/512946290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf00cad30 0x7fdcf00cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 -- 172.21.15.119:0/512946290 >> 172.21.15.119:0/512946290 conn(0x7fdcf00afe90 msgr2=0x7fdcf00b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7f4cd9fbc640 1 -- 172.21.15.119:0/2973738360 reap_dead start 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 -- 172.21.15.119:0/512946290 shutdown_connections 2023-12-19T16:15:48.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 -- 172.21.15.119:0/512946290 wait complete. 2023-12-19T16:15:48.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 Processor -- start 2023-12-19T16:15:48.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7fdcf7020640 1 -- start start 2023-12-19T16:15:48.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.127+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cc0004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00c490 tx=0x7f4ccc01cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5949966e7768229 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a5cb0 con 0x7f4cc00047d0 2023-12-19T16:15:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0a5e30 con 0x7f4cc00047d0 2023-12-19T16:15:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4ccbfff640 1 -- 172.21.15.119:0/2973738360 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0ad660 con 0x7f4cc00047d0 2023-12-19T16:15:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 msgr2=0x7f4cc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cc0004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00c490 tx=0x7f4ccc01cee0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2973738360 shutdown_connections 2023-12-19T16:15:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2973738360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cc0004c50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2973738360 >> 172.21.15.119:0/2973738360 conn(0x7f4cd406a3e0 msgr2=0x7f4cd40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2973738360 shutdown_connections 2023-12-19T16:15:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2973738360 wait complete. 2023-12-19T16:15:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf7020640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 0x7fdcf0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf7020640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcf00cad30 0x7fdcf0158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf4dbc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 0x7fdcf0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf4dbc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 0x7fdcf0151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:34428/0 (socket says 172.21.15.119:34428) 2023-12-19T16:15:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf4dbc640 1 -- 172.21.15.119:0/2508569564 learned_addr learned my addr 172.21.15.119:0/2508569564 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf015da60 0x7fdcf0159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.131+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0156bb0 con 0x7fdcf00cad30 2023-12-19T16:15:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0159f90 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf55bd640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf015da60 0x7fdcf0159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0159cb0 con 0x7fdcf015da60 2023-12-19T16:15:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 Processor -- start 2023-12-19T16:15:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 -- start start 2023-12-19T16:15:48.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf4dbc640 1 -- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf015da60 msgr2=0x7fdcf0159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf4dbc640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf015da60 0x7fdcf0159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf4dbc640 1 -- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcf00cad30 msgr2=0x7fdcf0158f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:15:48.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdceffff640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcf00cad30 0x7fdcf0158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf4dbc640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcf00cad30 0x7fdcf0158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf4dbc640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40094d0 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cd40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cd414b8c0 0x7f4cd40c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4157b80 0x7f4cd4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4158540 con 0x7f4cd4157b80 2023-12-19T16:15:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd40b0e90 con 0x7f4cc00047d0 2023-12-19T16:15:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cdba1f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd40b1170 con 0x7f4cd414b8c0 2023-12-19T16:15:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdceffff640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcf00cad30 0x7fdcf0158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cd9fbc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4157b80 0x7f4cd4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cd9fbc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4157b80 0x7f4cd4158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57042/0 (socket says 172.21.15.119:57042) 2023-12-19T16:15:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cd9fbc640 1 -- 172.21.15.119:0/2309568176 learned_addr learned my addr 172.21.15.119:0/2309568176 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cd97bb640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cd40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cd414b8c0 0x7f4cd40c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdcf4dbc640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 0x7fdcf0151bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdce800ba50 tx=0x7fdce800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.135+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce800cc10 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cd97bb640 1 -- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cd414b8c0 msgr2=0x7f4cd40c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce800cd70 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8014680 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cd97bb640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cd414b8c0 0x7f4cd40c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cd97bb640 1 -- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4157b80 msgr2=0x7f4cd4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf006cd40 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cd97bb640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4157b80 0x7f4cd4158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cd97bb640 1 -- 172.21.15.119:0/2309568176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40b1450 con 0x7f4cc00047d0 2023-12-19T16:15:48.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cd97bb640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cd40c6c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c700 tx=0x7f4cd000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf01567d0 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0005a80 con 0x7f4cc00047d0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd0005be0 con 0x7f4cc00047d0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0007070 con 0x7f4cc00047d0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd40b1730 con 0x7f4cc00047d0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.139+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd414bd20 con 0x7f4cc00047d0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd0005260 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdce80147e0 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7fdced7fa640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdcdc065a60 0x7fdcdc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4cd00071d0 con 0x7f4cc00047d0 2023-12-19T16:15:48.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7f4cc9ffb640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4cb8065b30 0x7f4cb8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdce8083300 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd40735b0 con 0x7f4cc00047d0 2023-12-19T16:15:48.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4cd0082b50 con 0x7f4cc00047d0 2023-12-19T16:15:48.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.143+0000 7fdceffff640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdcdc065a60 0x7fdcdc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.147+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4cb8065b30 0x7f4cb8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.147+0000 7fdceffff640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdcdc065a60 0x7fdcdc067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00cd4c0 tx=0x7fdce0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.147+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdce8050a70 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.147+0000 7f4cd8fba640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4cb8065b30 0x7f4cb8067ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0af000 tx=0x7f4ccc005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.155+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4cd0017080 con 0x7f4cc00047d0 2023-12-19T16:15:48.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.279+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f00740b1550 con 0x7f0074071500 2023-12-19T16:15:48.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.279+0000 7f006b7fe640 1 -- 172.21.15.119:0/1140597022 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f005c020030 con 0x7f0074071500 2023-12-19T16:15:48.284 INFO:teuthology.orchestra.run.smithi119.stdout:55834574860 2023-12-19T16:15:48.286 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:48.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.283+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0054065ab0 msgr2=0x7f0054067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.283+0000 7f00697fa640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0054065ab0 0x7f0054067f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0074143360 tx=0x7f006400b040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.283+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 msgr2=0x7f00740b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.283+0000 7f00697fa640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 0x7f00740b1830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f005c00e810 tx=0x7f005c00ecd0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:48.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 shutdown_connections 2023-12-19T16:15:48.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0054065ab0 0x7f0054067f70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740cb6e0 0x7f00740c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0074071500 0x7f00740b1830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 --2- 172.21.15.119:0/1140597022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f007406d020 0x7f007414bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 >> 172.21.15.119:0/1140597022 conn(0x7f00740cabf0 msgr2=0x7f007415e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 shutdown_connections 2023-12-19T16:15:48.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f00697fa640 1 -- 172.21.15.119:0/1140597022 wait complete. 2023-12-19T16:15:48.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.287+0000 7f46081ce640 1 -- 172.21.15.119:0/4256741247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46000c7a40 con 0x7f46000cc710 2023-12-19T16:15:48.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.291+0000 7f45f67fc640 1 -- 172.21.15.119:0/4256741247 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45f8051520 con 0x7f46000cc710 2023-12-19T16:15:48.297 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:48.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 -- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e4065a90 msgr2=0x7f45e4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e4065a90 0x7f45e4067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46000afae0 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 -- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 msgr2=0x7f4600159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600159170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f45f800efc0 tx=0x7f45f800c490 comp rx=0 tx=0).stop 2023-12-19T16:15:48.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 -- 172.21.15.119:0/4256741247 shutdown_connections 2023-12-19T16:15:48.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f45e4065a90 0x7f45e4067f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46001649a0 0x7f4600163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46000cd380 0x7f46001639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 --2- 172.21.15.119:0/4256741247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46000cc710 0x7f4600159170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 -- 172.21.15.119:0/4256741247 >> 172.21.15.119:0/4256741247 conn(0x7f46000afe90 msgr2=0x7f4600162f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 -- 172.21.15.119:0/4256741247 shutdown_connections 2023-12-19T16:15:48.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.299+0000 7f45e3fff640 1 -- 172.21.15.119:0/4256741247 wait complete. 2023-12-19T16:15:48.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2023-12-19T16:15:48.341 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-12-19T16:15:48.352 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.367+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f7404e000 con 0x7f1f740cdba0 2023-12-19T16:15:48.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.367+0000 7f1f62ffd640 1 -- 172.21.15.119:0/1292852285 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f64053db0 con 0x7f1f740cdba0 2023-12-19T16:15:48.371 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:48.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f54065ab0 msgr2=0x7f1f54067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f54065ab0 0x7f1f54067f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c007dc0 tx=0x7f1f6c0072f0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 msgr2=0x7f1f740ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 0x7f1f740ae6e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400d800 tx=0x7f1f6400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15f006e470 con 0x7f15f00c49e0 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 shutdown_connections 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f54065ab0 0x7f1f54067f70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f74158790 0x7f1f7415a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740cdba0 0x7f1f740ae6e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 --2- 172.21.15.119:0/1292852285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f740cb480 0x7f1f7414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 >> 172.21.15.119:0/1292852285 conn(0x7f1f7406a3e0 msgr2=0x7f1f74162f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 shutdown_connections 2023-12-19T16:15:48.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f1f78ff3640 1 -- 172.21.15.119:0/1292852285 wait complete. 2023-12-19T16:15:48.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.371+0000 7f15ed7fa640 1 -- 172.21.15.119:0/254908872 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15e00508c0 con 0x7f15f00c49e0 2023-12-19T16:15:48.375 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2023-12-19T16:15:48.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f15dc065a60 msgr2=0x7f15dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f15dc065a60 0x7f15dc067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f15e80af000 tx=0x7f15e8004740 comp rx=0 tx=0).stop 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 msgr2=0x7f15f00b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 0x7f15f00b2d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15e000cba0 tx=0x7f15e000a430 comp rx=0 tx=0).stop 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 shutdown_connections 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f15dc065a60 0x7f15dc067f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15f014f8c0 0x7f15f02020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00cc8b0 0x7f15f00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 --2- 172.21.15.119:0/254908872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15f00c49e0 0x7f15f00b2d20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 >> 172.21.15.119:0/254908872 conn(0x7f15f00afd80 msgr2=0x7f15f00b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 shutdown_connections 2023-12-19T16:15:48.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.375+0000 7f15d6ffd640 1 -- 172.21.15.119:0/254908872 wait complete. 2023-12-19T16:15:48.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.383+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbbf40b1a80 con 0x7fbbf40c96c0 2023-12-19T16:15:48.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.383+0000 7fbbe9ffb640 1 -- 172.21.15.119:0/1688453359 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbf40b1a80 con 0x7fbbf40c96c0 2023-12-19T16:15:48.387 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2023-12-19T16:15:48.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.383+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcb8414ca50 con 0x7fcb840cad30 2023-12-19T16:15:48.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb79ffb640 1 -- 172.21.15.119:0/3265193701 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb740ea4b0 con 0x7fcb840cad30 2023-12-19T16:15:48.389 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2023-12-19T16:15:48.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbd8065a60 msgr2=0x7fbbd8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbd8065a60 0x7fbbd8067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40096b0 tx=0x7fbbe4006c30 comp rx=0 tx=0).stop 2023-12-19T16:15:48.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 msgr2=0x7fbbf4156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 0x7fbbf4156fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00b1040 tx=0x7fbbf001a4e0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 shutdown_connections 2023-12-19T16:15:48.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbd8065a60 0x7fbbd8067f20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbf4158880 0x7fbbf41574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf40c96c0 0x7fbbf4156fb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 --2- 172.21.15.119:0/1688453359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbf406d0b0 0x7fbbf41530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 >> 172.21.15.119:0/1688453359 conn(0x7fbbf40afd80 msgr2=0x7fbbf40c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 shutdown_connections 2023-12-19T16:15:48.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fbbfa611640 1 -- 172.21.15.119:0/1688453359 wait complete. 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb68065b30 msgr2=0x7fcb68067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb68065b30 0x7fcb68067ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb8406c2e0 tx=0x7fcb7c00b040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840cad30 msgr2=0x7fcb840b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840cad30 0x7fcb840b2510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb740ac000 tx=0x7fcb74019280 comp rx=0 tx=0).stop 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 shutdown_connections 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb68065b30 0x7fcb68067ff0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb840abd30 0x7fcb840b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb840cad30 0x7fcb840b2510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 --2- 172.21.15.119:0/3265193701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb840ab8a0 0x7fcb8415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 >> 172.21.15.119:0/3265193701 conn(0x7fcb840afe90 msgr2=0x7fcb8415d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.387+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 shutdown_connections 2023-12-19T16:15:48.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.391+0000 7fcb8b266640 1 -- 172.21.15.119:0/3265193701 wait complete. 2023-12-19T16:15:48.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-12-19T16:15:48.399 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-12-19T16:15:48.406 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-12-19T16:15:48.425 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-12-19T16:15:48.426 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.443+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4cd40b12b0 con 0x7f4cc00047d0 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.443+0000 7f4cc9ffb640 1 -- 172.21.15.119:0/2309568176 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4cd40b12b0 con 0x7f4cc00047d0 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4cb8065b30 msgr2=0x7f4cb8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4cb8065b30 0x7f4cb8067ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0af000 tx=0x7f4ccc005040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 msgr2=0x7f4cd40c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cd40c6c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c700 tx=0x7f4cd000cbc0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 shutdown_connections 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4cb8065b30 0x7f4cb8067ff0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4157b80 0x7f4cd4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cd414b8c0 0x7f4cd40c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 --2- 172.21.15.119:0/2309568176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cc00047d0 0x7f4cd40c6c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 >> 172.21.15.119:0/2309568176 conn(0x7f4cd406a3e0 msgr2=0x7f4cd4071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 shutdown_connections 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.447+0000 7f4cdba1f640 1 -- 172.21.15.119:0/2309568176 wait complete. 2023-12-19T16:15:48.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.459+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdcd0005510 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdced7fa640 1 -- 172.21.15.119:0/2508569564 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdce8054090 con 0x7fdcf00ab8a0 2023-12-19T16:15:48.465 INFO:teuthology.orchestra.run.smithi119.stdout:55834574860 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdcdc065a60 msgr2=0x7fdcdc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdcdc065a60 0x7fdcdc067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00cd4c0 tx=0x7fdce0008040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 msgr2=0x7fdcf0151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 0x7fdcf0151bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdce800ba50 tx=0x7fdce800bf10 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 shutdown_connections 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdcdc065a60 0x7fdcdc067f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcf015da60 0x7fdcf0159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcf00cad30 0x7fdcf0158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 --2- 172.21.15.119:0/2508569564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcf00ab8a0 0x7fdcf0151bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 >> 172.21.15.119:0/2508569564 conn(0x7fdcf00afe90 msgr2=0x7fdcf00ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 shutdown_connections 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.463+0000 7fdcf7020640 1 -- 172.21.15.119:0/2508569564 wait complete. 2023-12-19T16:15:48.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-12-19T16:15:48.474 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2023-12-19T16:15:48.488 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.488 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T16:15:48.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:48.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 Processor -- start 2023-12-19T16:15:48.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 -- start start 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015a680 0x7fe8d015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8d00cac10 0x7fe8d015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe8d015afa0 0x7fe8d006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d015f100 con 0x7fe8d00cac10 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00ca7d0 con 0x7fe8d015afa0 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d717b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d015e860 con 0x7fe8d015a680 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8d00cac10 0x7fe8d015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8d00cac10 0x7fe8d015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57046/0 (socket says 172.21.15.119:57046) 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 -- 172.21.15.119:0/1662855784 learned_addr learned my addr 172.21.15.119:0/1662855784 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d4f17640 1 --2- 172.21.15.119:0/1662855784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015a680 0x7fe8d015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8d5718640 1 --2- 172.21.15.119:0/1662855784 >> v2:172.21.15.143:3300/0 conn(0x7fe8d015afa0 0x7fe8d006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 -- 172.21.15.119:0/1662855784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015a680 msgr2=0x7fe8d015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 --2- 172.21.15.119:0/1662855784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015a680 0x7fe8d015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 -- 172.21.15.119:0/1662855784 >> v2:172.21.15.143:3300/0 conn(0x7fe8d015afa0 msgr2=0x7fe8d006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 --2- 172.21.15.119:0/1662855784 >> v2:172.21.15.143:3300/0 conn(0x7fe8d015afa0 0x7fe8d006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.667+0000 7fe8c7fff640 1 -- 172.21.15.119:0/1662855784 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d015eb40 con 0x7fe8d00cac10 2023-12-19T16:15:48.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8c7fff640 1 --2- 172.21.15.119:0/1662855784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d015aa60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00add90 tx=0x7fe8c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ef4935c7a33dd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8c77fe640 1 -- 172.21.15.119:0/1662855784 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00ab600 con 0x7fe8d00cac10 2023-12-19T16:15:48.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8c77fe640 1 -- 172.21.15.119:0/1662855784 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c00a7050 con 0x7fe8d00cac10 2023-12-19T16:15:48.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8c77fe640 1 -- 172.21.15.119:0/1662855784 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00ab980 con 0x7fe8d00cac10 2023-12-19T16:15:48.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 -- 172.21.15.119:0/1662855784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 msgr2=0x7fe8d015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 --2- 172.21.15.119:0/1662855784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d015aa60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00add90 tx=0x7fe8c001c470 comp rx=0 tx=0).stop 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 -- 172.21.15.119:0/1662855784 shutdown_connections 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 --2- 172.21.15.119:0/1662855784 >> v2:172.21.15.143:3300/0 conn(0x7fe8d015afa0 0x7fe8d006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 --2- 172.21.15.119:0/1662855784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d015aa60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 --2- 172.21.15.119:0/1662855784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015a680 0x7fe8d015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 -- 172.21.15.119:0/1662855784 >> 172.21.15.119:0/1662855784 conn(0x7fe8d006a3e0 msgr2=0x7fe8d00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 -- 172.21.15.119:0/1662855784 shutdown_connections 2023-12-19T16:15:48.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.671+0000 7fe8d717b640 1 -- 172.21.15.119:0/1662855784 wait complete. 2023-12-19T16:15:48.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 Processor -- start 2023-12-19T16:15:48.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 -- start start 2023-12-19T16:15:48.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d00cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8d015a680 0x7fe8d014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015afa0 0x7fe8d00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cdfc0 con 0x7fe8d00cac10 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cd5f0 con 0x7fe8d015a680 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cc9e0 con 0x7fe8d015afa0 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d00cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d00cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57060/0 (socket says 172.21.15.119:57060) 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 -- 172.21.15.119:0/2408480295 learned_addr learned my addr 172.21.15.119:0/2408480295 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d5718640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015afa0 0x7fe8d00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8c7fff640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8d015a680 0x7fe8d014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 -- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015afa0 msgr2=0x7fe8d00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015afa0 0x7fe8d00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 -- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8d015a680 msgr2=0x7fe8d014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8d015a680 0x7fe8d014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 -- 172.21.15.119:0/2408480295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00094d0 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d4f17640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d00cda80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e930 tx=0x7fe8cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc009690 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00ca00 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d00cccc0 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00cd70 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.675+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d00cd280 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.679+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d00735b0 con 0x7fe8d00cac10 2023-12-19T16:15:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.679+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8cc013470 con 0x7fe8d00cac10 2023-12-19T16:15:48.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.679+0000 7fe8c57fa640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8bc065a60 0x7fe8bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.679+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8cc083760 con 0x7fe8d00cac10 2023-12-19T16:15:48.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.679+0000 7fe8c7fff640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8bc065a60 0x7fe8bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.679+0000 7fe8c7fff640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8bc065a60 0x7fe8bc067f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe8d006cf60 tx=0x7fe8c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.683+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe8cc050e50 con 0x7fe8d00cac10 2023-12-19T16:15:48.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.831+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8d0070700 con 0x7fe8bc065a60 2023-12-19T16:15:48.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.839+0000 7fe8c57fa640 1 -- 172.21.15.119:0/2408480295 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345264 (secure 0 0 0) 0x7fe8c00ab660 con 0x7fe8bc065a60 2023-12-19T16:15:48.845 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:48.847 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:15:48.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8bc065a60 msgr2=0x7fe8bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8bc065a60 0x7fe8bc067f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe8d006cf60 tx=0x7fe8c0009040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 msgr2=0x7fe8d00cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d00cda80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e930 tx=0x7fe8cc00edf0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 shutdown_connections 2023-12-19T16:15:48.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8bc065a60 0x7fe8bc067f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8d015a680 0x7fe8d014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8d015afa0 0x7fe8d00c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 --2- 172.21.15.119:0/2408480295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8d00cac10 0x7fe8d00cda80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 >> 172.21.15.119:0/2408480295 conn(0x7fe8d006a3e0 msgr2=0x7fe8d015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 shutdown_connections 2023-12-19T16:15:48.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:48.843+0000 7fe8d717b640 1 -- 172.21.15.119:0/2408480295 wait complete. 2023-12-19T16:15:48.866 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-19T16:15:48.454210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588192+0000","last_change":"2023-12-19T16:15:20.196445+0000","last_active":"2023-12-19T16:15:24.588192+0000","last_peered":"2023-12-19T16:15:24.588192+0000","last_clean":"2023-12-19T16:15:24.588192+0000","last_became_active":"2023-12-19T16:15:20.196170+0000","last_became_peered":"2023-12-19T16:15:20.196170+0000","last_unstale":"2023-12-19T16:15:24.588192+0000","last_undegraded":"2023-12-19T16:15:24.588192+0000","last_fullsized":"2023-12-19T16:15:24.588192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:39.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580441+0000","last_change":"2023-12-19T16:15:20.606495+0000","last_active":"2023-12-19T16:15:24.580441+0000","last_peered":"2023-12-19T16:15:24.580441+0000","last_clean":"2023-12-19T16:15:24.580441+0000","last_became_active":"2023-12-19T16:15:20.605146+0000","last_became_peered":"2023-12-19T16:15:20.605146+0000","last_unstale":"2023-12-19T16:15:24.580441+0000","last_undegraded":"2023-12-19T16:15:24.580441+0000","last_fullsized":"2023-12-19T16:15:24.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991230+0000","last_change":"2023-12-19T16:15:24.614967+0000","last_active":"2023-12-19T16:15:24.991230+0000","last_peered":"2023-12-19T16:15:24.991230+0000","last_clean":"2023-12-19T16:15:24.991230+0000","last_became_active":"2023-12-19T16:15:24.614174+0000","last_became_peered":"2023-12-19T16:15:24.614174+0000","last_unstale":"2023-12-19T16:15:24.991230+0000","last_undegraded":"2023-12-19T16:15:24.991230+0000","last_fullsized":"2023-12-19T16:15:24.991230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580626+0000","last_change":"2023-12-19T16:15:20.202976+0000","last_active":"2023-12-19T16:15:24.580626+0000","last_peered":"2023-12-19T16:15:24.580626+0000","last_clean":"2023-12-19T16:15:24.580626+0000","last_became_active":"2023-12-19T16:15:20.202692+0000","last_became_peered":"2023-12-19T16:15:20.202692+0000","last_unstale":"2023-12-19T16:15:24.580626+0000","last_undegraded":"2023-12-19T16:15:24.580626+0000","last_fullsized":"2023-12-19T16:15:24.580626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587899+0000","last_change":"2023-12-19T16:15:20.579266+0000","last_active":"2023-12-19T16:15:24.587899+0000","last_peered":"2023-12-19T16:15:24.587899+0000","last_clean":"2023-12-19T16:15:24.587899+0000","last_became_active":"2023-12-19T16:15:20.579039+0000","last_became_peered":"2023-12-19T16:15:20.579039+0000","last_unstale":"2023-12-19T16:15:24.587899+0000","last_undegraded":"2023-12-19T16:15:24.587899+0000","last_fullsized":"2023-12-19T16:15:24.587899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987177+0000","last_change":"2023-12-19T16:15:24.618815+0000","last_active":"2023-12-19T16:15:24.987177+0000","last_peered":"2023-12-19T16:15:24.987177+0000","last_clean":"2023-12-19T16:15:24.987177+0000","last_became_active":"2023-12-19T16:15:24.618408+0000","last_became_peered":"2023-12-19T16:15:24.618408+0000","last_unstale":"2023-12-19T16:15:24.987177+0000","last_undegraded":"2023-12-19T16:15:24.987177+0000","last_fullsized":"2023-12-19T16:15:24.987177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.615964+0000","last_change":"2023-12-19T16:15:20.206941+0000","last_active":"2023-12-19T16:15:24.615964+0000","last_peered":"2023-12-19T16:15:24.615964+0000","last_clean":"2023-12-19T16:15:24.615964+0000","last_became_active":"2023-12-19T16:15:20.206623+0000","last_became_peered":"2023-12-19T16:15:20.206623+0000","last_unstale":"2023-12-19T16:15:24.615964+0000","last_undegraded":"2023-12-19T16:15:24.615964+0000","last_fullsized":"2023-12-19T16:15:24.615964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:42.922649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582028+0000","last_change":"2023-12-19T16:15:20.576757+0000","last_active":"2023-12-19T16:15:24.582028+0000","last_peered":"2023-12-19T16:15:24.582028+0000","last_clean":"2023-12-19T16:15:24.582028+0000","last_became_active":"2023-12-19T16:15:20.576280+0000","last_became_peered":"2023-12-19T16:15:20.576280+0000","last_unstale":"2023-12-19T16:15:24.582028+0000","last_undegraded":"2023-12-19T16:15:24.582028+0000","last_fullsized":"2023-12-19T16:15:24.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987587+0000","last_change":"2023-12-19T16:15:24.618996+0000","last_active":"2023-12-19T16:15:24.987587+0000","last_peered":"2023-12-19T16:15:24.987587+0000","last_clean":"2023-12-19T16:15:24.987587+0000","last_became_active":"2023-12-19T16:15:24.613588+0000","last_became_peered":"2023-12-19T16:15:24.613588+0000","last_unstale":"2023-12-19T16:15:24.987587+0000","last_undegraded":"2023-12-19T16:15:24.987587+0000","last_fullsized":"2023-12-19T16:15:24.987587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:20.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612643+0000","last_change":"2023-12-19T16:15:20.209759+0000","last_active":"2023-12-19T16:15:24.612643+0000","last_peered":"2023-12-19T16:15:24.612643+0000","last_clean":"2023-12-19T16:15:24.612643+0000","last_became_active":"2023-12-19T16:15:20.209441+0000","last_became_peered":"2023-12-19T16:15:20.209441+0000","last_unstale":"2023-12-19T16:15:24.612643+0000","last_undegraded":"2023-12-19T16:15:24.612643+0000","last_fullsized":"2023-12-19T16:15:24.612643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:45.528168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583519+0000","last_change":"2023-12-19T16:15:20.576676+0000","last_active":"2023-12-19T16:15:24.583519+0000","last_peered":"2023-12-19T16:15:24.583519+0000","last_clean":"2023-12-19T16:15:24.583519+0000","last_became_active":"2023-12-19T16:15:20.576400+0000","last_became_peered":"2023-12-19T16:15:20.576400+0000","last_unstale":"2023-12-19T16:15:24.583519+0000","last_undegraded":"2023-12-19T16:15:24.583519+0000","last_fullsized":"2023-12-19T16:15:24.583519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987579+0000","last_change":"2023-12-19T16:15:24.619492+0000","last_active":"2023-12-19T16:15:24.987579+0000","last_peered":"2023-12-19T16:15:24.987579+0000","last_clean":"2023-12-19T16:15:24.987579+0000","last_became_active":"2023-12-19T16:15:24.618455+0000","last_became_peered":"2023-12-19T16:15:24.618455+0000","last_unstale":"2023-12-19T16:15:24.987579+0000","last_undegraded":"2023-12-19T16:15:24.987579+0000","last_fullsized":"2023-12-19T16:15:24.987579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:27.195791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590403+0000","last_change":"2023-12-19T16:15:20.598403+0000","last_active":"2023-12-19T16:15:24.590403+0000","last_peered":"2023-12-19T16:15:24.590403+0000","last_clean":"2023-12-19T16:15:24.590403+0000","last_became_active":"2023-12-19T16:15:20.598090+0000","last_became_peered":"2023-12-19T16:15:20.598090+0000","last_unstale":"2023-12-19T16:15:24.590403+0000","last_undegraded":"2023-12-19T16:15:24.590403+0000","last_fullsized":"2023-12-19T16:15:24.590403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612925+0000","last_change":"2023-12-19T16:15:20.202909+0000","last_active":"2023-12-19T16:15:24.612925+0000","last_peered":"2023-12-19T16:15:24.612925+0000","last_clean":"2023-12-19T16:15:24.612925+0000","last_became_active":"2023-12-19T16:15:20.202536+0000","last_became_peered":"2023-12-19T16:15:20.202536+0000","last_unstale":"2023-12-19T16:15:24.612925+0000","last_undegraded":"2023-12-19T16:15:24.612925+0000","last_fullsized":"2023-12-19T16:15:24.612925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:37.663686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987782+0000","last_change":"2023-12-19T16:15:24.611948+0000","last_active":"2023-12-19T16:15:24.987782+0000","last_peered":"2023-12-19T16:15:24.987782+0000","last_clean":"2023-12-19T16:15:24.987782+0000","last_became_active":"2023-12-19T16:15:24.611168+0000","last_became_peered":"2023-12-19T16:15:24.611168+0000","last_unstale":"2023-12-19T16:15:24.987782+0000","last_undegraded":"2023-12-19T16:15:24.987782+0000","last_fullsized":"2023-12-19T16:15:24.987782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:58.259665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580838+0000","last_change":"2023-12-19T16:15:20.582515+0000","last_active":"2023-12-19T16:15:24.580838+0000","last_peered":"2023-12-19T16:15:24.580838+0000","last_clean":"2023-12-19T16:15:24.580838+0000","last_became_active":"2023-12-19T16:15:20.582246+0000","last_became_peered":"2023-12-19T16:15:20.582246+0000","last_unstale":"2023-12-19T16:15:24.580838+0000","last_undegraded":"2023-12-19T16:15:24.580838+0000","last_fullsized":"2023-12-19T16:15:24.580838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609028+0000","last_change":"2023-12-19T16:15:20.193662+0000","last_active":"2023-12-19T16:15:24.609028+0000","last_peered":"2023-12-19T16:15:24.609028+0000","last_clean":"2023-12-19T16:15:24.609028+0000","last_became_active":"2023-12-19T16:15:20.193345+0000","last_became_peered":"2023-12-19T16:15:20.193345+0000","last_unstale":"2023-12-19T16:15:24.609028+0000","last_undegraded":"2023-12-19T16:15:24.609028+0000","last_fullsized":"2023-12-19T16:15:24.609028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987322+0000","last_change":"2023-12-19T16:15:24.621026+0000","last_active":"2023-12-19T16:15:24.987322+0000","last_peered":"2023-12-19T16:15:24.987322+0000","last_clean":"2023-12-19T16:15:24.987322+0000","last_became_active":"2023-12-19T16:15:24.618568+0000","last_became_peered":"2023-12-19T16:15:24.618568+0000","last_unstale":"2023-12-19T16:15:24.987322+0000","last_undegraded":"2023-12-19T16:15:24.987322+0000","last_fullsized":"2023-12-19T16:15:24.987322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580610+0000","last_change":"2023-12-19T16:15:20.593268+0000","last_active":"2023-12-19T16:15:24.580610+0000","last_peered":"2023-12-19T16:15:24.580610+0000","last_clean":"2023-12-19T16:15:24.580610+0000","last_became_active":"2023-12-19T16:15:20.593033+0000","last_became_peered":"2023-12-19T16:15:20.593033+0000","last_unstale":"2023-12-19T16:15:24.580610+0000","last_undegraded":"2023-12-19T16:15:24.580610+0000","last_fullsized":"2023-12-19T16:15:24.580610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607527+0000","last_change":"2023-12-19T16:15:20.190652+0000","last_active":"2023-12-19T16:15:24.607527+0000","last_peered":"2023-12-19T16:15:24.607527+0000","last_clean":"2023-12-19T16:15:24.607527+0000","last_became_active":"2023-12-19T16:15:20.190271+0000","last_became_peered":"2023-12-19T16:15:20.190271+0000","last_unstale":"2023-12-19T16:15:24.607527+0000","last_undegraded":"2023-12-19T16:15:24.607527+0000","last_fullsized":"2023-12-19T16:15:24.607527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991773+0000","last_change":"2023-12-19T16:15:24.620676+0000","last_active":"2023-12-19T16:15:24.991773+0000","last_peered":"2023-12-19T16:15:24.991773+0000","last_clean":"2023-12-19T16:15:24.991773+0000","last_became_active":"2023-12-19T16:15:24.619756+0000","last_became_peered":"2023-12-19T16:15:24.619756+0000","last_unstale":"2023-12-19T16:15:24.991773+0000","last_undegraded":"2023-12-19T16:15:24.991773+0000","last_fullsized":"2023-12-19T16:15:24.991773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588078+0000","last_change":"2023-12-19T16:15:20.583947+0000","last_active":"2023-12-19T16:15:24.588078+0000","last_peered":"2023-12-19T16:15:24.588078+0000","last_clean":"2023-12-19T16:15:24.588078+0000","last_became_active":"2023-12-19T16:15:20.583625+0000","last_became_peered":"2023-12-19T16:15:20.583625+0000","last_unstale":"2023-12-19T16:15:24.588078+0000","last_undegraded":"2023-12-19T16:15:24.588078+0000","last_fullsized":"2023-12-19T16:15:24.588078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:00.076039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606271+0000","last_change":"2023-12-19T16:15:20.197434+0000","last_active":"2023-12-19T16:15:24.606271+0000","last_peered":"2023-12-19T16:15:24.606271+0000","last_clean":"2023-12-19T16:15:24.606271+0000","last_became_active":"2023-12-19T16:15:20.197066+0000","last_became_peered":"2023-12-19T16:15:20.197066+0000","last_unstale":"2023-12-19T16:15:24.606271+0000","last_undegraded":"2023-12-19T16:15:24.606271+0000","last_fullsized":"2023-12-19T16:15:24.606271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987228+0000","last_change":"2023-12-19T16:15:24.614999+0000","last_active":"2023-12-19T16:15:24.987228+0000","last_peered":"2023-12-19T16:15:24.987228+0000","last_clean":"2023-12-19T16:15:24.987228+0000","last_became_active":"2023-12-19T16:15:24.613975+0000","last_became_peered":"2023-12-19T16:15:24.613975+0000","last_unstale":"2023-12-19T16:15:24.987228+0000","last_undegraded":"2023-12-19T16:15:24.987228+0000","last_fullsized":"2023-12-19T16:15:24.987228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588898+0000","last_change":"2023-12-19T16:15:20.592452+0000","last_active":"2023-12-19T16:15:24.588898+0000","last_peered":"2023-12-19T16:15:24.588898+0000","last_clean":"2023-12-19T16:15:24.588898+0000","last_became_active":"2023-12-19T16:15:20.592161+0000","last_became_peered":"2023-12-19T16:15:20.592161+0000","last_unstale":"2023-12-19T16:15:24.588898+0000","last_undegraded":"2023-12-19T16:15:24.588898+0000","last_fullsized":"2023-12-19T16:15:24.588898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591886+0000","last_change":"2023-12-19T16:15:20.208862+0000","last_active":"2023-12-19T16:15:24.591886+0000","last_peered":"2023-12-19T16:15:24.591886+0000","last_clean":"2023-12-19T16:15:24.591886+0000","last_became_active":"2023-12-19T16:15:20.208590+0000","last_became_peered":"2023-12-19T16:15:20.208590+0000","last_unstale":"2023-12-19T16:15:24.591886+0000","last_undegraded":"2023-12-19T16:15:24.591886+0000","last_fullsized":"2023-12-19T16:15:24.591886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987223+0000","last_change":"2023-12-19T16:15:24.614167+0000","last_active":"2023-12-19T16:15:24.987223+0000","last_peered":"2023-12-19T16:15:24.987223+0000","last_clean":"2023-12-19T16:15:24.987223+0000","last_became_active":"2023-12-19T16:15:24.613456+0000","last_became_peered":"2023-12-19T16:15:24.613456+0000","last_unstale":"2023-12-19T16:15:24.987223+0000","last_undegraded":"2023-12-19T16:15:24.987223+0000","last_fullsized":"2023-12-19T16:15:24.987223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580848+0000","last_change":"2023-12-19T16:15:20.587069+0000","last_active":"2023-12-19T16:15:24.580848+0000","last_peered":"2023-12-19T16:15:24.580848+0000","last_clean":"2023-12-19T16:15:24.580848+0000","last_became_active":"2023-12-19T16:15:20.586781+0000","last_became_peered":"2023-12-19T16:15:20.586781+0000","last_unstale":"2023-12-19T16:15:24.580848+0000","last_undegraded":"2023-12-19T16:15:24.580848+0000","last_fullsized":"2023-12-19T16:15:24.580848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609772+0000","last_change":"2023-12-19T16:15:20.206431+0000","last_active":"2023-12-19T16:15:24.609772+0000","last_peered":"2023-12-19T16:15:24.609772+0000","last_clean":"2023-12-19T16:15:24.609772+0000","last_became_active":"2023-12-19T16:15:20.206208+0000","last_became_peered":"2023-12-19T16:15:20.206208+0000","last_unstale":"2023-12-19T16:15:24.609772+0000","last_undegraded":"2023-12-19T16:15:24.609772+0000","last_fullsized":"2023-12-19T16:15:24.609772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990754+0000","last_change":"2023-12-19T16:15:24.612174+0000","last_active":"2023-12-19T16:15:24.990754+0000","last_peered":"2023-12-19T16:15:24.990754+0000","last_clean":"2023-12-19T16:15:24.990754+0000","last_became_active":"2023-12-19T16:15:24.611609+0000","last_became_peered":"2023-12-19T16:15:24.611609+0000","last_unstale":"2023-12-19T16:15:24.990754+0000","last_undegraded":"2023-12-19T16:15:24.990754+0000","last_fullsized":"2023-12-19T16:15:24.990754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:54.794163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609936+0000","last_change":"2023-12-19T16:15:20.590393+0000","last_active":"2023-12-19T16:15:24.609936+0000","last_peered":"2023-12-19T16:15:24.609936+0000","last_clean":"2023-12-19T16:15:24.609936+0000","last_became_active":"2023-12-19T16:15:20.589290+0000","last_became_peered":"2023-12-19T16:15:20.589290+0000","last_unstale":"2023-12-19T16:15:24.609936+0000","last_undegraded":"2023-12-19T16:15:24.609936+0000","last_fullsized":"2023-12-19T16:15:24.609936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616161+0000","last_change":"2023-12-19T16:15:20.203475+0000","last_active":"2023-12-19T16:15:24.616161+0000","last_peered":"2023-12-19T16:15:24.616161+0000","last_clean":"2023-12-19T16:15:24.616161+0000","last_became_active":"2023-12-19T16:15:20.203209+0000","last_became_peered":"2023-12-19T16:15:20.203209+0000","last_unstale":"2023-12-19T16:15:24.616161+0000","last_undegraded":"2023-12-19T16:15:24.616161+0000","last_fullsized":"2023-12-19T16:15:24.616161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991778+0000","last_change":"2023-12-19T16:15:24.604368+0000","last_active":"2023-12-19T16:15:24.991778+0000","last_peered":"2023-12-19T16:15:24.991778+0000","last_clean":"2023-12-19T16:15:24.991778+0000","last_became_active":"2023-12-19T16:15:24.603970+0000","last_became_peered":"2023-12-19T16:15:24.603970+0000","last_unstale":"2023-12-19T16:15:24.991778+0000","last_undegraded":"2023-12-19T16:15:24.991778+0000","last_fullsized":"2023-12-19T16:15:24.991778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583544+0000","last_change":"2023-12-19T16:15:20.590364+0000","last_active":"2023-12-19T16:15:24.583544+0000","last_peered":"2023-12-19T16:15:24.583544+0000","last_clean":"2023-12-19T16:15:24.583544+0000","last_became_active":"2023-12-19T16:15:20.589975+0000","last_became_peered":"2023-12-19T16:15:20.589975+0000","last_unstale":"2023-12-19T16:15:24.583544+0000","last_undegraded":"2023-12-19T16:15:24.583544+0000","last_fullsized":"2023-12-19T16:15:24.583544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610003+0000","last_change":"2023-12-19T16:15:20.190567+0000","last_active":"2023-12-19T16:15:24.610003+0000","last_peered":"2023-12-19T16:15:24.610003+0000","last_clean":"2023-12-19T16:15:24.610003+0000","last_became_active":"2023-12-19T16:15:20.189732+0000","last_became_peered":"2023-12-19T16:15:20.189732+0000","last_unstale":"2023-12-19T16:15:24.610003+0000","last_undegraded":"2023-12-19T16:15:24.610003+0000","last_fullsized":"2023-12-19T16:15:24.610003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990745+0000","last_change":"2023-12-19T16:15:24.613205+0000","last_active":"2023-12-19T16:15:24.990745+0000","last_peered":"2023-12-19T16:15:24.990745+0000","last_clean":"2023-12-19T16:15:24.990745+0000","last_became_active":"2023-12-19T16:15:24.612609+0000","last_became_peered":"2023-12-19T16:15:24.612609+0000","last_unstale":"2023-12-19T16:15:24.990745+0000","last_undegraded":"2023-12-19T16:15:24.990745+0000","last_fullsized":"2023-12-19T16:15:24.990745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586333+0000","last_change":"2023-12-19T16:15:20.574569+0000","last_active":"2023-12-19T16:15:24.586333+0000","last_peered":"2023-12-19T16:15:24.586333+0000","last_clean":"2023-12-19T16:15:24.586333+0000","last_became_active":"2023-12-19T16:15:20.573795+0000","last_became_peered":"2023-12-19T16:15:20.573795+0000","last_unstale":"2023-12-19T16:15:24.586333+0000","last_undegraded":"2023-12-19T16:15:24.586333+0000","last_fullsized":"2023-12-19T16:15:24.586333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583390+0000","last_change":"2023-12-19T16:15:20.194527+0000","last_active":"2023-12-19T16:15:24.583390+0000","last_peered":"2023-12-19T16:15:24.583390+0000","last_clean":"2023-12-19T16:15:24.583390+0000","last_became_active":"2023-12-19T16:15:20.194212+0000","last_became_peered":"2023-12-19T16:15:20.194212+0000","last_unstale":"2023-12-19T16:15:24.583390+0000","last_undegraded":"2023-12-19T16:15:24.583390+0000","last_fullsized":"2023-12-19T16:15:24.583390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991169+0000","last_change":"2023-12-19T16:15:24.619624+0000","last_active":"2023-12-19T16:15:24.991169+0000","last_peered":"2023-12-19T16:15:24.991169+0000","last_clean":"2023-12-19T16:15:24.991169+0000","last_became_active":"2023-12-19T16:15:24.619279+0000","last_became_peered":"2023-12-19T16:15:24.619279+0000","last_unstale":"2023-12-19T16:15:24.991169+0000","last_undegraded":"2023-12-19T16:15:24.991169+0000","last_fullsized":"2023-12-19T16:15:24.991169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.604284+0000","last_change":"2023-12-19T16:15:20.588633+0000","last_active":"2023-12-19T16:15:24.604284+0000","last_peered":"2023-12-19T16:15:24.604284+0000","last_clean":"2023-12-19T16:15:24.604284+0000","last_became_active":"2023-12-19T16:15:20.585483+0000","last_became_peered":"2023-12-19T16:15:20.585483+0000","last_unstale":"2023-12-19T16:15:24.604284+0000","last_undegraded":"2023-12-19T16:15:24.604284+0000","last_fullsized":"2023-12-19T16:15:24.604284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586562+0000","last_change":"2023-12-19T16:15:20.190133+0000","last_active":"2023-12-19T16:15:24.586562+0000","last_peered":"2023-12-19T16:15:24.586562+0000","last_clean":"2023-12-19T16:15:24.586562+0000","last_became_active":"2023-12-19T16:15:20.189767+0000","last_became_peered":"2023-12-19T16:15:20.189767+0000","last_unstale":"2023-12-19T16:15:24.586562+0000","last_undegraded":"2023-12-19T16:15:24.586562+0000","last_fullsized":"2023-12-19T16:15:24.586562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991870+0000","last_change":"2023-12-19T16:15:24.620960+0000","last_active":"2023-12-19T16:15:24.991870+0000","last_peered":"2023-12-19T16:15:24.991870+0000","last_clean":"2023-12-19T16:15:24.991870+0000","last_became_active":"2023-12-19T16:15:24.620316+0000","last_became_peered":"2023-12-19T16:15:24.620316+0000","last_unstale":"2023-12-19T16:15:24.991870+0000","last_undegraded":"2023-12-19T16:15:24.991870+0000","last_fullsized":"2023-12-19T16:15:24.991870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589097+0000","last_change":"2023-12-19T16:15:20.577774+0000","last_active":"2023-12-19T16:15:24.589097+0000","last_peered":"2023-12-19T16:15:24.589097+0000","last_clean":"2023-12-19T16:15:24.589097+0000","last_became_active":"2023-12-19T16:15:20.577521+0000","last_became_peered":"2023-12-19T16:15:20.577521+0000","last_unstale":"2023-12-19T16:15:24.589097+0000","last_undegraded":"2023-12-19T16:15:24.589097+0000","last_fullsized":"2023-12-19T16:15:24.589097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606291+0000","last_change":"2023-12-19T16:15:20.201723+0000","last_active":"2023-12-19T16:15:24.606291+0000","last_peered":"2023-12-19T16:15:24.606291+0000","last_clean":"2023-12-19T16:15:24.606291+0000","last_became_active":"2023-12-19T16:15:20.201368+0000","last_became_peered":"2023-12-19T16:15:20.201368+0000","last_unstale":"2023-12-19T16:15:24.606291+0000","last_undegraded":"2023-12-19T16:15:24.606291+0000","last_fullsized":"2023-12-19T16:15:24.606291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:17.746223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991977+0000","last_change":"2023-12-19T16:15:24.614648+0000","last_active":"2023-12-19T16:15:24.991977+0000","last_peered":"2023-12-19T16:15:24.991977+0000","last_clean":"2023-12-19T16:15:24.991977+0000","last_became_active":"2023-12-19T16:15:24.611988+0000","last_became_peered":"2023-12-19T16:15:24.611988+0000","last_unstale":"2023-12-19T16:15:24.991977+0000","last_undegraded":"2023-12-19T16:15:24.991977+0000","last_fullsized":"2023-12-19T16:15:24.991977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579894+0000","last_change":"2023-12-19T16:15:20.591587+0000","last_active":"2023-12-19T16:15:24.579894+0000","last_peered":"2023-12-19T16:15:24.579894+0000","last_clean":"2023-12-19T16:15:24.579894+0000","last_became_active":"2023-12-19T16:15:20.589033+0000","last_became_peered":"2023-12-19T16:15:20.589033+0000","last_unstale":"2023-12-19T16:15:24.579894+0000","last_undegraded":"2023-12-19T16:15:24.579894+0000","last_fullsized":"2023-12-19T16:15:24.579894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583506+0000","last_change":"2023-12-19T16:15:20.193675+0000","last_active":"2023-12-19T16:15:24.583506+0000","last_peered":"2023-12-19T16:15:24.583506+0000","last_clean":"2023-12-19T16:15:24.583506+0000","last_became_active":"2023-12-19T16:15:20.189433+0000","last_became_peered":"2023-12-19T16:15:20.189433+0000","last_unstale":"2023-12-19T16:15:24.583506+0000","last_undegraded":"2023-12-19T16:15:24.583506+0000","last_fullsized":"2023-12-19T16:15:24.583506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606398+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:15:24.606398+0000","last_peered":"2023-12-19T16:15:24.606398+0000","last_clean":"2023-12-19T16:15:24.606398+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:15:24.606398+0000","last_undegraded":"2023-12-19T16:15:24.606398+0000","last_fullsized":"2023-12-19T16:15:24.606398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992081+0000","last_change":"2023-12-19T16:15:24.621441+0000","last_active":"2023-12-19T16:15:24.992081+0000","last_peered":"2023-12-19T16:15:24.992081+0000","last_clean":"2023-12-19T16:15:24.992081+0000","last_became_active":"2023-12-19T16:15:24.619272+0000","last_became_peered":"2023-12-19T16:15:24.619272+0000","last_unstale":"2023-12-19T16:15:24.992081+0000","last_undegraded":"2023-12-19T16:15:24.992081+0000","last_fullsized":"2023-12-19T16:15:24.992081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:04.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.614464+0000","last_change":"2023-12-19T16:15:20.608106+0000","last_active":"2023-12-19T16:15:24.614464+0000","last_peered":"2023-12-19T16:15:24.614464+0000","last_clean":"2023-12-19T16:15:24.614464+0000","last_became_active":"2023-12-19T16:15:20.607827+0000","last_became_peered":"2023-12-19T16:15:20.607827+0000","last_unstale":"2023-12-19T16:15:24.614464+0000","last_undegraded":"2023-12-19T16:15:24.614464+0000","last_fullsized":"2023-12-19T16:15:24.614464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:56.432350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586822+0000","last_change":"2023-12-19T16:15:20.188280+0000","last_active":"2023-12-19T16:15:24.586822+0000","last_peered":"2023-12-19T16:15:24.586822+0000","last_clean":"2023-12-19T16:15:24.586822+0000","last_became_active":"2023-12-19T16:15:20.187947+0000","last_became_peered":"2023-12-19T16:15:20.187947+0000","last_unstale":"2023-12-19T16:15:24.586822+0000","last_undegraded":"2023-12-19T16:15:24.586822+0000","last_fullsized":"2023-12-19T16:15:24.586822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991784+0000","last_change":"2023-12-19T16:15:24.611679+0000","last_active":"2023-12-19T16:15:24.991784+0000","last_peered":"2023-12-19T16:15:24.991784+0000","last_clean":"2023-12-19T16:15:24.991784+0000","last_became_active":"2023-12-19T16:15:24.610986+0000","last_became_peered":"2023-12-19T16:15:24.610986+0000","last_unstale":"2023-12-19T16:15:24.991784+0000","last_undegraded":"2023-12-19T16:15:24.991784+0000","last_fullsized":"2023-12-19T16:15:24.991784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:11.191541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582165+0000","last_change":"2023-12-19T16:15:20.595169+0000","last_active":"2023-12-19T16:15:24.582165+0000","last_peered":"2023-12-19T16:15:24.582165+0000","last_clean":"2023-12-19T16:15:24.582165+0000","last_became_active":"2023-12-19T16:15:20.594861+0000","last_became_peered":"2023-12-19T16:15:20.594861+0000","last_unstale":"2023-12-19T16:15:24.582165+0000","last_undegraded":"2023-12-19T16:15:24.582165+0000","last_fullsized":"2023-12-19T16:15:24.582165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610122+0000","last_change":"2023-12-19T16:15:20.189994+0000","last_active":"2023-12-19T16:15:24.610122+0000","last_peered":"2023-12-19T16:15:24.610122+0000","last_clean":"2023-12-19T16:15:24.610122+0000","last_became_active":"2023-12-19T16:15:20.188076+0000","last_became_peered":"2023-12-19T16:15:20.188076+0000","last_unstale":"2023-12-19T16:15:24.610122+0000","last_undegraded":"2023-12-19T16:15:24.610122+0000","last_fullsized":"2023-12-19T16:15:24.610122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991932+0000","last_change":"2023-12-19T16:15:24.602286+0000","last_active":"2023-12-19T16:15:24.991932+0000","last_peered":"2023-12-19T16:15:24.991932+0000","last_clean":"2023-12-19T16:15:24.991932+0000","last_became_active":"2023-12-19T16:15:24.601875+0000","last_became_peered":"2023-12-19T16:15:24.601875+0000","last_unstale":"2023-12-19T16:15:24.991932+0000","last_undegraded":"2023-12-19T16:15:24.991932+0000","last_fullsized":"2023-12-19T16:15:24.991932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616423+0000","last_change":"2023-12-19T16:15:20.605190+0000","last_active":"2023-12-19T16:15:24.616423+0000","last_peered":"2023-12-19T16:15:24.616423+0000","last_clean":"2023-12-19T16:15:24.616423+0000","last_became_active":"2023-12-19T16:15:20.605031+0000","last_became_peered":"2023-12-19T16:15:20.605031+0000","last_unstale":"2023-12-19T16:15:24.616423+0000","last_undegraded":"2023-12-19T16:15:24.616423+0000","last_fullsized":"2023-12-19T16:15:24.616423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586417+0000","last_change":"2023-12-19T16:15:20.188422+0000","last_active":"2023-12-19T16:15:24.586417+0000","last_peered":"2023-12-19T16:15:24.586417+0000","last_clean":"2023-12-19T16:15:24.586417+0000","last_became_active":"2023-12-19T16:15:20.188093+0000","last_became_peered":"2023-12-19T16:15:20.188093+0000","last_unstale":"2023-12-19T16:15:24.586417+0000","last_undegraded":"2023-12-19T16:15:24.586417+0000","last_fullsized":"2023-12-19T16:15:24.586417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987050+0000","last_change":"2023-12-19T16:15:24.601682+0000","last_active":"2023-12-19T16:15:24.987050+0000","last_peered":"2023-12-19T16:15:24.987050+0000","last_clean":"2023-12-19T16:15:24.987050+0000","last_became_active":"2023-12-19T16:15:24.601267+0000","last_became_peered":"2023-12-19T16:15:24.601267+0000","last_unstale":"2023-12-19T16:15:24.987050+0000","last_undegraded":"2023-12-19T16:15:24.987050+0000","last_fullsized":"2023-12-19T16:15:24.987050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616152+0000","last_change":"2023-12-19T16:15:20.601877+0000","last_active":"2023-12-19T16:15:24.616152+0000","last_peered":"2023-12-19T16:15:24.616152+0000","last_clean":"2023-12-19T16:15:24.616152+0000","last_became_active":"2023-12-19T16:15:20.601574+0000","last_became_peered":"2023-12-19T16:15:20.601574+0000","last_unstale":"2023-12-19T16:15:24.616152+0000","last_undegraded":"2023-12-19T16:15:24.616152+0000","last_fullsized":"2023-12-19T16:15:24.616152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586605+0000","last_change":"2023-12-19T16:15:20.203704+0000","last_active":"2023-12-19T16:15:24.586605+0000","last_peered":"2023-12-19T16:15:24.586605+0000","last_clean":"2023-12-19T16:15:24.586605+0000","last_became_active":"2023-12-19T16:15:20.203355+0000","last_became_peered":"2023-12-19T16:15:20.203355+0000","last_unstale":"2023-12-19T16:15:24.586605+0000","last_undegraded":"2023-12-19T16:15:24.586605+0000","last_fullsized":"2023-12-19T16:15:24.586605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987820+0000","last_change":"2023-12-19T16:15:24.624496+0000","last_active":"2023-12-19T16:15:24.987820+0000","last_peered":"2023-12-19T16:15:24.987820+0000","last_clean":"2023-12-19T16:15:24.987820+0000","last_became_active":"2023-12-19T16:15:24.620007+0000","last_became_peered":"2023-12-19T16:15:24.620007+0000","last_unstale":"2023-12-19T16:15:24.987820+0000","last_undegraded":"2023-12-19T16:15:24.987820+0000","last_fullsized":"2023-12-19T16:15:24.987820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611918+0000","last_change":"2023-12-19T16:15:20.592930+0000","last_active":"2023-12-19T16:15:24.611918+0000","last_peered":"2023-12-19T16:15:24.611918+0000","last_clean":"2023-12-19T16:15:24.611918+0000","last_became_active":"2023-12-19T16:15:20.592602+0000","last_became_peered":"2023-12-19T16:15:20.592602+0000","last_unstale":"2023-12-19T16:15:24.611918+0000","last_undegraded":"2023-12-19T16:15:24.611918+0000","last_fullsized":"2023-12-19T16:15:24.611918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586537+0000","last_change":"2023-12-19T16:15:20.193145+0000","last_active":"2023-12-19T16:15:24.586537+0000","last_peered":"2023-12-19T16:15:24.586537+0000","last_clean":"2023-12-19T16:15:24.586537+0000","last_became_active":"2023-12-19T16:15:20.192849+0000","last_became_peered":"2023-12-19T16:15:20.192849+0000","last_unstale":"2023-12-19T16:15:24.586537+0000","last_undegraded":"2023-12-19T16:15:24.586537+0000","last_fullsized":"2023-12-19T16:15:24.586537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990894+0000","last_change":"2023-12-19T16:15:24.617964+0000","last_active":"2023-12-19T16:15:24.990894+0000","last_peered":"2023-12-19T16:15:24.990894+0000","last_clean":"2023-12-19T16:15:24.990894+0000","last_became_active":"2023-12-19T16:15:24.617522+0000","last_became_peered":"2023-12-19T16:15:24.617522+0000","last_unstale":"2023-12-19T16:15:24.990894+0000","last_undegraded":"2023-12-19T16:15:24.990894+0000","last_fullsized":"2023-12-19T16:15:24.990894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589828+0000","last_change":"2023-12-19T16:15:20.610470+0000","last_active":"2023-12-19T16:15:24.589828+0000","last_peered":"2023-12-19T16:15:24.589828+0000","last_clean":"2023-12-19T16:15:24.589828+0000","last_became_active":"2023-12-19T16:15:20.610140+0000","last_became_peered":"2023-12-19T16:15:20.610140+0000","last_unstale":"2023-12-19T16:15:24.589828+0000","last_undegraded":"2023-12-19T16:15:24.589828+0000","last_fullsized":"2023-12-19T16:15:24.589828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590885+0000","last_change":"2023-12-19T16:15:20.193278+0000","last_active":"2023-12-19T16:15:24.590885+0000","last_peered":"2023-12-19T16:15:24.590885+0000","last_clean":"2023-12-19T16:15:24.590885+0000","last_became_active":"2023-12-19T16:15:20.189782+0000","last_became_peered":"2023-12-19T16:15:20.189782+0000","last_unstale":"2023-12-19T16:15:24.590885+0000","last_undegraded":"2023-12-19T16:15:24.590885+0000","last_fullsized":"2023-12-19T16:15:24.590885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.993027+0000","last_change":"2023-12-19T16:15:24.609889+0000","last_active":"2023-12-19T16:15:24.993027+0000","last_peered":"2023-12-19T16:15:24.993027+0000","last_clean":"2023-12-19T16:15:24.993027+0000","last_became_active":"2023-12-19T16:15:24.609251+0000","last_became_peered":"2023-12-19T16:15:24.609251+0000","last_unstale":"2023-12-19T16:15:24.993027+0000","last_undegraded":"2023-12-19T16:15:24.993027+0000","last_fullsized":"2023-12-19T16:15:24.993027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:02.692965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612765+0000","last_change":"2023-12-19T16:15:20.600917+0000","last_active":"2023-12-19T16:15:24.612765+0000","last_peered":"2023-12-19T16:15:24.612765+0000","last_clean":"2023-12-19T16:15:24.612765+0000","last_became_active":"2023-12-19T16:15:20.600561+0000","last_became_peered":"2023-12-19T16:15:20.600561+0000","last_unstale":"2023-12-19T16:15:24.612765+0000","last_undegraded":"2023-12-19T16:15:24.612765+0000","last_fullsized":"2023-12-19T16:15:24.612765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583304+0000","last_change":"2023-12-19T16:15:20.201508+0000","last_active":"2023-12-19T16:15:24.583304+0000","last_peered":"2023-12-19T16:15:24.583304+0000","last_clean":"2023-12-19T16:15:24.583304+0000","last_became_active":"2023-12-19T16:15:20.201097+0000","last_became_peered":"2023-12-19T16:15:20.201097+0000","last_unstale":"2023-12-19T16:15:24.583304+0000","last_undegraded":"2023-12-19T16:15:24.583304+0000","last_fullsized":"2023-12-19T16:15:24.583304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992254+0000","last_change":"2023-12-19T16:15:24.608002+0000","last_active":"2023-12-19T16:15:24.992254+0000","last_peered":"2023-12-19T16:15:24.992254+0000","last_clean":"2023-12-19T16:15:24.992254+0000","last_became_active":"2023-12-19T16:15:24.606747+0000","last_became_peered":"2023-12-19T16:15:24.606747+0000","last_unstale":"2023-12-19T16:15:24.992254+0000","last_undegraded":"2023-12-19T16:15:24.992254+0000","last_fullsized":"2023-12-19T16:15:24.992254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:18.036976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588578+0000","last_change":"2023-12-19T16:15:20.587572+0000","last_active":"2023-12-19T16:15:24.588578+0000","last_peered":"2023-12-19T16:15:24.588578+0000","last_clean":"2023-12-19T16:15:24.588578+0000","last_became_active":"2023-12-19T16:15:20.581946+0000","last_became_peered":"2023-12-19T16:15:20.581946+0000","last_unstale":"2023-12-19T16:15:24.588578+0000","last_undegraded":"2023-12-19T16:15:24.588578+0000","last_fullsized":"2023-12-19T16:15:24.588578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589554+0000","last_change":"2023-12-19T16:15:20.195315+0000","last_active":"2023-12-19T16:15:24.589554+0000","last_peered":"2023-12-19T16:15:24.589554+0000","last_clean":"2023-12-19T16:15:24.589554+0000","last_became_active":"2023-12-19T16:15:20.194795+0000","last_became_peered":"2023-12-19T16:15:20.194795+0000","last_unstale":"2023-12-19T16:15:24.589554+0000","last_undegraded":"2023-12-19T16:15:24.589554+0000","last_fullsized":"2023-12-19T16:15:24.589554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.989014+0000","last_change":"2023-12-19T16:15:24.620913+0000","last_active":"2023-12-19T16:15:24.989014+0000","last_peered":"2023-12-19T16:15:24.989014+0000","last_clean":"2023-12-19T16:15:24.989014+0000","last_became_active":"2023-12-19T16:15:24.620490+0000","last_became_peered":"2023-12-19T16:15:24.620490+0000","last_unstale":"2023-12-19T16:15:24.989014+0000","last_undegraded":"2023-12-19T16:15:24.989014+0000","last_fullsized":"2023-12-19T16:15:24.989014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.613716+0000","last_change":"2023-12-19T16:15:20.607538+0000","last_active":"2023-12-19T16:15:24.613716+0000","last_peered":"2023-12-19T16:15:24.613716+0000","last_clean":"2023-12-19T16:15:24.613716+0000","last_became_active":"2023-12-19T16:15:20.607181+0000","last_became_peered":"2023-12-19T16:15:20.607181+0000","last_unstale":"2023-12-19T16:15:24.613716+0000","last_undegraded":"2023-12-19T16:15:24.613716+0000","last_fullsized":"2023-12-19T16:15:24.613716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:30.750566+0000","last_change":"2023-12-19T16:15:20.199632+0000","last_active":"2023-12-19T16:15:30.750566+0000","last_peered":"2023-12-19T16:15:30.750566+0000","last_clean":"2023-12-19T16:15:30.750566+0000","last_became_active":"2023-12-19T16:15:20.198790+0000","last_became_peered":"2023-12-19T16:15:20.198790+0000","last_unstale":"2023-12-19T16:15:30.750566+0000","last_undegraded":"2023-12-19T16:15:30.750566+0000","last_fullsized":"2023-12-19T16:15:30.750566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990866+0000","last_change":"2023-12-19T16:15:24.608145+0000","last_active":"2023-12-19T16:15:24.990866+0000","last_peered":"2023-12-19T16:15:24.990866+0000","last_clean":"2023-12-19T16:15:24.990866+0000","last_became_active":"2023-12-19T16:15:24.607175+0000","last_became_peered":"2023-12-19T16:15:24.607175+0000","last_unstale":"2023-12-19T16:15:24.990866+0000","last_undegraded":"2023-12-19T16:15:24.990866+0000","last_fullsized":"2023-12-19T16:15:24.990866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589930+0000","last_change":"2023-12-19T16:15:20.579667+0000","last_active":"2023-12-19T16:15:24.589930+0000","last_peered":"2023-12-19T16:15:24.589930+0000","last_clean":"2023-12-19T16:15:24.589930+0000","last_became_active":"2023-12-19T16:15:20.578820+0000","last_became_peered":"2023-12-19T16:15:20.578820+0000","last_unstale":"2023-12-19T16:15:24.589930+0000","last_undegraded":"2023-12-19T16:15:24.589930+0000","last_fullsized":"2023-12-19T16:15:24.589930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610063+0000","last_change":"2023-12-19T16:15:20.202464+0000","last_active":"2023-12-19T16:15:24.610063+0000","last_peered":"2023-12-19T16:15:24.610063+0000","last_clean":"2023-12-19T16:15:24.610063+0000","last_became_active":"2023-12-19T16:15:20.202201+0000","last_became_peered":"2023-12-19T16:15:20.202201+0000","last_unstale":"2023-12-19T16:15:24.610063+0000","last_undegraded":"2023-12-19T16:15:24.610063+0000","last_fullsized":"2023-12-19T16:15:24.610063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987742+0000","last_change":"2023-12-19T16:15:24.606235+0000","last_active":"2023-12-19T16:15:24.987742+0000","last_peered":"2023-12-19T16:15:24.987742+0000","last_clean":"2023-12-19T16:15:24.987742+0000","last_became_active":"2023-12-19T16:15:24.605689+0000","last_became_peered":"2023-12-19T16:15:24.605689+0000","last_unstale":"2023-12-19T16:15:24.987742+0000","last_undegraded":"2023-12-19T16:15:24.987742+0000","last_fullsized":"2023-12-19T16:15:24.987742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588108+0000","last_change":"2023-12-19T16:15:20.579264+0000","last_active":"2023-12-19T16:15:24.588108+0000","last_peered":"2023-12-19T16:15:24.588108+0000","last_clean":"2023-12-19T16:15:24.588108+0000","last_became_active":"2023-12-19T16:15:20.578990+0000","last_became_peered":"2023-12-19T16:15:20.578990+0000","last_unstale":"2023-12-19T16:15:24.588108+0000","last_undegraded":"2023-12-19T16:15:24.588108+0000","last_fullsized":"2023-12-19T16:15:24.588108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583852+0000","last_change":"2023-12-19T16:15:20.199283+0000","last_active":"2023-12-19T16:15:24.583852+0000","last_peered":"2023-12-19T16:15:24.583852+0000","last_clean":"2023-12-19T16:15:24.583852+0000","last_became_active":"2023-12-19T16:15:20.199018+0000","last_became_peered":"2023-12-19T16:15:20.199018+0000","last_unstale":"2023-12-19T16:15:24.583852+0000","last_undegraded":"2023-12-19T16:15:24.583852+0000","last_fullsized":"2023-12-19T16:15:24.583852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990899+0000","last_change":"2023-12-19T16:15:24.606050+0000","last_active":"2023-12-19T16:15:24.990899+0000","last_peered":"2023-12-19T16:15:24.990899+0000","last_clean":"2023-12-19T16:15:24.990899+0000","last_became_active":"2023-12-19T16:15:24.605031+0000","last_became_peered":"2023-12-19T16:15:24.605031+0000","last_unstale":"2023-12-19T16:15:24.990899+0000","last_undegraded":"2023-12-19T16:15:24.990899+0000","last_fullsized":"2023-12-19T16:15:24.990899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:43.598139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583755+0000","last_change":"2023-12-19T16:15:20.587105+0000","last_active":"2023-12-19T16:15:24.583755+0000","last_peered":"2023-12-19T16:15:24.583755+0000","last_clean":"2023-12-19T16:15:24.583755+0000","last_became_active":"2023-12-19T16:15:20.586267+0000","last_became_peered":"2023-12-19T16:15:20.586267+0000","last_unstale":"2023-12-19T16:15:24.583755+0000","last_undegraded":"2023-12-19T16:15:24.583755+0000","last_fullsized":"2023-12-19T16:15:24.583755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591781+0000","last_change":"2023-12-19T16:15:20.205716+0000","last_active":"2023-12-19T16:15:24.591781+0000","last_peered":"2023-12-19T16:15:24.591781+0000","last_clean":"2023-12-19T16:15:24.591781+0000","last_became_active":"2023-12-19T16:15:20.205375+0000","last_became_peered":"2023-12-19T16:15:20.205375+0000","last_unstale":"2023-12-19T16:15:24.591781+0000","last_undegraded":"2023-12-19T16:15:24.591781+0000","last_fullsized":"2023-12-19T16:15:24.591781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991323+0000","last_change":"2023-12-19T16:15:24.614651+0000","last_active":"2023-12-19T16:15:24.991323+0000","last_peered":"2023-12-19T16:15:24.991323+0000","last_clean":"2023-12-19T16:15:24.991323+0000","last_became_active":"2023-12-19T16:15:24.613651+0000","last_became_peered":"2023-12-19T16:15:24.613651+0000","last_unstale":"2023-12-19T16:15:24.991323+0000","last_undegraded":"2023-12-19T16:15:24.991323+0000","last_fullsized":"2023-12-19T16:15:24.991323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990804+0000","last_change":"2023-12-19T16:15:24.617457+0000","last_active":"2023-12-19T16:15:24.990804+0000","last_peered":"2023-12-19T16:15:24.990804+0000","last_clean":"2023-12-19T16:15:24.990804+0000","last_became_active":"2023-12-19T16:15:24.617082+0000","last_became_peered":"2023-12-19T16:15:24.617082+0000","last_unstale":"2023-12-19T16:15:24.990804+0000","last_undegraded":"2023-12-19T16:15:24.990804+0000","last_fullsized":"2023-12-19T16:15:24.990804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606089+0000","last_change":"2023-12-19T16:15:20.596047+0000","last_active":"2023-12-19T16:15:24.606089+0000","last_peered":"2023-12-19T16:15:24.606089+0000","last_clean":"2023-12-19T16:15:24.606089+0000","last_became_active":"2023-12-19T16:15:20.595801+0000","last_became_peered":"2023-12-19T16:15:20.595801+0000","last_unstale":"2023-12-19T16:15:24.606089+0000","last_undegraded":"2023-12-19T16:15:24.606089+0000","last_fullsized":"2023-12-19T16:15:24.606089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582938+0000","last_change":"2023-12-19T16:15:20.198366+0000","last_active":"2023-12-19T16:15:24.582938+0000","last_peered":"2023-12-19T16:15:24.582938+0000","last_clean":"2023-12-19T16:15:24.582938+0000","last_became_active":"2023-12-19T16:15:20.198123+0000","last_became_peered":"2023-12-19T16:15:20.198123+0000","last_unstale":"2023-12-19T16:15:24.582938+0000","last_undegraded":"2023-12-19T16:15:24.582938+0000","last_fullsized":"2023-12-19T16:15:24.582938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992336+0000","last_change":"2023-12-19T16:15:24.613114+0000","last_active":"2023-12-19T16:15:24.992336+0000","last_peered":"2023-12-19T16:15:24.992336+0000","last_clean":"2023-12-19T16:15:24.992336+0000","last_became_active":"2023-12-19T16:15:24.612703+0000","last_became_peered":"2023-12-19T16:15:24.612703+0000","last_unstale":"2023-12-19T16:15:24.992336+0000","last_undegraded":"2023-12-19T16:15:24.992336+0000","last_fullsized":"2023-12-19T16:15:24.992336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580525+0000","last_change":"2023-12-19T16:15:20.578523+0000","last_active":"2023-12-19T16:15:24.580525+0000","last_peered":"2023-12-19T16:15:24.580525+0000","last_clean":"2023-12-19T16:15:24.580525+0000","last_became_active":"2023-12-19T16:15:20.578185+0000","last_became_peered":"2023-12-19T16:15:20.578185+0000","last_unstale":"2023-12-19T16:15:24.580525+0000","last_undegraded":"2023-12-19T16:15:24.580525+0000","last_fullsized":"2023-12-19T16:15:24.580525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582035+0000","last_change":"2023-12-19T16:15:20.197343+0000","last_active":"2023-12-19T16:15:24.582035+0000","last_peered":"2023-12-19T16:15:24.582035+0000","last_clean":"2023-12-19T16:15:24.582035+0000","last_became_active":"2023-12-19T16:15:20.196946+0000","last_became_peered":"2023-12-19T16:15:20.196946+0000","last_unstale":"2023-12-19T16:15:24.582035+0000","last_undegraded":"2023-12-19T16:15:24.582035+0000","last_fullsized":"2023-12-19T16:15:24.582035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590498+0000","last_change":"2023-12-19T16:15:20.196588+0000","last_active":"2023-12-19T16:15:24.590498+0000","last_peered":"2023-12-19T16:15:24.590498+0000","last_clean":"2023-12-19T16:15:24.590498+0000","last_became_active":"2023-12-19T16:15:20.196249+0000","last_became_peered":"2023-12-19T16:15:20.196249+0000","last_unstale":"2023-12-19T16:15:24.590498+0000","last_undegraded":"2023-12-19T16:15:24.590498+0000","last_fullsized":"2023-12-19T16:15:24.590498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589480+0000","last_change":"2023-12-19T16:15:20.578312+0000","last_active":"2023-12-19T16:15:24.589480+0000","last_peered":"2023-12-19T16:15:24.589480+0000","last_clean":"2023-12-19T16:15:24.589480+0000","last_became_active":"2023-12-19T16:15:20.578056+0000","last_became_peered":"2023-12-19T16:15:20.578056+0000","last_unstale":"2023-12-19T16:15:24.589480+0000","last_undegraded":"2023-12-19T16:15:24.589480+0000","last_fullsized":"2023-12-19T16:15:24.589480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.985598+0000","last_change":"2023-12-19T16:15:24.614365+0000","last_active":"2023-12-19T16:15:24.985598+0000","last_peered":"2023-12-19T16:15:24.985598+0000","last_clean":"2023-12-19T16:15:24.985598+0000","last_became_active":"2023-12-19T16:15:24.613978+0000","last_became_peered":"2023-12-19T16:15:24.613978+0000","last_unstale":"2023-12-19T16:15:24.985598+0000","last_undegraded":"2023-12-19T16:15:24.985598+0000","last_fullsized":"2023-12-19T16:15:24.985598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:33.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580327+0000","last_change":"2023-12-19T16:15:20.191767+0000","last_active":"2023-12-19T16:15:24.580327+0000","last_peered":"2023-12-19T16:15:24.580327+0000","last_clean":"2023-12-19T16:15:24.580327+0000","last_became_active":"2023-12-19T16:15:20.191391+0000","last_became_peered":"2023-12-19T16:15:20.191391+0000","last_unstale":"2023-12-19T16:15:24.580327+0000","last_undegraded":"2023-12-19T16:15:24.580327+0000","last_fullsized":"2023-12-19T16:15:24.580327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587620+0000","last_change":"2023-12-19T16:15:20.593654+0000","last_active":"2023-12-19T16:15:24.587620+0000","last_peered":"2023-12-19T16:15:24.587620+0000","last_clean":"2023-12-19T16:15:24.587620+0000","last_became_active":"2023-12-19T16:15:20.593384+0000","last_became_peered":"2023-12-19T16:15:20.593384+0000","last_unstale":"2023-12-19T16:15:24.587620+0000","last_undegraded":"2023-12-19T16:15:24.587620+0000","last_fullsized":"2023-12-19T16:15:24.587620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992753+0000","last_change":"2023-12-19T16:15:24.608692+0000","last_active":"2023-12-19T16:15:24.992753+0000","last_peered":"2023-12-19T16:15:24.992753+0000","last_clean":"2023-12-19T16:15:24.992753+0000","last_became_active":"2023-12-19T16:15:24.608307+0000","last_became_peered":"2023-12-19T16:15:24.608307+0000","last_unstale":"2023-12-19T16:15:24.992753+0000","last_undegraded":"2023-12-19T16:15:24.992753+0000","last_fullsized":"2023-12-19T16:15:24.992753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:21:37.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589734+0000","last_change":"2023-12-19T16:15:20.608095+0000","last_active":"2023-12-19T16:15:24.589734+0000","last_peered":"2023-12-19T16:15:24.589734+0000","last_clean":"2023-12-19T16:15:24.589734+0000","last_became_active":"2023-12-19T16:15:20.604431+0000","last_became_peered":"2023-12-19T16:15:20.604431+0000","last_unstale":"2023-12-19T16:15:24.589734+0000","last_undegraded":"2023-12-19T16:15:24.589734+0000","last_fullsized":"2023-12-19T16:15:24.589734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586488+0000","last_change":"2023-12-19T16:15:20.587765+0000","last_active":"2023-12-19T16:15:24.586488+0000","last_peered":"2023-12-19T16:15:24.586488+0000","last_clean":"2023-12-19T16:15:24.586488+0000","last_became_active":"2023-12-19T16:15:20.587480+0000","last_became_peered":"2023-12-19T16:15:20.587480+0000","last_unstale":"2023-12-19T16:15:24.586488+0000","last_undegraded":"2023-12-19T16:15:24.586488+0000","last_fullsized":"2023-12-19T16:15:24.586488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583224+0000","last_change":"2023-12-19T16:15:20.590224+0000","last_active":"2023-12-19T16:15:24.583224+0000","last_peered":"2023-12-19T16:15:24.583224+0000","last_clean":"2023-12-19T16:15:24.583224+0000","last_became_active":"2023-12-19T16:15:20.589817+0000","last_became_peered":"2023-12-19T16:15:20.589817+0000","last_unstale":"2023-12-19T16:15:24.583224+0000","last_undegraded":"2023-12-19T16:15:24.583224+0000","last_fullsized":"2023-12-19T16:15:24.583224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589415+0000","last_change":"2023-12-19T16:15:20.584816+0000","last_active":"2023-12-19T16:15:24.589415+0000","last_peered":"2023-12-19T16:15:24.589415+0000","last_clean":"2023-12-19T16:15:24.589415+0000","last_became_active":"2023-12-19T16:15:20.584532+0000","last_became_peered":"2023-12-19T16:15:20.584532+0000","last_unstale":"2023-12-19T16:15:24.589415+0000","last_undegraded":"2023-12-19T16:15:24.589415+0000","last_fullsized":"2023-12-19T16:15:24.589415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580387+0000","last_change":"2023-12-19T16:15:20.583294+0000","last_active":"2023-12-19T16:15:24.580387+0000","last_peered":"2023-12-19T16:15:24.580387+0000","last_clean":"2023-12-19T16:15:24.580387+0000","last_became_active":"2023-12-19T16:15:20.583080+0000","last_became_peered":"2023-12-19T16:15:20.583080+0000","last_unstale":"2023-12-19T16:15:24.580387+0000","last_undegraded":"2023-12-19T16:15:24.580387+0000","last_fullsized":"2023-12-19T16:15:24.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609991+0000","last_change":"2023-12-19T16:15:20.604537+0000","last_active":"2023-12-19T16:15:24.609991+0000","last_peered":"2023-12-19T16:15:24.609991+0000","last_clean":"2023-12-19T16:15:24.609991+0000","last_became_active":"2023-12-19T16:15:20.604292+0000","last_became_peered":"2023-12-19T16:15:20.604292+0000","last_unstale":"2023-12-19T16:15:24.609991+0000","last_undegraded":"2023-12-19T16:15:24.609991+0000","last_fullsized":"2023-12-19T16:15:24.609991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592846+0000","last_change":"2023-12-19T16:15:20.586983+0000","last_active":"2023-12-19T16:15:24.592846+0000","last_peered":"2023-12-19T16:15:24.592846+0000","last_clean":"2023-12-19T16:15:24.592846+0000","last_became_active":"2023-12-19T16:15:20.586747+0000","last_became_peered":"2023-12-19T16:15:20.586747+0000","last_unstale":"2023-12-19T16:15:24.592846+0000","last_undegraded":"2023-12-19T16:15:24.592846+0000","last_fullsized":"2023-12-19T16:15:24.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580756+0000","last_change":"2023-12-19T16:15:20.600781+0000","last_active":"2023-12-19T16:15:24.580756+0000","last_peered":"2023-12-19T16:15:24.580756+0000","last_clean":"2023-12-19T16:15:24.580756+0000","last_became_active":"2023-12-19T16:15:20.600499+0000","last_became_peered":"2023-12-19T16:15:20.600499+0000","last_unstale":"2023-12-19T16:15:24.580756+0000","last_undegraded":"2023-12-19T16:15:24.580756+0000","last_fullsized":"2023-12-19T16:15:24.580756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582940+0000","last_change":"2023-12-19T16:15:20.590492+0000","last_active":"2023-12-19T16:15:24.582940+0000","last_peered":"2023-12-19T16:15:24.582940+0000","last_clean":"2023-12-19T16:15:24.582940+0000","last_became_active":"2023-12-19T16:15:20.590230+0000","last_became_peered":"2023-12-19T16:15:20.590230+0000","last_unstale":"2023-12-19T16:15:24.582940+0000","last_undegraded":"2023-12-19T16:15:24.582940+0000","last_fullsized":"2023-12-19T16:15:24.582940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581284+0000","last_change":"2023-12-19T16:15:20.582285+0000","last_active":"2023-12-19T16:15:24.581284+0000","last_peered":"2023-12-19T16:15:24.581284+0000","last_clean":"2023-12-19T16:15:24.581284+0000","last_became_active":"2023-12-19T16:15:20.581886+0000","last_became_peered":"2023-12-19T16:15:20.581886+0000","last_unstale":"2023-12-19T16:15:24.581284+0000","last_undegraded":"2023-12-19T16:15:24.581284+0000","last_fullsized":"2023-12-19T16:15:24.581284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583151+0000","last_change":"2023-12-19T16:15:20.580662+0000","last_active":"2023-12-19T16:15:24.583151+0000","last_peered":"2023-12-19T16:15:24.583151+0000","last_clean":"2023-12-19T16:15:24.583151+0000","last_became_active":"2023-12-19T16:15:20.580373+0000","last_became_peered":"2023-12-19T16:15:20.580373+0000","last_unstale":"2023-12-19T16:15:24.583151+0000","last_undegraded":"2023-12-19T16:15:24.583151+0000","last_fullsized":"2023-12-19T16:15:24.583151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589332+0000","last_change":"2023-12-19T16:15:20.583886+0000","last_active":"2023-12-19T16:15:24.589332+0000","last_peered":"2023-12-19T16:15:24.589332+0000","last_clean":"2023-12-19T16:15:24.589332+0000","last_became_active":"2023-12-19T16:15:20.583709+0000","last_became_peered":"2023-12-19T16:15:20.583709+0000","last_unstale":"2023-12-19T16:15:24.589332+0000","last_undegraded":"2023-12-19T16:15:24.589332+0000","last_fullsized":"2023-12-19T16:15:24.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591040+0000","last_change":"2023-12-19T16:15:20.611237+0000","last_active":"2023-12-19T16:15:24.591040+0000","last_peered":"2023-12-19T16:15:24.591040+0000","last_clean":"2023-12-19T16:15:24.591040+0000","last_became_active":"2023-12-19T16:15:20.610946+0000","last_became_peered":"2023-12-19T16:15:20.610946+0000","last_unstale":"2023-12-19T16:15:24.591040+0000","last_undegraded":"2023-12-19T16:15:24.591040+0000","last_fullsized":"2023-12-19T16:15:24.591040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616066+0000","last_change":"2023-12-19T16:15:20.602585+0000","last_active":"2023-12-19T16:15:24.616066+0000","last_peered":"2023-12-19T16:15:24.616066+0000","last_clean":"2023-12-19T16:15:24.616066+0000","last_became_active":"2023-12-19T16:15:20.602278+0000","last_became_peered":"2023-12-19T16:15:20.602278+0000","last_unstale":"2023-12-19T16:15:24.616066+0000","last_undegraded":"2023-12-19T16:15:24.616066+0000","last_fullsized":"2023-12-19T16:15:24.616066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586325+0000","last_change":"2023-12-19T16:15:20.602226+0000","last_active":"2023-12-19T16:15:24.586325+0000","last_peered":"2023-12-19T16:15:24.586325+0000","last_clean":"2023-12-19T16:15:24.586325+0000","last_became_active":"2023-12-19T16:15:20.601928+0000","last_became_peered":"2023-12-19T16:15:20.601928+0000","last_unstale":"2023-12-19T16:15:24.586325+0000","last_undegraded":"2023-12-19T16:15:24.586325+0000","last_fullsized":"2023-12-19T16:15:24.586325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.584077+0000","last_change":"2023-12-19T16:15:20.584639+0000","last_active":"2023-12-19T16:15:24.584077+0000","last_peered":"2023-12-19T16:15:24.584077+0000","last_clean":"2023-12-19T16:15:24.584077+0000","last_became_active":"2023-12-19T16:15:20.584426+0000","last_became_peered":"2023-12-19T16:15:20.584426+0000","last_unstale":"2023-12-19T16:15:24.584077+0000","last_undegraded":"2023-12-19T16:15:24.584077+0000","last_fullsized":"2023-12-19T16:15:24.584077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582785+0000","last_change":"2023-12-19T16:15:20.575948+0000","last_active":"2023-12-19T16:15:24.582785+0000","last_peered":"2023-12-19T16:15:24.582785+0000","last_clean":"2023-12-19T16:15:24.582785+0000","last_became_active":"2023-12-19T16:15:20.573675+0000","last_became_peered":"2023-12-19T16:15:20.573675+0000","last_unstale":"2023-12-19T16:15:24.582785+0000","last_undegraded":"2023-12-19T16:15:24.582785+0000","last_fullsized":"2023-12-19T16:15:24.582785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:23.787433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607444+0000","last_change":"2023-12-19T16:15:20.588200+0000","last_active":"2023-12-19T16:15:24.607444+0000","last_peered":"2023-12-19T16:15:24.607444+0000","last_clean":"2023-12-19T16:15:24.607444+0000","last_became_active":"2023-12-19T16:15:20.587984+0000","last_became_peered":"2023-12-19T16:15:20.587984+0000","last_unstale":"2023-12-19T16:15:24.607444+0000","last_undegraded":"2023-12-19T16:15:24.607444+0000","last_fullsized":"2023-12-19T16:15:24.607444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588501+0000","last_change":"2023-12-19T16:15:20.588750+0000","last_active":"2023-12-19T16:15:24.588501+0000","last_peered":"2023-12-19T16:15:24.588501+0000","last_clean":"2023-12-19T16:15:24.588501+0000","last_became_active":"2023-12-19T16:15:20.588398+0000","last_became_peered":"2023-12-19T16:15:20.588398+0000","last_unstale":"2023-12-19T16:15:24.588501+0000","last_undegraded":"2023-12-19T16:15:24.588501+0000","last_fullsized":"2023-12-19T16:15:24.588501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580194+0000","last_change":"2023-12-19T16:15:20.604284+0000","last_active":"2023-12-19T16:15:24.580194+0000","last_peered":"2023-12-19T16:15:24.580194+0000","last_clean":"2023-12-19T16:15:24.580194+0000","last_became_active":"2023-12-19T16:15:20.603889+0000","last_became_peered":"2023-12-19T16:15:20.603889+0000","last_unstale":"2023-12-19T16:15:24.580194+0000","last_undegraded":"2023-12-19T16:15:24.580194+0000","last_fullsized":"2023-12-19T16:15:24.580194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589849+0000","last_change":"2023-12-19T16:15:20.611693+0000","last_active":"2023-12-19T16:15:24.589849+0000","last_peered":"2023-12-19T16:15:24.589849+0000","last_clean":"2023-12-19T16:15:24.589849+0000","last_became_active":"2023-12-19T16:15:20.611287+0000","last_became_peered":"2023-12-19T16:15:20.611287+0000","last_unstale":"2023-12-19T16:15:24.589849+0000","last_undegraded":"2023-12-19T16:15:24.589849+0000","last_fullsized":"2023-12-19T16:15:24.589849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592587+0000","last_change":"2023-12-19T16:15:20.603377+0000","last_active":"2023-12-19T16:15:24.592587+0000","last_peered":"2023-12-19T16:15:24.592587+0000","last_clean":"2023-12-19T16:15:24.592587+0000","last_became_active":"2023-12-19T16:15:20.603157+0000","last_became_peered":"2023-12-19T16:15:20.603157+0000","last_unstale":"2023-12-19T16:15:24.592587+0000","last_undegraded":"2023-12-19T16:15:24.592587+0000","last_fullsized":"2023-12-19T16:15:24.592587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592770+0000","last_change":"2023-12-19T16:15:20.599480+0000","last_active":"2023-12-19T16:15:24.592770+0000","last_peered":"2023-12-19T16:15:24.592770+0000","last_clean":"2023-12-19T16:15:24.592770+0000","last_became_active":"2023-12-19T16:15:20.599204+0000","last_became_peered":"2023-12-19T16:15:20.599204+0000","last_unstale":"2023-12-19T16:15:24.592770+0000","last_undegraded":"2023-12-19T16:15:24.592770+0000","last_fullsized":"2023-12-19T16:15:24.592770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616342+0000","last_change":"2023-12-19T16:15:20.609122+0000","last_active":"2023-12-19T16:15:24.616342+0000","last_peered":"2023-12-19T16:15:24.616342+0000","last_clean":"2023-12-19T16:15:24.616342+0000","last_became_active":"2023-12-19T16:15:20.608840+0000","last_became_peered":"2023-12-19T16:15:20.608840+0000","last_unstale":"2023-12-19T16:15:24.616342+0000","last_undegraded":"2023-12-19T16:15:24.616342+0000","last_fullsized":"2023-12-19T16:15:24.616342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:01.062348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579734+0000","last_change":"2023-12-19T16:15:20.589707+0000","last_active":"2023-12-19T16:15:24.579734+0000","last_peered":"2023-12-19T16:15:24.579734+0000","last_clean":"2023-12-19T16:15:24.579734+0000","last_became_active":"2023-12-19T16:15:20.589430+0000","last_became_peered":"2023-12-19T16:15:20.589430+0000","last_unstale":"2023-12-19T16:15:24.579734+0000","last_undegraded":"2023-12-19T16:15:24.579734+0000","last_fullsized":"2023-12-19T16:15:24.579734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611868+0000","last_change":"2023-12-19T16:15:20.594142+0000","last_active":"2023-12-19T16:15:24.611868+0000","last_peered":"2023-12-19T16:15:24.611868+0000","last_clean":"2023-12-19T16:15:24.611868+0000","last_became_active":"2023-12-19T16:15:20.593842+0000","last_became_peered":"2023-12-19T16:15:20.593842+0000","last_unstale":"2023-12-19T16:15:24.611868+0000","last_undegraded":"2023-12-19T16:15:24.611868+0000","last_fullsized":"2023-12-19T16:15:24.611868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583063+0000","last_change":"2023-12-19T16:15:20.574706+0000","last_active":"2023-12-19T16:15:24.583063+0000","last_peered":"2023-12-19T16:15:24.583063+0000","last_clean":"2023-12-19T16:15:24.583063+0000","last_became_active":"2023-12-19T16:15:20.574376+0000","last_became_peered":"2023-12-19T16:15:20.574376+0000","last_unstale":"2023-12-19T16:15:24.583063+0000","last_undegraded":"2023-12-19T16:15:24.583063+0000","last_fullsized":"2023-12-19T16:15:24.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612667+0000","last_change":"2023-12-19T16:15:20.605920+0000","last_active":"2023-12-19T16:15:24.612667+0000","last_peered":"2023-12-19T16:15:24.612667+0000","last_clean":"2023-12-19T16:15:24.612667+0000","last_became_active":"2023-12-19T16:15:20.605610+0000","last_became_peered":"2023-12-19T16:15:20.605610+0000","last_unstale":"2023-12-19T16:15:24.612667+0000","last_undegraded":"2023-12-19T16:15:24.612667+0000","last_fullsized":"2023-12-19T16:15:24.612667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581912+0000","last_change":"2023-12-19T16:15:20.594793+0000","last_active":"2023-12-19T16:15:24.581912+0000","last_peered":"2023-12-19T16:15:24.581912+0000","last_clean":"2023-12-19T16:15:24.581912+0000","last_became_active":"2023-12-19T16:15:20.593463+0000","last_became_peered":"2023-12-19T16:15:20.593463+0000","last_unstale":"2023-12-19T16:15:24.581912+0000","last_undegraded":"2023-12-19T16:15:24.581912+0000","last_fullsized":"2023-12-19T16:15:24.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588263+0000","last_change":"2023-12-19T16:15:20.590564+0000","last_active":"2023-12-19T16:15:24.588263+0000","last_peered":"2023-12-19T16:15:24.588263+0000","last_clean":"2023-12-19T16:15:24.588263+0000","last_became_active":"2023-12-19T16:15:20.590320+0000","last_became_peered":"2023-12-19T16:15:20.590320+0000","last_unstale":"2023-12-19T16:15:24.588263+0000","last_undegraded":"2023-12-19T16:15:24.588263+0000","last_fullsized":"2023-12-19T16:15:24.588263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609610+0000","last_change":"2023-12-19T16:15:20.603717+0000","last_active":"2023-12-19T16:15:24.609610+0000","last_peered":"2023-12-19T16:15:24.609610+0000","last_clean":"2023-12-19T16:15:24.609610+0000","last_became_active":"2023-12-19T16:15:20.603426+0000","last_became_peered":"2023-12-19T16:15:20.603426+0000","last_unstale":"2023-12-19T16:15:24.609610+0000","last_undegraded":"2023-12-19T16:15:24.609610+0000","last_fullsized":"2023-12-19T16:15:24.609610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616243+0000","last_change":"2023-12-19T16:15:20.614781+0000","last_active":"2023-12-19T16:15:24.616243+0000","last_peered":"2023-12-19T16:15:24.616243+0000","last_clean":"2023-12-19T16:15:24.616243+0000","last_became_active":"2023-12-19T16:15:20.614271+0000","last_became_peered":"2023-12-19T16:15:20.614271+0000","last_unstale":"2023-12-19T16:15:24.616243+0000","last_undegraded":"2023-12-19T16:15:24.616243+0000","last_fullsized":"2023-12-19T16:15:24.616243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3220000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1720000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4829999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5119999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4379999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1289999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:48.872 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 Processor -- start 2023-12-19T16:15:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 -- start start 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f485415ffb0 0x7f48540d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f48540d1280 0x7f48540af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48540d33d0 con 0x7f48540b13d0 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540ce500 con 0x7f48540d1280 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f485a5a2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540af330 con 0x7f485415ffb0 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f48540d1280 0x7f48540af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f48540d1280 0x7f48540af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57074/0 (socket says 172.21.15.119:57074) 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 -- 172.21.15.119:0/3283717835 learned_addr learned my addr 172.21.15.119:0/3283717835 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f48595a0640 1 --2- 172.21.15.119:0/3283717835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f485415ffb0 0x7f48540d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 -- 172.21.15.119:0/3283717835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f485415ffb0 msgr2=0x7f48540d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 --2- 172.21.15.119:0/3283717835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f485415ffb0 0x7f48540d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 -- 172.21.15.119:0/3283717835 >> v1:172.21.15.143:6789/0 conn(0x7f48540b13d0 legacy=0x7f48540d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.047+0000 7f4859da1640 1 -- 172.21.15.119:0/3283717835 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540d3060 con 0x7f48540d1280 2023-12-19T16:15:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f4859da1640 1 --2- 172.21.15.119:0/3283717835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48540d1280 0x7f48540af850 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f484c009e50 tx=0x7f484c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dad591188c3b1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f484bfff640 1 -- 172.21.15.119:0/3283717835 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0a5650 con 0x7f48540d1280 2023-12-19T16:15:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f484bfff640 1 -- 172.21.15.119:0/3283717835 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c0a57b0 con 0x7f48540d1280 2023-12-19T16:15:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f484bfff640 1 -- 172.21.15.119:0/3283717835 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0a5b40 con 0x7f48540d1280 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 -- 172.21.15.119:0/3283717835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48540d1280 msgr2=0x7f48540af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 --2- 172.21.15.119:0/3283717835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48540d1280 0x7f48540af850 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f484c009e50 tx=0x7f484c01c9d0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 -- 172.21.15.119:0/3283717835 shutdown_connections 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 --2- 172.21.15.119:0/3283717835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48540d1280 0x7f48540af850 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 --2- 172.21.15.119:0/3283717835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f485415ffb0 0x7f48540d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 -- 172.21.15.119:0/3283717835 >> 172.21.15.119:0/3283717835 conn(0x7f485409b930 msgr2=0x7f48540d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 -- 172.21.15.119:0/3283717835 shutdown_connections 2023-12-19T16:15:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.051+0000 7f485a5a2640 1 -- 172.21.15.119:0/3283717835 wait complete. 2023-12-19T16:15:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 Processor -- start 2023-12-19T16:15:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 -- start start 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48540b13d0 0x7f4854151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48540d1280 0x7f4854155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 0x7f4854157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485415c620 con 0x7f485415ffb0 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485415c900 con 0x7f48540d1280 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485415cbe0 con 0x7f48540b13d0 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 0x7f4854157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 0x7f4854157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57090/0 (socket says 172.21.15.119:57090) 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 -- 172.21.15.119:0/2289962622 learned_addr learned my addr 172.21.15.119:0/2289962622 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f48595a0640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48540b13d0 0x7f4854151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4858d9f640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48540d1280 0x7f4854155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 -- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48540b13d0 msgr2=0x7f4854151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48540b13d0 0x7f4854151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 -- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48540d1280 msgr2=0x7f4854155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48540d1280 0x7f4854155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 -- 172.21.15.119:0/2289962622 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c009b30 con 0x7f485415ffb0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f48595a0640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48540b13d0 0x7f4854151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4859da1640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 0x7f4854157dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f484c01b080 tx=0x7f484c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0b8670 con 0x7f485415ffb0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c0b87d0 con 0x7f485415ffb0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0b8b80 con 0x7f485415ffb0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485415cec0 con 0x7f485415ffb0 2023-12-19T16:15:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.055+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485415c240 con 0x7f485415ffb0 2023-12-19T16:15:49.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.059+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485414fdd0 con 0x7f485415ffb0 2023-12-19T16:15:49.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.059+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f484c0b8ce0 con 0x7f485415ffb0 2023-12-19T16:15:49.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.059+0000 7f4849ffb640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4838065a60 0x7f4838067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.059+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f484c11e8f0 con 0x7f485415ffb0 2023-12-19T16:15:49.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.059+0000 7f48595a0640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4838065a60 0x7f4838067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.059+0000 7f48595a0640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4838065a60 0x7f4838067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4854155960 tx=0x7f4850008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.063+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f485414fdd0 con 0x7f485415ffb0 2023-12-19T16:15:49.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.211+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f485414fdd0 con 0x7f4838065a60 2023-12-19T16:15:49.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.219+0000 7f4849ffb640 1 -- 172.21.15.119:0/2289962622 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345264 (secure 0 0 0) 0x7f485414fdd0 con 0x7f4838065a60 2023-12-19T16:15:49.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4838065a60 msgr2=0x7f4838067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4838065a60 0x7f4838067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4854155960 tx=0x7f4850008040 comp rx=0 tx=0).stop 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 msgr2=0x7f4854157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 0x7f4854157dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f484c01b080 tx=0x7f484c019770 comp rx=0 tx=0).stop 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 shutdown_connections 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4838065a60 0x7f4838067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48540d1280 0x7f4854155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f485415ffb0 0x7f4854157dd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 --2- 172.21.15.119:0/2289962622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48540b13d0 0x7f4854151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 >> 172.21.15.119:0/2289962622 conn(0x7f485409b930 msgr2=0x7f485415ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 shutdown_connections 2023-12-19T16:15:49.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.223+0000 7f485a5a2640 1 -- 172.21.15.119:0/2289962622 wait complete. 2023-12-19T16:15:49.246 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-19T16:15:48.454210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588192+0000","last_change":"2023-12-19T16:15:20.196445+0000","last_active":"2023-12-19T16:15:24.588192+0000","last_peered":"2023-12-19T16:15:24.588192+0000","last_clean":"2023-12-19T16:15:24.588192+0000","last_became_active":"2023-12-19T16:15:20.196170+0000","last_became_peered":"2023-12-19T16:15:20.196170+0000","last_unstale":"2023-12-19T16:15:24.588192+0000","last_undegraded":"2023-12-19T16:15:24.588192+0000","last_fullsized":"2023-12-19T16:15:24.588192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:39.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580441+0000","last_change":"2023-12-19T16:15:20.606495+0000","last_active":"2023-12-19T16:15:24.580441+0000","last_peered":"2023-12-19T16:15:24.580441+0000","last_clean":"2023-12-19T16:15:24.580441+0000","last_became_active":"2023-12-19T16:15:20.605146+0000","last_became_peered":"2023-12-19T16:15:20.605146+0000","last_unstale":"2023-12-19T16:15:24.580441+0000","last_undegraded":"2023-12-19T16:15:24.580441+0000","last_fullsized":"2023-12-19T16:15:24.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991230+0000","last_change":"2023-12-19T16:15:24.614967+0000","last_active":"2023-12-19T16:15:24.991230+0000","last_peered":"2023-12-19T16:15:24.991230+0000","last_clean":"2023-12-19T16:15:24.991230+0000","last_became_active":"2023-12-19T16:15:24.614174+0000","last_became_peered":"2023-12-19T16:15:24.614174+0000","last_unstale":"2023-12-19T16:15:24.991230+0000","last_undegraded":"2023-12-19T16:15:24.991230+0000","last_fullsized":"2023-12-19T16:15:24.991230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580626+0000","last_change":"2023-12-19T16:15:20.202976+0000","last_active":"2023-12-19T16:15:24.580626+0000","last_peered":"2023-12-19T16:15:24.580626+0000","last_clean":"2023-12-19T16:15:24.580626+0000","last_became_active":"2023-12-19T16:15:20.202692+0000","last_became_peered":"2023-12-19T16:15:20.202692+0000","last_unstale":"2023-12-19T16:15:24.580626+0000","last_undegraded":"2023-12-19T16:15:24.580626+0000","last_fullsized":"2023-12-19T16:15:24.580626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587899+0000","last_change":"2023-12-19T16:15:20.579266+0000","last_active":"2023-12-19T16:15:24.587899+0000","last_peered":"2023-12-19T16:15:24.587899+0000","last_clean":"2023-12-19T16:15:24.587899+0000","last_became_active":"2023-12-19T16:15:20.579039+0000","last_became_peered":"2023-12-19T16:15:20.579039+0000","last_unstale":"2023-12-19T16:15:24.587899+0000","last_undegraded":"2023-12-19T16:15:24.587899+0000","last_fullsized":"2023-12-19T16:15:24.587899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987177+0000","last_change":"2023-12-19T16:15:24.618815+0000","last_active":"2023-12-19T16:15:24.987177+0000","last_peered":"2023-12-19T16:15:24.987177+0000","last_clean":"2023-12-19T16:15:24.987177+0000","last_became_active":"2023-12-19T16:15:24.618408+0000","last_became_peered":"2023-12-19T16:15:24.618408+0000","last_unstale":"2023-12-19T16:15:24.987177+0000","last_undegraded":"2023-12-19T16:15:24.987177+0000","last_fullsized":"2023-12-19T16:15:24.987177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.615964+0000","last_change":"2023-12-19T16:15:20.206941+0000","last_active":"2023-12-19T16:15:24.615964+0000","last_peered":"2023-12-19T16:15:24.615964+0000","last_clean":"2023-12-19T16:15:24.615964+0000","last_became_active":"2023-12-19T16:15:20.206623+0000","last_became_peered":"2023-12-19T16:15:20.206623+0000","last_unstale":"2023-12-19T16:15:24.615964+0000","last_undegraded":"2023-12-19T16:15:24.615964+0000","last_fullsized":"2023-12-19T16:15:24.615964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:42.922649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582028+0000","last_change":"2023-12-19T16:15:20.576757+0000","last_active":"2023-12-19T16:15:24.582028+0000","last_peered":"2023-12-19T16:15:24.582028+0000","last_clean":"2023-12-19T16:15:24.582028+0000","last_became_active":"2023-12-19T16:15:20.576280+0000","last_became_peered":"2023-12-19T16:15:20.576280+0000","last_unstale":"2023-12-19T16:15:24.582028+0000","last_undegraded":"2023-12-19T16:15:24.582028+0000","last_fullsized":"2023-12-19T16:15:24.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987587+0000","last_change":"2023-12-19T16:15:24.618996+0000","last_active":"2023-12-19T16:15:24.987587+0000","last_peered":"2023-12-19T16:15:24.987587+0000","last_clean":"2023-12-19T16:15:24.987587+0000","last_became_active":"2023-12-19T16:15:24.613588+0000","last_became_peered":"2023-12-19T16:15:24.613588+0000","last_unstale":"2023-12-19T16:15:24.987587+0000","last_undegraded":"2023-12-19T16:15:24.987587+0000","last_fullsized":"2023-12-19T16:15:24.987587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:20.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612643+0000","last_change":"2023-12-19T16:15:20.209759+0000","last_active":"2023-12-19T16:15:24.612643+0000","last_peered":"2023-12-19T16:15:24.612643+0000","last_clean":"2023-12-19T16:15:24.612643+0000","last_became_active":"2023-12-19T16:15:20.209441+0000","last_became_peered":"2023-12-19T16:15:20.209441+0000","last_unstale":"2023-12-19T16:15:24.612643+0000","last_undegraded":"2023-12-19T16:15:24.612643+0000","last_fullsized":"2023-12-19T16:15:24.612643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:45.528168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583519+0000","last_change":"2023-12-19T16:15:20.576676+0000","last_active":"2023-12-19T16:15:24.583519+0000","last_peered":"2023-12-19T16:15:24.583519+0000","last_clean":"2023-12-19T16:15:24.583519+0000","last_became_active":"2023-12-19T16:15:20.576400+0000","last_became_peered":"2023-12-19T16:15:20.576400+0000","last_unstale":"2023-12-19T16:15:24.583519+0000","last_undegraded":"2023-12-19T16:15:24.583519+0000","last_fullsized":"2023-12-19T16:15:24.583519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987579+0000","last_change":"2023-12-19T16:15:24.619492+0000","last_active":"2023-12-19T16:15:24.987579+0000","last_peered":"2023-12-19T16:15:24.987579+0000","last_clean":"2023-12-19T16:15:24.987579+0000","last_became_active":"2023-12-19T16:15:24.618455+0000","last_became_peered":"2023-12-19T16:15:24.618455+0000","last_unstale":"2023-12-19T16:15:24.987579+0000","last_undegraded":"2023-12-19T16:15:24.987579+0000","last_fullsized":"2023-12-19T16:15:24.987579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:27.195791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590403+0000","last_change":"2023-12-19T16:15:20.598403+0000","last_active":"2023-12-19T16:15:24.590403+0000","last_peered":"2023-12-19T16:15:24.590403+0000","last_clean":"2023-12-19T16:15:24.590403+0000","last_became_active":"2023-12-19T16:15:20.598090+0000","last_became_peered":"2023-12-19T16:15:20.598090+0000","last_unstale":"2023-12-19T16:15:24.590403+0000","last_undegraded":"2023-12-19T16:15:24.590403+0000","last_fullsized":"2023-12-19T16:15:24.590403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612925+0000","last_change":"2023-12-19T16:15:20.202909+0000","last_active":"2023-12-19T16:15:24.612925+0000","last_peered":"2023-12-19T16:15:24.612925+0000","last_clean":"2023-12-19T16:15:24.612925+0000","last_became_active":"2023-12-19T16:15:20.202536+0000","last_became_peered":"2023-12-19T16:15:20.202536+0000","last_unstale":"2023-12-19T16:15:24.612925+0000","last_undegraded":"2023-12-19T16:15:24.612925+0000","last_fullsized":"2023-12-19T16:15:24.612925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:37.663686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987782+0000","last_change":"2023-12-19T16:15:24.611948+0000","last_active":"2023-12-19T16:15:24.987782+0000","last_peered":"2023-12-19T16:15:24.987782+0000","last_clean":"2023-12-19T16:15:24.987782+0000","last_became_active":"2023-12-19T16:15:24.611168+0000","last_became_peered":"2023-12-19T16:15:24.611168+0000","last_unstale":"2023-12-19T16:15:24.987782+0000","last_undegraded":"2023-12-19T16:15:24.987782+0000","last_fullsized":"2023-12-19T16:15:24.987782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:58.259665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580838+0000","last_change":"2023-12-19T16:15:20.582515+0000","last_active":"2023-12-19T16:15:24.580838+0000","last_peered":"2023-12-19T16:15:24.580838+0000","last_clean":"2023-12-19T16:15:24.580838+0000","last_became_active":"2023-12-19T16:15:20.582246+0000","last_became_peered":"2023-12-19T16:15:20.582246+0000","last_unstale":"2023-12-19T16:15:24.580838+0000","last_undegraded":"2023-12-19T16:15:24.580838+0000","last_fullsized":"2023-12-19T16:15:24.580838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609028+0000","last_change":"2023-12-19T16:15:20.193662+0000","last_active":"2023-12-19T16:15:24.609028+0000","last_peered":"2023-12-19T16:15:24.609028+0000","last_clean":"2023-12-19T16:15:24.609028+0000","last_became_active":"2023-12-19T16:15:20.193345+0000","last_became_peered":"2023-12-19T16:15:20.193345+0000","last_unstale":"2023-12-19T16:15:24.609028+0000","last_undegraded":"2023-12-19T16:15:24.609028+0000","last_fullsized":"2023-12-19T16:15:24.609028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987322+0000","last_change":"2023-12-19T16:15:24.621026+0000","last_active":"2023-12-19T16:15:24.987322+0000","last_peered":"2023-12-19T16:15:24.987322+0000","last_clean":"2023-12-19T16:15:24.987322+0000","last_became_active":"2023-12-19T16:15:24.618568+0000","last_became_peered":"2023-12-19T16:15:24.618568+0000","last_unstale":"2023-12-19T16:15:24.987322+0000","last_undegraded":"2023-12-19T16:15:24.987322+0000","last_fullsized":"2023-12-19T16:15:24.987322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580610+0000","last_change":"2023-12-19T16:15:20.593268+0000","last_active":"2023-12-19T16:15:24.580610+0000","last_peered":"2023-12-19T16:15:24.580610+0000","last_clean":"2023-12-19T16:15:24.580610+0000","last_became_active":"2023-12-19T16:15:20.593033+0000","last_became_peered":"2023-12-19T16:15:20.593033+0000","last_unstale":"2023-12-19T16:15:24.580610+0000","last_undegraded":"2023-12-19T16:15:24.580610+0000","last_fullsized":"2023-12-19T16:15:24.580610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607527+0000","last_change":"2023-12-19T16:15:20.190652+0000","last_active":"2023-12-19T16:15:24.607527+0000","last_peered":"2023-12-19T16:15:24.607527+0000","last_clean":"2023-12-19T16:15:24.607527+0000","last_became_active":"2023-12-19T16:15:20.190271+0000","last_became_peered":"2023-12-19T16:15:20.190271+0000","last_unstale":"2023-12-19T16:15:24.607527+0000","last_undegraded":"2023-12-19T16:15:24.607527+0000","last_fullsized":"2023-12-19T16:15:24.607527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991773+0000","last_change":"2023-12-19T16:15:24.620676+0000","last_active":"2023-12-19T16:15:24.991773+0000","last_peered":"2023-12-19T16:15:24.991773+0000","last_clean":"2023-12-19T16:15:24.991773+0000","last_became_active":"2023-12-19T16:15:24.619756+0000","last_became_peered":"2023-12-19T16:15:24.619756+0000","last_unstale":"2023-12-19T16:15:24.991773+0000","last_undegraded":"2023-12-19T16:15:24.991773+0000","last_fullsized":"2023-12-19T16:15:24.991773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588078+0000","last_change":"2023-12-19T16:15:20.583947+0000","last_active":"2023-12-19T16:15:24.588078+0000","last_peered":"2023-12-19T16:15:24.588078+0000","last_clean":"2023-12-19T16:15:24.588078+0000","last_became_active":"2023-12-19T16:15:20.583625+0000","last_became_peered":"2023-12-19T16:15:20.583625+0000","last_unstale":"2023-12-19T16:15:24.588078+0000","last_undegraded":"2023-12-19T16:15:24.588078+0000","last_fullsized":"2023-12-19T16:15:24.588078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:00.076039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606271+0000","last_change":"2023-12-19T16:15:20.197434+0000","last_active":"2023-12-19T16:15:24.606271+0000","last_peered":"2023-12-19T16:15:24.606271+0000","last_clean":"2023-12-19T16:15:24.606271+0000","last_became_active":"2023-12-19T16:15:20.197066+0000","last_became_peered":"2023-12-19T16:15:20.197066+0000","last_unstale":"2023-12-19T16:15:24.606271+0000","last_undegraded":"2023-12-19T16:15:24.606271+0000","last_fullsized":"2023-12-19T16:15:24.606271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987228+0000","last_change":"2023-12-19T16:15:24.614999+0000","last_active":"2023-12-19T16:15:24.987228+0000","last_peered":"2023-12-19T16:15:24.987228+0000","last_clean":"2023-12-19T16:15:24.987228+0000","last_became_active":"2023-12-19T16:15:24.613975+0000","last_became_peered":"2023-12-19T16:15:24.613975+0000","last_unstale":"2023-12-19T16:15:24.987228+0000","last_undegraded":"2023-12-19T16:15:24.987228+0000","last_fullsized":"2023-12-19T16:15:24.987228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588898+0000","last_change":"2023-12-19T16:15:20.592452+0000","last_active":"2023-12-19T16:15:24.588898+0000","last_peered":"2023-12-19T16:15:24.588898+0000","last_clean":"2023-12-19T16:15:24.588898+0000","last_became_active":"2023-12-19T16:15:20.592161+0000","last_became_peered":"2023-12-19T16:15:20.592161+0000","last_unstale":"2023-12-19T16:15:24.588898+0000","last_undegraded":"2023-12-19T16:15:24.588898+0000","last_fullsized":"2023-12-19T16:15:24.588898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591886+0000","last_change":"2023-12-19T16:15:20.208862+0000","last_active":"2023-12-19T16:15:24.591886+0000","last_peered":"2023-12-19T16:15:24.591886+0000","last_clean":"2023-12-19T16:15:24.591886+0000","last_became_active":"2023-12-19T16:15:20.208590+0000","last_became_peered":"2023-12-19T16:15:20.208590+0000","last_unstale":"2023-12-19T16:15:24.591886+0000","last_undegraded":"2023-12-19T16:15:24.591886+0000","last_fullsized":"2023-12-19T16:15:24.591886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987223+0000","last_change":"2023-12-19T16:15:24.614167+0000","last_active":"2023-12-19T16:15:24.987223+0000","last_peered":"2023-12-19T16:15:24.987223+0000","last_clean":"2023-12-19T16:15:24.987223+0000","last_became_active":"2023-12-19T16:15:24.613456+0000","last_became_peered":"2023-12-19T16:15:24.613456+0000","last_unstale":"2023-12-19T16:15:24.987223+0000","last_undegraded":"2023-12-19T16:15:24.987223+0000","last_fullsized":"2023-12-19T16:15:24.987223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:45.305869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580848+0000","last_change":"2023-12-19T16:15:20.587069+0000","last_active":"2023-12-19T16:15:24.580848+0000","last_peered":"2023-12-19T16:15:24.580848+0000","last_clean":"2023-12-19T16:15:24.580848+0000","last_became_active":"2023-12-19T16:15:20.586781+0000","last_became_peered":"2023-12-19T16:15:20.586781+0000","last_unstale":"2023-12-19T16:15:24.580848+0000","last_undegraded":"2023-12-19T16:15:24.580848+0000","last_fullsized":"2023-12-19T16:15:24.580848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609772+0000","last_change":"2023-12-19T16:15:20.206431+0000","last_active":"2023-12-19T16:15:24.609772+0000","last_peered":"2023-12-19T16:15:24.609772+0000","last_clean":"2023-12-19T16:15:24.609772+0000","last_became_active":"2023-12-19T16:15:20.206208+0000","last_became_peered":"2023-12-19T16:15:20.206208+0000","last_unstale":"2023-12-19T16:15:24.609772+0000","last_undegraded":"2023-12-19T16:15:24.609772+0000","last_fullsized":"2023-12-19T16:15:24.609772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990754+0000","last_change":"2023-12-19T16:15:24.612174+0000","last_active":"2023-12-19T16:15:24.990754+0000","last_peered":"2023-12-19T16:15:24.990754+0000","last_clean":"2023-12-19T16:15:24.990754+0000","last_became_active":"2023-12-19T16:15:24.611609+0000","last_became_peered":"2023-12-19T16:15:24.611609+0000","last_unstale":"2023-12-19T16:15:24.990754+0000","last_undegraded":"2023-12-19T16:15:24.990754+0000","last_fullsized":"2023-12-19T16:15:24.990754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:54.794163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609936+0000","last_change":"2023-12-19T16:15:20.590393+0000","last_active":"2023-12-19T16:15:24.609936+0000","last_peered":"2023-12-19T16:15:24.609936+0000","last_clean":"2023-12-19T16:15:24.609936+0000","last_became_active":"2023-12-19T16:15:20.589290+0000","last_became_peered":"2023-12-19T16:15:20.589290+0000","last_unstale":"2023-12-19T16:15:24.609936+0000","last_undegraded":"2023-12-19T16:15:24.609936+0000","last_fullsized":"2023-12-19T16:15:24.609936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616161+0000","last_change":"2023-12-19T16:15:20.203475+0000","last_active":"2023-12-19T16:15:24.616161+0000","last_peered":"2023-12-19T16:15:24.616161+0000","last_clean":"2023-12-19T16:15:24.616161+0000","last_became_active":"2023-12-19T16:15:20.203209+0000","last_became_peered":"2023-12-19T16:15:20.203209+0000","last_unstale":"2023-12-19T16:15:24.616161+0000","last_undegraded":"2023-12-19T16:15:24.616161+0000","last_fullsized":"2023-12-19T16:15:24.616161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991778+0000","last_change":"2023-12-19T16:15:24.604368+0000","last_active":"2023-12-19T16:15:24.991778+0000","last_peered":"2023-12-19T16:15:24.991778+0000","last_clean":"2023-12-19T16:15:24.991778+0000","last_became_active":"2023-12-19T16:15:24.603970+0000","last_became_peered":"2023-12-19T16:15:24.603970+0000","last_unstale":"2023-12-19T16:15:24.991778+0000","last_undegraded":"2023-12-19T16:15:24.991778+0000","last_fullsized":"2023-12-19T16:15:24.991778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583544+0000","last_change":"2023-12-19T16:15:20.590364+0000","last_active":"2023-12-19T16:15:24.583544+0000","last_peered":"2023-12-19T16:15:24.583544+0000","last_clean":"2023-12-19T16:15:24.583544+0000","last_became_active":"2023-12-19T16:15:20.589975+0000","last_became_peered":"2023-12-19T16:15:20.589975+0000","last_unstale":"2023-12-19T16:15:24.583544+0000","last_undegraded":"2023-12-19T16:15:24.583544+0000","last_fullsized":"2023-12-19T16:15:24.583544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610003+0000","last_change":"2023-12-19T16:15:20.190567+0000","last_active":"2023-12-19T16:15:24.610003+0000","last_peered":"2023-12-19T16:15:24.610003+0000","last_clean":"2023-12-19T16:15:24.610003+0000","last_became_active":"2023-12-19T16:15:20.189732+0000","last_became_peered":"2023-12-19T16:15:20.189732+0000","last_unstale":"2023-12-19T16:15:24.610003+0000","last_undegraded":"2023-12-19T16:15:24.610003+0000","last_fullsized":"2023-12-19T16:15:24.610003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990745+0000","last_change":"2023-12-19T16:15:24.613205+0000","last_active":"2023-12-19T16:15:24.990745+0000","last_peered":"2023-12-19T16:15:24.990745+0000","last_clean":"2023-12-19T16:15:24.990745+0000","last_became_active":"2023-12-19T16:15:24.612609+0000","last_became_peered":"2023-12-19T16:15:24.612609+0000","last_unstale":"2023-12-19T16:15:24.990745+0000","last_undegraded":"2023-12-19T16:15:24.990745+0000","last_fullsized":"2023-12-19T16:15:24.990745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586333+0000","last_change":"2023-12-19T16:15:20.574569+0000","last_active":"2023-12-19T16:15:24.586333+0000","last_peered":"2023-12-19T16:15:24.586333+0000","last_clean":"2023-12-19T16:15:24.586333+0000","last_became_active":"2023-12-19T16:15:20.573795+0000","last_became_peered":"2023-12-19T16:15:20.573795+0000","last_unstale":"2023-12-19T16:15:24.586333+0000","last_undegraded":"2023-12-19T16:15:24.586333+0000","last_fullsized":"2023-12-19T16:15:24.586333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583390+0000","last_change":"2023-12-19T16:15:20.194527+0000","last_active":"2023-12-19T16:15:24.583390+0000","last_peered":"2023-12-19T16:15:24.583390+0000","last_clean":"2023-12-19T16:15:24.583390+0000","last_became_active":"2023-12-19T16:15:20.194212+0000","last_became_peered":"2023-12-19T16:15:20.194212+0000","last_unstale":"2023-12-19T16:15:24.583390+0000","last_undegraded":"2023-12-19T16:15:24.583390+0000","last_fullsized":"2023-12-19T16:15:24.583390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991169+0000","last_change":"2023-12-19T16:15:24.619624+0000","last_active":"2023-12-19T16:15:24.991169+0000","last_peered":"2023-12-19T16:15:24.991169+0000","last_clean":"2023-12-19T16:15:24.991169+0000","last_became_active":"2023-12-19T16:15:24.619279+0000","last_became_peered":"2023-12-19T16:15:24.619279+0000","last_unstale":"2023-12-19T16:15:24.991169+0000","last_undegraded":"2023-12-19T16:15:24.991169+0000","last_fullsized":"2023-12-19T16:15:24.991169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.604284+0000","last_change":"2023-12-19T16:15:20.588633+0000","last_active":"2023-12-19T16:15:24.604284+0000","last_peered":"2023-12-19T16:15:24.604284+0000","last_clean":"2023-12-19T16:15:24.604284+0000","last_became_active":"2023-12-19T16:15:20.585483+0000","last_became_peered":"2023-12-19T16:15:20.585483+0000","last_unstale":"2023-12-19T16:15:24.604284+0000","last_undegraded":"2023-12-19T16:15:24.604284+0000","last_fullsized":"2023-12-19T16:15:24.604284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586562+0000","last_change":"2023-12-19T16:15:20.190133+0000","last_active":"2023-12-19T16:15:24.586562+0000","last_peered":"2023-12-19T16:15:24.586562+0000","last_clean":"2023-12-19T16:15:24.586562+0000","last_became_active":"2023-12-19T16:15:20.189767+0000","last_became_peered":"2023-12-19T16:15:20.189767+0000","last_unstale":"2023-12-19T16:15:24.586562+0000","last_undegraded":"2023-12-19T16:15:24.586562+0000","last_fullsized":"2023-12-19T16:15:24.586562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991870+0000","last_change":"2023-12-19T16:15:24.620960+0000","last_active":"2023-12-19T16:15:24.991870+0000","last_peered":"2023-12-19T16:15:24.991870+0000","last_clean":"2023-12-19T16:15:24.991870+0000","last_became_active":"2023-12-19T16:15:24.620316+0000","last_became_peered":"2023-12-19T16:15:24.620316+0000","last_unstale":"2023-12-19T16:15:24.991870+0000","last_undegraded":"2023-12-19T16:15:24.991870+0000","last_fullsized":"2023-12-19T16:15:24.991870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589097+0000","last_change":"2023-12-19T16:15:20.577774+0000","last_active":"2023-12-19T16:15:24.589097+0000","last_peered":"2023-12-19T16:15:24.589097+0000","last_clean":"2023-12-19T16:15:24.589097+0000","last_became_active":"2023-12-19T16:15:20.577521+0000","last_became_peered":"2023-12-19T16:15:20.577521+0000","last_unstale":"2023-12-19T16:15:24.589097+0000","last_undegraded":"2023-12-19T16:15:24.589097+0000","last_fullsized":"2023-12-19T16:15:24.589097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606291+0000","last_change":"2023-12-19T16:15:20.201723+0000","last_active":"2023-12-19T16:15:24.606291+0000","last_peered":"2023-12-19T16:15:24.606291+0000","last_clean":"2023-12-19T16:15:24.606291+0000","last_became_active":"2023-12-19T16:15:20.201368+0000","last_became_peered":"2023-12-19T16:15:20.201368+0000","last_unstale":"2023-12-19T16:15:24.606291+0000","last_undegraded":"2023-12-19T16:15:24.606291+0000","last_fullsized":"2023-12-19T16:15:24.606291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:34:17.746223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991977+0000","last_change":"2023-12-19T16:15:24.614648+0000","last_active":"2023-12-19T16:15:24.991977+0000","last_peered":"2023-12-19T16:15:24.991977+0000","last_clean":"2023-12-19T16:15:24.991977+0000","last_became_active":"2023-12-19T16:15:24.611988+0000","last_became_peered":"2023-12-19T16:15:24.611988+0000","last_unstale":"2023-12-19T16:15:24.991977+0000","last_undegraded":"2023-12-19T16:15:24.991977+0000","last_fullsized":"2023-12-19T16:15:24.991977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:22.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579894+0000","last_change":"2023-12-19T16:15:20.591587+0000","last_active":"2023-12-19T16:15:24.579894+0000","last_peered":"2023-12-19T16:15:24.579894+0000","last_clean":"2023-12-19T16:15:24.579894+0000","last_became_active":"2023-12-19T16:15:20.589033+0000","last_became_peered":"2023-12-19T16:15:20.589033+0000","last_unstale":"2023-12-19T16:15:24.579894+0000","last_undegraded":"2023-12-19T16:15:24.579894+0000","last_fullsized":"2023-12-19T16:15:24.579894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583506+0000","last_change":"2023-12-19T16:15:20.193675+0000","last_active":"2023-12-19T16:15:24.583506+0000","last_peered":"2023-12-19T16:15:24.583506+0000","last_clean":"2023-12-19T16:15:24.583506+0000","last_became_active":"2023-12-19T16:15:20.189433+0000","last_became_peered":"2023-12-19T16:15:20.189433+0000","last_unstale":"2023-12-19T16:15:24.583506+0000","last_undegraded":"2023-12-19T16:15:24.583506+0000","last_fullsized":"2023-12-19T16:15:24.583506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:19.743984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606398+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:15:24.606398+0000","last_peered":"2023-12-19T16:15:24.606398+0000","last_clean":"2023-12-19T16:15:24.606398+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:15:24.606398+0000","last_undegraded":"2023-12-19T16:15:24.606398+0000","last_fullsized":"2023-12-19T16:15:24.606398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992081+0000","last_change":"2023-12-19T16:15:24.621441+0000","last_active":"2023-12-19T16:15:24.992081+0000","last_peered":"2023-12-19T16:15:24.992081+0000","last_clean":"2023-12-19T16:15:24.992081+0000","last_became_active":"2023-12-19T16:15:24.619272+0000","last_became_peered":"2023-12-19T16:15:24.619272+0000","last_unstale":"2023-12-19T16:15:24.992081+0000","last_undegraded":"2023-12-19T16:15:24.992081+0000","last_fullsized":"2023-12-19T16:15:24.992081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:04.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.614464+0000","last_change":"2023-12-19T16:15:20.608106+0000","last_active":"2023-12-19T16:15:24.614464+0000","last_peered":"2023-12-19T16:15:24.614464+0000","last_clean":"2023-12-19T16:15:24.614464+0000","last_became_active":"2023-12-19T16:15:20.607827+0000","last_became_peered":"2023-12-19T16:15:20.607827+0000","last_unstale":"2023-12-19T16:15:24.614464+0000","last_undegraded":"2023-12-19T16:15:24.614464+0000","last_fullsized":"2023-12-19T16:15:24.614464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:56.432350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586822+0000","last_change":"2023-12-19T16:15:20.188280+0000","last_active":"2023-12-19T16:15:24.586822+0000","last_peered":"2023-12-19T16:15:24.586822+0000","last_clean":"2023-12-19T16:15:24.586822+0000","last_became_active":"2023-12-19T16:15:20.187947+0000","last_became_peered":"2023-12-19T16:15:20.187947+0000","last_unstale":"2023-12-19T16:15:24.586822+0000","last_undegraded":"2023-12-19T16:15:24.586822+0000","last_fullsized":"2023-12-19T16:15:24.586822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991784+0000","last_change":"2023-12-19T16:15:24.611679+0000","last_active":"2023-12-19T16:15:24.991784+0000","last_peered":"2023-12-19T16:15:24.991784+0000","last_clean":"2023-12-19T16:15:24.991784+0000","last_became_active":"2023-12-19T16:15:24.610986+0000","last_became_peered":"2023-12-19T16:15:24.610986+0000","last_unstale":"2023-12-19T16:15:24.991784+0000","last_undegraded":"2023-12-19T16:15:24.991784+0000","last_fullsized":"2023-12-19T16:15:24.991784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:44:11.191541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582165+0000","last_change":"2023-12-19T16:15:20.595169+0000","last_active":"2023-12-19T16:15:24.582165+0000","last_peered":"2023-12-19T16:15:24.582165+0000","last_clean":"2023-12-19T16:15:24.582165+0000","last_became_active":"2023-12-19T16:15:20.594861+0000","last_became_peered":"2023-12-19T16:15:20.594861+0000","last_unstale":"2023-12-19T16:15:24.582165+0000","last_undegraded":"2023-12-19T16:15:24.582165+0000","last_fullsized":"2023-12-19T16:15:24.582165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:30.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610122+0000","last_change":"2023-12-19T16:15:20.189994+0000","last_active":"2023-12-19T16:15:24.610122+0000","last_peered":"2023-12-19T16:15:24.610122+0000","last_clean":"2023-12-19T16:15:24.610122+0000","last_became_active":"2023-12-19T16:15:20.188076+0000","last_became_peered":"2023-12-19T16:15:20.188076+0000","last_unstale":"2023-12-19T16:15:24.610122+0000","last_undegraded":"2023-12-19T16:15:24.610122+0000","last_fullsized":"2023-12-19T16:15:24.610122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991932+0000","last_change":"2023-12-19T16:15:24.602286+0000","last_active":"2023-12-19T16:15:24.991932+0000","last_peered":"2023-12-19T16:15:24.991932+0000","last_clean":"2023-12-19T16:15:24.991932+0000","last_became_active":"2023-12-19T16:15:24.601875+0000","last_became_peered":"2023-12-19T16:15:24.601875+0000","last_unstale":"2023-12-19T16:15:24.991932+0000","last_undegraded":"2023-12-19T16:15:24.991932+0000","last_fullsized":"2023-12-19T16:15:24.991932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:24.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616423+0000","last_change":"2023-12-19T16:15:20.605190+0000","last_active":"2023-12-19T16:15:24.616423+0000","last_peered":"2023-12-19T16:15:24.616423+0000","last_clean":"2023-12-19T16:15:24.616423+0000","last_became_active":"2023-12-19T16:15:20.605031+0000","last_became_peered":"2023-12-19T16:15:20.605031+0000","last_unstale":"2023-12-19T16:15:24.616423+0000","last_undegraded":"2023-12-19T16:15:24.616423+0000","last_fullsized":"2023-12-19T16:15:24.616423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586417+0000","last_change":"2023-12-19T16:15:20.188422+0000","last_active":"2023-12-19T16:15:24.586417+0000","last_peered":"2023-12-19T16:15:24.586417+0000","last_clean":"2023-12-19T16:15:24.586417+0000","last_became_active":"2023-12-19T16:15:20.188093+0000","last_became_peered":"2023-12-19T16:15:20.188093+0000","last_unstale":"2023-12-19T16:15:24.586417+0000","last_undegraded":"2023-12-19T16:15:24.586417+0000","last_fullsized":"2023-12-19T16:15:24.586417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987050+0000","last_change":"2023-12-19T16:15:24.601682+0000","last_active":"2023-12-19T16:15:24.987050+0000","last_peered":"2023-12-19T16:15:24.987050+0000","last_clean":"2023-12-19T16:15:24.987050+0000","last_became_active":"2023-12-19T16:15:24.601267+0000","last_became_peered":"2023-12-19T16:15:24.601267+0000","last_unstale":"2023-12-19T16:15:24.987050+0000","last_undegraded":"2023-12-19T16:15:24.987050+0000","last_fullsized":"2023-12-19T16:15:24.987050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:32.531986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616152+0000","last_change":"2023-12-19T16:15:20.601877+0000","last_active":"2023-12-19T16:15:24.616152+0000","last_peered":"2023-12-19T16:15:24.616152+0000","last_clean":"2023-12-19T16:15:24.616152+0000","last_became_active":"2023-12-19T16:15:20.601574+0000","last_became_peered":"2023-12-19T16:15:20.601574+0000","last_unstale":"2023-12-19T16:15:24.616152+0000","last_undegraded":"2023-12-19T16:15:24.616152+0000","last_fullsized":"2023-12-19T16:15:24.616152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586605+0000","last_change":"2023-12-19T16:15:20.203704+0000","last_active":"2023-12-19T16:15:24.586605+0000","last_peered":"2023-12-19T16:15:24.586605+0000","last_clean":"2023-12-19T16:15:24.586605+0000","last_became_active":"2023-12-19T16:15:20.203355+0000","last_became_peered":"2023-12-19T16:15:20.203355+0000","last_unstale":"2023-12-19T16:15:24.586605+0000","last_undegraded":"2023-12-19T16:15:24.586605+0000","last_fullsized":"2023-12-19T16:15:24.586605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987820+0000","last_change":"2023-12-19T16:15:24.624496+0000","last_active":"2023-12-19T16:15:24.987820+0000","last_peered":"2023-12-19T16:15:24.987820+0000","last_clean":"2023-12-19T16:15:24.987820+0000","last_became_active":"2023-12-19T16:15:24.620007+0000","last_became_peered":"2023-12-19T16:15:24.620007+0000","last_unstale":"2023-12-19T16:15:24.987820+0000","last_undegraded":"2023-12-19T16:15:24.987820+0000","last_fullsized":"2023-12-19T16:15:24.987820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:39.456525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611918+0000","last_change":"2023-12-19T16:15:20.592930+0000","last_active":"2023-12-19T16:15:24.611918+0000","last_peered":"2023-12-19T16:15:24.611918+0000","last_clean":"2023-12-19T16:15:24.611918+0000","last_became_active":"2023-12-19T16:15:20.592602+0000","last_became_peered":"2023-12-19T16:15:20.592602+0000","last_unstale":"2023-12-19T16:15:24.611918+0000","last_undegraded":"2023-12-19T16:15:24.611918+0000","last_fullsized":"2023-12-19T16:15:24.611918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586537+0000","last_change":"2023-12-19T16:15:20.193145+0000","last_active":"2023-12-19T16:15:24.586537+0000","last_peered":"2023-12-19T16:15:24.586537+0000","last_clean":"2023-12-19T16:15:24.586537+0000","last_became_active":"2023-12-19T16:15:20.192849+0000","last_became_peered":"2023-12-19T16:15:20.192849+0000","last_unstale":"2023-12-19T16:15:24.586537+0000","last_undegraded":"2023-12-19T16:15:24.586537+0000","last_fullsized":"2023-12-19T16:15:24.586537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:21:07.081724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990894+0000","last_change":"2023-12-19T16:15:24.617964+0000","last_active":"2023-12-19T16:15:24.990894+0000","last_peered":"2023-12-19T16:15:24.990894+0000","last_clean":"2023-12-19T16:15:24.990894+0000","last_became_active":"2023-12-19T16:15:24.617522+0000","last_became_peered":"2023-12-19T16:15:24.617522+0000","last_unstale":"2023-12-19T16:15:24.990894+0000","last_undegraded":"2023-12-19T16:15:24.990894+0000","last_fullsized":"2023-12-19T16:15:24.990894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589828+0000","last_change":"2023-12-19T16:15:20.610470+0000","last_active":"2023-12-19T16:15:24.589828+0000","last_peered":"2023-12-19T16:15:24.589828+0000","last_clean":"2023-12-19T16:15:24.589828+0000","last_became_active":"2023-12-19T16:15:20.610140+0000","last_became_peered":"2023-12-19T16:15:20.610140+0000","last_unstale":"2023-12-19T16:15:24.589828+0000","last_undegraded":"2023-12-19T16:15:24.589828+0000","last_fullsized":"2023-12-19T16:15:24.589828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590885+0000","last_change":"2023-12-19T16:15:20.193278+0000","last_active":"2023-12-19T16:15:24.590885+0000","last_peered":"2023-12-19T16:15:24.590885+0000","last_clean":"2023-12-19T16:15:24.590885+0000","last_became_active":"2023-12-19T16:15:20.189782+0000","last_became_peered":"2023-12-19T16:15:20.189782+0000","last_unstale":"2023-12-19T16:15:24.590885+0000","last_undegraded":"2023-12-19T16:15:24.590885+0000","last_fullsized":"2023-12-19T16:15:24.590885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:08.507432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.993027+0000","last_change":"2023-12-19T16:15:24.609889+0000","last_active":"2023-12-19T16:15:24.993027+0000","last_peered":"2023-12-19T16:15:24.993027+0000","last_clean":"2023-12-19T16:15:24.993027+0000","last_became_active":"2023-12-19T16:15:24.609251+0000","last_became_peered":"2023-12-19T16:15:24.609251+0000","last_unstale":"2023-12-19T16:15:24.993027+0000","last_undegraded":"2023-12-19T16:15:24.993027+0000","last_fullsized":"2023-12-19T16:15:24.993027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:02.692965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612765+0000","last_change":"2023-12-19T16:15:20.600917+0000","last_active":"2023-12-19T16:15:24.612765+0000","last_peered":"2023-12-19T16:15:24.612765+0000","last_clean":"2023-12-19T16:15:24.612765+0000","last_became_active":"2023-12-19T16:15:20.600561+0000","last_became_peered":"2023-12-19T16:15:20.600561+0000","last_unstale":"2023-12-19T16:15:24.612765+0000","last_undegraded":"2023-12-19T16:15:24.612765+0000","last_fullsized":"2023-12-19T16:15:24.612765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583304+0000","last_change":"2023-12-19T16:15:20.201508+0000","last_active":"2023-12-19T16:15:24.583304+0000","last_peered":"2023-12-19T16:15:24.583304+0000","last_clean":"2023-12-19T16:15:24.583304+0000","last_became_active":"2023-12-19T16:15:20.201097+0000","last_became_peered":"2023-12-19T16:15:20.201097+0000","last_unstale":"2023-12-19T16:15:24.583304+0000","last_undegraded":"2023-12-19T16:15:24.583304+0000","last_fullsized":"2023-12-19T16:15:24.583304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992254+0000","last_change":"2023-12-19T16:15:24.608002+0000","last_active":"2023-12-19T16:15:24.992254+0000","last_peered":"2023-12-19T16:15:24.992254+0000","last_clean":"2023-12-19T16:15:24.992254+0000","last_became_active":"2023-12-19T16:15:24.606747+0000","last_became_peered":"2023-12-19T16:15:24.606747+0000","last_unstale":"2023-12-19T16:15:24.992254+0000","last_undegraded":"2023-12-19T16:15:24.992254+0000","last_fullsized":"2023-12-19T16:15:24.992254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:18.036976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588578+0000","last_change":"2023-12-19T16:15:20.587572+0000","last_active":"2023-12-19T16:15:24.588578+0000","last_peered":"2023-12-19T16:15:24.588578+0000","last_clean":"2023-12-19T16:15:24.588578+0000","last_became_active":"2023-12-19T16:15:20.581946+0000","last_became_peered":"2023-12-19T16:15:20.581946+0000","last_unstale":"2023-12-19T16:15:24.588578+0000","last_undegraded":"2023-12-19T16:15:24.588578+0000","last_fullsized":"2023-12-19T16:15:24.588578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589554+0000","last_change":"2023-12-19T16:15:20.195315+0000","last_active":"2023-12-19T16:15:24.589554+0000","last_peered":"2023-12-19T16:15:24.589554+0000","last_clean":"2023-12-19T16:15:24.589554+0000","last_became_active":"2023-12-19T16:15:20.194795+0000","last_became_peered":"2023-12-19T16:15:20.194795+0000","last_unstale":"2023-12-19T16:15:24.589554+0000","last_undegraded":"2023-12-19T16:15:24.589554+0000","last_fullsized":"2023-12-19T16:15:24.589554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:27.524480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.989014+0000","last_change":"2023-12-19T16:15:24.620913+0000","last_active":"2023-12-19T16:15:24.989014+0000","last_peered":"2023-12-19T16:15:24.989014+0000","last_clean":"2023-12-19T16:15:24.989014+0000","last_became_active":"2023-12-19T16:15:24.620490+0000","last_became_peered":"2023-12-19T16:15:24.620490+0000","last_unstale":"2023-12-19T16:15:24.989014+0000","last_undegraded":"2023-12-19T16:15:24.989014+0000","last_fullsized":"2023-12-19T16:15:24.989014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.613716+0000","last_change":"2023-12-19T16:15:20.607538+0000","last_active":"2023-12-19T16:15:24.613716+0000","last_peered":"2023-12-19T16:15:24.613716+0000","last_clean":"2023-12-19T16:15:24.613716+0000","last_became_active":"2023-12-19T16:15:20.607181+0000","last_became_peered":"2023-12-19T16:15:20.607181+0000","last_unstale":"2023-12-19T16:15:24.613716+0000","last_undegraded":"2023-12-19T16:15:24.613716+0000","last_fullsized":"2023-12-19T16:15:24.613716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:30.750566+0000","last_change":"2023-12-19T16:15:20.199632+0000","last_active":"2023-12-19T16:15:30.750566+0000","last_peered":"2023-12-19T16:15:30.750566+0000","last_clean":"2023-12-19T16:15:30.750566+0000","last_became_active":"2023-12-19T16:15:20.198790+0000","last_became_peered":"2023-12-19T16:15:20.198790+0000","last_unstale":"2023-12-19T16:15:30.750566+0000","last_undegraded":"2023-12-19T16:15:30.750566+0000","last_fullsized":"2023-12-19T16:15:30.750566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990866+0000","last_change":"2023-12-19T16:15:24.608145+0000","last_active":"2023-12-19T16:15:24.990866+0000","last_peered":"2023-12-19T16:15:24.990866+0000","last_clean":"2023-12-19T16:15:24.990866+0000","last_became_active":"2023-12-19T16:15:24.607175+0000","last_became_peered":"2023-12-19T16:15:24.607175+0000","last_unstale":"2023-12-19T16:15:24.990866+0000","last_undegraded":"2023-12-19T16:15:24.990866+0000","last_fullsized":"2023-12-19T16:15:24.990866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589930+0000","last_change":"2023-12-19T16:15:20.579667+0000","last_active":"2023-12-19T16:15:24.589930+0000","last_peered":"2023-12-19T16:15:24.589930+0000","last_clean":"2023-12-19T16:15:24.589930+0000","last_became_active":"2023-12-19T16:15:20.578820+0000","last_became_peered":"2023-12-19T16:15:20.578820+0000","last_unstale":"2023-12-19T16:15:24.589930+0000","last_undegraded":"2023-12-19T16:15:24.589930+0000","last_fullsized":"2023-12-19T16:15:24.589930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:20.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.610063+0000","last_change":"2023-12-19T16:15:20.202464+0000","last_active":"2023-12-19T16:15:24.610063+0000","last_peered":"2023-12-19T16:15:24.610063+0000","last_clean":"2023-12-19T16:15:24.610063+0000","last_became_active":"2023-12-19T16:15:20.202201+0000","last_became_peered":"2023-12-19T16:15:20.202201+0000","last_unstale":"2023-12-19T16:15:24.610063+0000","last_undegraded":"2023-12-19T16:15:24.610063+0000","last_fullsized":"2023-12-19T16:15:24.610063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:54.682365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.987742+0000","last_change":"2023-12-19T16:15:24.606235+0000","last_active":"2023-12-19T16:15:24.987742+0000","last_peered":"2023-12-19T16:15:24.987742+0000","last_clean":"2023-12-19T16:15:24.987742+0000","last_became_active":"2023-12-19T16:15:24.605689+0000","last_became_peered":"2023-12-19T16:15:24.605689+0000","last_unstale":"2023-12-19T16:15:24.987742+0000","last_undegraded":"2023-12-19T16:15:24.987742+0000","last_fullsized":"2023-12-19T16:15:24.987742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:28.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588108+0000","last_change":"2023-12-19T16:15:20.579264+0000","last_active":"2023-12-19T16:15:24.588108+0000","last_peered":"2023-12-19T16:15:24.588108+0000","last_clean":"2023-12-19T16:15:24.588108+0000","last_became_active":"2023-12-19T16:15:20.578990+0000","last_became_peered":"2023-12-19T16:15:20.578990+0000","last_unstale":"2023-12-19T16:15:24.588108+0000","last_undegraded":"2023-12-19T16:15:24.588108+0000","last_fullsized":"2023-12-19T16:15:24.588108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583852+0000","last_change":"2023-12-19T16:15:20.199283+0000","last_active":"2023-12-19T16:15:24.583852+0000","last_peered":"2023-12-19T16:15:24.583852+0000","last_clean":"2023-12-19T16:15:24.583852+0000","last_became_active":"2023-12-19T16:15:20.199018+0000","last_became_peered":"2023-12-19T16:15:20.199018+0000","last_unstale":"2023-12-19T16:15:24.583852+0000","last_undegraded":"2023-12-19T16:15:24.583852+0000","last_fullsized":"2023-12-19T16:15:24.583852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990899+0000","last_change":"2023-12-19T16:15:24.606050+0000","last_active":"2023-12-19T16:15:24.990899+0000","last_peered":"2023-12-19T16:15:24.990899+0000","last_clean":"2023-12-19T16:15:24.990899+0000","last_became_active":"2023-12-19T16:15:24.605031+0000","last_became_peered":"2023-12-19T16:15:24.605031+0000","last_unstale":"2023-12-19T16:15:24.990899+0000","last_undegraded":"2023-12-19T16:15:24.990899+0000","last_fullsized":"2023-12-19T16:15:24.990899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:21:43.598139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583755+0000","last_change":"2023-12-19T16:15:20.587105+0000","last_active":"2023-12-19T16:15:24.583755+0000","last_peered":"2023-12-19T16:15:24.583755+0000","last_clean":"2023-12-19T16:15:24.583755+0000","last_became_active":"2023-12-19T16:15:20.586267+0000","last_became_peered":"2023-12-19T16:15:20.586267+0000","last_unstale":"2023-12-19T16:15:24.583755+0000","last_undegraded":"2023-12-19T16:15:24.583755+0000","last_fullsized":"2023-12-19T16:15:24.583755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:08:48.469689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591781+0000","last_change":"2023-12-19T16:15:20.205716+0000","last_active":"2023-12-19T16:15:24.591781+0000","last_peered":"2023-12-19T16:15:24.591781+0000","last_clean":"2023-12-19T16:15:24.591781+0000","last_became_active":"2023-12-19T16:15:20.205375+0000","last_became_peered":"2023-12-19T16:15:20.205375+0000","last_unstale":"2023-12-19T16:15:24.591781+0000","last_undegraded":"2023-12-19T16:15:24.591781+0000","last_fullsized":"2023-12-19T16:15:24.591781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.991323+0000","last_change":"2023-12-19T16:15:24.614651+0000","last_active":"2023-12-19T16:15:24.991323+0000","last_peered":"2023-12-19T16:15:24.991323+0000","last_clean":"2023-12-19T16:15:24.991323+0000","last_became_active":"2023-12-19T16:15:24.613651+0000","last_became_peered":"2023-12-19T16:15:24.613651+0000","last_unstale":"2023-12-19T16:15:24.991323+0000","last_undegraded":"2023-12-19T16:15:24.991323+0000","last_fullsized":"2023-12-19T16:15:24.991323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:01.000816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.990804+0000","last_change":"2023-12-19T16:15:24.617457+0000","last_active":"2023-12-19T16:15:24.990804+0000","last_peered":"2023-12-19T16:15:24.990804+0000","last_clean":"2023-12-19T16:15:24.990804+0000","last_became_active":"2023-12-19T16:15:24.617082+0000","last_became_peered":"2023-12-19T16:15:24.617082+0000","last_unstale":"2023-12-19T16:15:24.990804+0000","last_undegraded":"2023-12-19T16:15:24.990804+0000","last_fullsized":"2023-12-19T16:15:24.990804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:45.617399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.606089+0000","last_change":"2023-12-19T16:15:20.596047+0000","last_active":"2023-12-19T16:15:24.606089+0000","last_peered":"2023-12-19T16:15:24.606089+0000","last_clean":"2023-12-19T16:15:24.606089+0000","last_became_active":"2023-12-19T16:15:20.595801+0000","last_became_peered":"2023-12-19T16:15:20.595801+0000","last_unstale":"2023-12-19T16:15:24.606089+0000","last_undegraded":"2023-12-19T16:15:24.606089+0000","last_fullsized":"2023-12-19T16:15:24.606089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582938+0000","last_change":"2023-12-19T16:15:20.198366+0000","last_active":"2023-12-19T16:15:24.582938+0000","last_peered":"2023-12-19T16:15:24.582938+0000","last_clean":"2023-12-19T16:15:24.582938+0000","last_became_active":"2023-12-19T16:15:20.198123+0000","last_became_peered":"2023-12-19T16:15:20.198123+0000","last_unstale":"2023-12-19T16:15:24.582938+0000","last_undegraded":"2023-12-19T16:15:24.582938+0000","last_fullsized":"2023-12-19T16:15:24.582938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:59.069513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992336+0000","last_change":"2023-12-19T16:15:24.613114+0000","last_active":"2023-12-19T16:15:24.992336+0000","last_peered":"2023-12-19T16:15:24.992336+0000","last_clean":"2023-12-19T16:15:24.992336+0000","last_became_active":"2023-12-19T16:15:24.612703+0000","last_became_peered":"2023-12-19T16:15:24.612703+0000","last_unstale":"2023-12-19T16:15:24.992336+0000","last_undegraded":"2023-12-19T16:15:24.992336+0000","last_fullsized":"2023-12-19T16:15:24.992336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:39.753120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580525+0000","last_change":"2023-12-19T16:15:20.578523+0000","last_active":"2023-12-19T16:15:24.580525+0000","last_peered":"2023-12-19T16:15:24.580525+0000","last_clean":"2023-12-19T16:15:24.580525+0000","last_became_active":"2023-12-19T16:15:20.578185+0000","last_became_peered":"2023-12-19T16:15:20.578185+0000","last_unstale":"2023-12-19T16:15:24.580525+0000","last_undegraded":"2023-12-19T16:15:24.580525+0000","last_fullsized":"2023-12-19T16:15:24.580525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.931830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582035+0000","last_change":"2023-12-19T16:15:20.197343+0000","last_active":"2023-12-19T16:15:24.582035+0000","last_peered":"2023-12-19T16:15:24.582035+0000","last_clean":"2023-12-19T16:15:24.582035+0000","last_became_active":"2023-12-19T16:15:20.196946+0000","last_became_peered":"2023-12-19T16:15:20.196946+0000","last_unstale":"2023-12-19T16:15:24.582035+0000","last_undegraded":"2023-12-19T16:15:24.582035+0000","last_fullsized":"2023-12-19T16:15:24.582035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:12:51.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.590498+0000","last_change":"2023-12-19T16:15:20.196588+0000","last_active":"2023-12-19T16:15:24.590498+0000","last_peered":"2023-12-19T16:15:24.590498+0000","last_clean":"2023-12-19T16:15:24.590498+0000","last_became_active":"2023-12-19T16:15:20.196249+0000","last_became_peered":"2023-12-19T16:15:20.196249+0000","last_unstale":"2023-12-19T16:15:24.590498+0000","last_undegraded":"2023-12-19T16:15:24.590498+0000","last_fullsized":"2023-12-19T16:15:24.590498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:53.709522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589480+0000","last_change":"2023-12-19T16:15:20.578312+0000","last_active":"2023-12-19T16:15:24.589480+0000","last_peered":"2023-12-19T16:15:24.589480+0000","last_clean":"2023-12-19T16:15:24.589480+0000","last_became_active":"2023-12-19T16:15:20.578056+0000","last_became_peered":"2023-12-19T16:15:20.578056+0000","last_unstale":"2023-12-19T16:15:24.589480+0000","last_undegraded":"2023-12-19T16:15:24.589480+0000","last_fullsized":"2023-12-19T16:15:24.589480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:41.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.985598+0000","last_change":"2023-12-19T16:15:24.614365+0000","last_active":"2023-12-19T16:15:24.985598+0000","last_peered":"2023-12-19T16:15:24.985598+0000","last_clean":"2023-12-19T16:15:24.985598+0000","last_became_active":"2023-12-19T16:15:24.613978+0000","last_became_peered":"2023-12-19T16:15:24.613978+0000","last_unstale":"2023-12-19T16:15:24.985598+0000","last_undegraded":"2023-12-19T16:15:24.985598+0000","last_fullsized":"2023-12-19T16:15:24.985598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:33.085597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580327+0000","last_change":"2023-12-19T16:15:20.191767+0000","last_active":"2023-12-19T16:15:24.580327+0000","last_peered":"2023-12-19T16:15:24.580327+0000","last_clean":"2023-12-19T16:15:24.580327+0000","last_became_active":"2023-12-19T16:15:20.191391+0000","last_became_peered":"2023-12-19T16:15:20.191391+0000","last_unstale":"2023-12-19T16:15:24.580327+0000","last_undegraded":"2023-12-19T16:15:24.580327+0000","last_fullsized":"2023-12-19T16:15:24.580327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:19.157120+0000","last_clean_scrub_stamp":"2023-12-19T16:15:19.157120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:03.918215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.587620+0000","last_change":"2023-12-19T16:15:20.593654+0000","last_active":"2023-12-19T16:15:24.587620+0000","last_peered":"2023-12-19T16:15:24.587620+0000","last_clean":"2023-12-19T16:15:24.587620+0000","last_became_active":"2023-12-19T16:15:20.593384+0000","last_became_peered":"2023-12-19T16:15:20.593384+0000","last_unstale":"2023-12-19T16:15:24.587620+0000","last_undegraded":"2023-12-19T16:15:24.587620+0000","last_fullsized":"2023-12-19T16:15:24.587620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:31:55.688891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.992753+0000","last_change":"2023-12-19T16:15:24.608692+0000","last_active":"2023-12-19T16:15:24.992753+0000","last_peered":"2023-12-19T16:15:24.992753+0000","last_clean":"2023-12-19T16:15:24.992753+0000","last_became_active":"2023-12-19T16:15:24.608307+0000","last_became_peered":"2023-12-19T16:15:24.608307+0000","last_unstale":"2023-12-19T16:15:24.992753+0000","last_undegraded":"2023-12-19T16:15:24.992753+0000","last_fullsized":"2023-12-19T16:15:24.992753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:23.572004+0000","last_clean_scrub_stamp":"2023-12-19T16:15:23.572004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:21:37.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589734+0000","last_change":"2023-12-19T16:15:20.608095+0000","last_active":"2023-12-19T16:15:24.589734+0000","last_peered":"2023-12-19T16:15:24.589734+0000","last_clean":"2023-12-19T16:15:24.589734+0000","last_became_active":"2023-12-19T16:15:20.604431+0000","last_became_peered":"2023-12-19T16:15:20.604431+0000","last_unstale":"2023-12-19T16:15:24.589734+0000","last_undegraded":"2023-12-19T16:15:24.589734+0000","last_fullsized":"2023-12-19T16:15:24.589734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586488+0000","last_change":"2023-12-19T16:15:20.587765+0000","last_active":"2023-12-19T16:15:24.586488+0000","last_peered":"2023-12-19T16:15:24.586488+0000","last_clean":"2023-12-19T16:15:24.586488+0000","last_became_active":"2023-12-19T16:15:20.587480+0000","last_became_peered":"2023-12-19T16:15:20.587480+0000","last_unstale":"2023-12-19T16:15:24.586488+0000","last_undegraded":"2023-12-19T16:15:24.586488+0000","last_fullsized":"2023-12-19T16:15:24.586488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:01:38.670212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583224+0000","last_change":"2023-12-19T16:15:20.590224+0000","last_active":"2023-12-19T16:15:24.583224+0000","last_peered":"2023-12-19T16:15:24.583224+0000","last_clean":"2023-12-19T16:15:24.583224+0000","last_became_active":"2023-12-19T16:15:20.589817+0000","last_became_peered":"2023-12-19T16:15:20.589817+0000","last_unstale":"2023-12-19T16:15:24.583224+0000","last_undegraded":"2023-12-19T16:15:24.583224+0000","last_fullsized":"2023-12-19T16:15:24.583224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:56.920854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589415+0000","last_change":"2023-12-19T16:15:20.584816+0000","last_active":"2023-12-19T16:15:24.589415+0000","last_peered":"2023-12-19T16:15:24.589415+0000","last_clean":"2023-12-19T16:15:24.589415+0000","last_became_active":"2023-12-19T16:15:20.584532+0000","last_became_peered":"2023-12-19T16:15:20.584532+0000","last_unstale":"2023-12-19T16:15:24.589415+0000","last_undegraded":"2023-12-19T16:15:24.589415+0000","last_fullsized":"2023-12-19T16:15:24.589415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580387+0000","last_change":"2023-12-19T16:15:20.583294+0000","last_active":"2023-12-19T16:15:24.580387+0000","last_peered":"2023-12-19T16:15:24.580387+0000","last_clean":"2023-12-19T16:15:24.580387+0000","last_became_active":"2023-12-19T16:15:20.583080+0000","last_became_peered":"2023-12-19T16:15:20.583080+0000","last_unstale":"2023-12-19T16:15:24.580387+0000","last_undegraded":"2023-12-19T16:15:24.580387+0000","last_fullsized":"2023-12-19T16:15:24.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609991+0000","last_change":"2023-12-19T16:15:20.604537+0000","last_active":"2023-12-19T16:15:24.609991+0000","last_peered":"2023-12-19T16:15:24.609991+0000","last_clean":"2023-12-19T16:15:24.609991+0000","last_became_active":"2023-12-19T16:15:20.604292+0000","last_became_peered":"2023-12-19T16:15:20.604292+0000","last_unstale":"2023-12-19T16:15:24.609991+0000","last_undegraded":"2023-12-19T16:15:24.609991+0000","last_fullsized":"2023-12-19T16:15:24.609991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:17.574612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592846+0000","last_change":"2023-12-19T16:15:20.586983+0000","last_active":"2023-12-19T16:15:24.592846+0000","last_peered":"2023-12-19T16:15:24.592846+0000","last_clean":"2023-12-19T16:15:24.592846+0000","last_became_active":"2023-12-19T16:15:20.586747+0000","last_became_peered":"2023-12-19T16:15:20.586747+0000","last_unstale":"2023-12-19T16:15:24.592846+0000","last_undegraded":"2023-12-19T16:15:24.592846+0000","last_fullsized":"2023-12-19T16:15:24.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580756+0000","last_change":"2023-12-19T16:15:20.600781+0000","last_active":"2023-12-19T16:15:24.580756+0000","last_peered":"2023-12-19T16:15:24.580756+0000","last_clean":"2023-12-19T16:15:24.580756+0000","last_became_active":"2023-12-19T16:15:20.600499+0000","last_became_peered":"2023-12-19T16:15:20.600499+0000","last_unstale":"2023-12-19T16:15:24.580756+0000","last_undegraded":"2023-12-19T16:15:24.580756+0000","last_fullsized":"2023-12-19T16:15:24.580756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:07.389763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582940+0000","last_change":"2023-12-19T16:15:20.590492+0000","last_active":"2023-12-19T16:15:24.582940+0000","last_peered":"2023-12-19T16:15:24.582940+0000","last_clean":"2023-12-19T16:15:24.582940+0000","last_became_active":"2023-12-19T16:15:20.590230+0000","last_became_peered":"2023-12-19T16:15:20.590230+0000","last_unstale":"2023-12-19T16:15:24.582940+0000","last_undegraded":"2023-12-19T16:15:24.582940+0000","last_fullsized":"2023-12-19T16:15:24.582940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581284+0000","last_change":"2023-12-19T16:15:20.582285+0000","last_active":"2023-12-19T16:15:24.581284+0000","last_peered":"2023-12-19T16:15:24.581284+0000","last_clean":"2023-12-19T16:15:24.581284+0000","last_became_active":"2023-12-19T16:15:20.581886+0000","last_became_peered":"2023-12-19T16:15:20.581886+0000","last_unstale":"2023-12-19T16:15:24.581284+0000","last_undegraded":"2023-12-19T16:15:24.581284+0000","last_fullsized":"2023-12-19T16:15:24.581284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583151+0000","last_change":"2023-12-19T16:15:20.580662+0000","last_active":"2023-12-19T16:15:24.583151+0000","last_peered":"2023-12-19T16:15:24.583151+0000","last_clean":"2023-12-19T16:15:24.583151+0000","last_became_active":"2023-12-19T16:15:20.580373+0000","last_became_peered":"2023-12-19T16:15:20.580373+0000","last_unstale":"2023-12-19T16:15:24.583151+0000","last_undegraded":"2023-12-19T16:15:24.583151+0000","last_fullsized":"2023-12-19T16:15:24.583151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589332+0000","last_change":"2023-12-19T16:15:20.583886+0000","last_active":"2023-12-19T16:15:24.589332+0000","last_peered":"2023-12-19T16:15:24.589332+0000","last_clean":"2023-12-19T16:15:24.589332+0000","last_became_active":"2023-12-19T16:15:20.583709+0000","last_became_peered":"2023-12-19T16:15:20.583709+0000","last_unstale":"2023-12-19T16:15:24.589332+0000","last_undegraded":"2023-12-19T16:15:24.589332+0000","last_fullsized":"2023-12-19T16:15:24.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.591040+0000","last_change":"2023-12-19T16:15:20.611237+0000","last_active":"2023-12-19T16:15:24.591040+0000","last_peered":"2023-12-19T16:15:24.591040+0000","last_clean":"2023-12-19T16:15:24.591040+0000","last_became_active":"2023-12-19T16:15:20.610946+0000","last_became_peered":"2023-12-19T16:15:20.610946+0000","last_unstale":"2023-12-19T16:15:24.591040+0000","last_undegraded":"2023-12-19T16:15:24.591040+0000","last_fullsized":"2023-12-19T16:15:24.591040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616066+0000","last_change":"2023-12-19T16:15:20.602585+0000","last_active":"2023-12-19T16:15:24.616066+0000","last_peered":"2023-12-19T16:15:24.616066+0000","last_clean":"2023-12-19T16:15:24.616066+0000","last_became_active":"2023-12-19T16:15:20.602278+0000","last_became_peered":"2023-12-19T16:15:20.602278+0000","last_unstale":"2023-12-19T16:15:24.616066+0000","last_undegraded":"2023-12-19T16:15:24.616066+0000","last_fullsized":"2023-12-19T16:15:24.616066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.586325+0000","last_change":"2023-12-19T16:15:20.602226+0000","last_active":"2023-12-19T16:15:24.586325+0000","last_peered":"2023-12-19T16:15:24.586325+0000","last_clean":"2023-12-19T16:15:24.586325+0000","last_became_active":"2023-12-19T16:15:20.601928+0000","last_became_peered":"2023-12-19T16:15:20.601928+0000","last_unstale":"2023-12-19T16:15:24.586325+0000","last_undegraded":"2023-12-19T16:15:24.586325+0000","last_fullsized":"2023-12-19T16:15:24.586325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.584077+0000","last_change":"2023-12-19T16:15:20.584639+0000","last_active":"2023-12-19T16:15:24.584077+0000","last_peered":"2023-12-19T16:15:24.584077+0000","last_clean":"2023-12-19T16:15:24.584077+0000","last_became_active":"2023-12-19T16:15:20.584426+0000","last_became_peered":"2023-12-19T16:15:20.584426+0000","last_unstale":"2023-12-19T16:15:24.584077+0000","last_undegraded":"2023-12-19T16:15:24.584077+0000","last_fullsized":"2023-12-19T16:15:24.584077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:11.712037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.582785+0000","last_change":"2023-12-19T16:15:20.575948+0000","last_active":"2023-12-19T16:15:24.582785+0000","last_peered":"2023-12-19T16:15:24.582785+0000","last_clean":"2023-12-19T16:15:24.582785+0000","last_became_active":"2023-12-19T16:15:20.573675+0000","last_became_peered":"2023-12-19T16:15:20.573675+0000","last_unstale":"2023-12-19T16:15:24.582785+0000","last_undegraded":"2023-12-19T16:15:24.582785+0000","last_fullsized":"2023-12-19T16:15:24.582785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:23.787433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.607444+0000","last_change":"2023-12-19T16:15:20.588200+0000","last_active":"2023-12-19T16:15:24.607444+0000","last_peered":"2023-12-19T16:15:24.607444+0000","last_clean":"2023-12-19T16:15:24.607444+0000","last_became_active":"2023-12-19T16:15:20.587984+0000","last_became_peered":"2023-12-19T16:15:20.587984+0000","last_unstale":"2023-12-19T16:15:24.607444+0000","last_undegraded":"2023-12-19T16:15:24.607444+0000","last_fullsized":"2023-12-19T16:15:24.607444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:58:11.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588501+0000","last_change":"2023-12-19T16:15:20.588750+0000","last_active":"2023-12-19T16:15:24.588501+0000","last_peered":"2023-12-19T16:15:24.588501+0000","last_clean":"2023-12-19T16:15:24.588501+0000","last_became_active":"2023-12-19T16:15:20.588398+0000","last_became_peered":"2023-12-19T16:15:20.588398+0000","last_unstale":"2023-12-19T16:15:24.588501+0000","last_undegraded":"2023-12-19T16:15:24.588501+0000","last_fullsized":"2023-12-19T16:15:24.588501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:29.677239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.580194+0000","last_change":"2023-12-19T16:15:20.604284+0000","last_active":"2023-12-19T16:15:24.580194+0000","last_peered":"2023-12-19T16:15:24.580194+0000","last_clean":"2023-12-19T16:15:24.580194+0000","last_became_active":"2023-12-19T16:15:20.603889+0000","last_became_peered":"2023-12-19T16:15:20.603889+0000","last_unstale":"2023-12-19T16:15:24.580194+0000","last_undegraded":"2023-12-19T16:15:24.580194+0000","last_fullsized":"2023-12-19T16:15:24.580194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:49:35.547084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.589849+0000","last_change":"2023-12-19T16:15:20.611693+0000","last_active":"2023-12-19T16:15:24.589849+0000","last_peered":"2023-12-19T16:15:24.589849+0000","last_clean":"2023-12-19T16:15:24.589849+0000","last_became_active":"2023-12-19T16:15:20.611287+0000","last_became_peered":"2023-12-19T16:15:20.611287+0000","last_unstale":"2023-12-19T16:15:24.589849+0000","last_undegraded":"2023-12-19T16:15:24.589849+0000","last_fullsized":"2023-12-19T16:15:24.589849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:43.929175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592587+0000","last_change":"2023-12-19T16:15:20.603377+0000","last_active":"2023-12-19T16:15:24.592587+0000","last_peered":"2023-12-19T16:15:24.592587+0000","last_clean":"2023-12-19T16:15:24.592587+0000","last_became_active":"2023-12-19T16:15:20.603157+0000","last_became_peered":"2023-12-19T16:15:20.603157+0000","last_unstale":"2023-12-19T16:15:24.592587+0000","last_undegraded":"2023-12-19T16:15:24.592587+0000","last_fullsized":"2023-12-19T16:15:24.592587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:32.791021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.592770+0000","last_change":"2023-12-19T16:15:20.599480+0000","last_active":"2023-12-19T16:15:24.592770+0000","last_peered":"2023-12-19T16:15:24.592770+0000","last_clean":"2023-12-19T16:15:24.592770+0000","last_became_active":"2023-12-19T16:15:20.599204+0000","last_became_peered":"2023-12-19T16:15:20.599204+0000","last_unstale":"2023-12-19T16:15:24.592770+0000","last_undegraded":"2023-12-19T16:15:24.592770+0000","last_fullsized":"2023-12-19T16:15:24.592770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616342+0000","last_change":"2023-12-19T16:15:20.609122+0000","last_active":"2023-12-19T16:15:24.616342+0000","last_peered":"2023-12-19T16:15:24.616342+0000","last_clean":"2023-12-19T16:15:24.616342+0000","last_became_active":"2023-12-19T16:15:20.608840+0000","last_became_peered":"2023-12-19T16:15:20.608840+0000","last_unstale":"2023-12-19T16:15:24.616342+0000","last_undegraded":"2023-12-19T16:15:24.616342+0000","last_fullsized":"2023-12-19T16:15:24.616342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:01.062348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.579734+0000","last_change":"2023-12-19T16:15:20.589707+0000","last_active":"2023-12-19T16:15:24.579734+0000","last_peered":"2023-12-19T16:15:24.579734+0000","last_clean":"2023-12-19T16:15:24.579734+0000","last_became_active":"2023-12-19T16:15:20.589430+0000","last_became_peered":"2023-12-19T16:15:20.589430+0000","last_unstale":"2023-12-19T16:15:24.579734+0000","last_undegraded":"2023-12-19T16:15:24.579734+0000","last_fullsized":"2023-12-19T16:15:24.579734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:26.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.611868+0000","last_change":"2023-12-19T16:15:20.594142+0000","last_active":"2023-12-19T16:15:24.611868+0000","last_peered":"2023-12-19T16:15:24.611868+0000","last_clean":"2023-12-19T16:15:24.611868+0000","last_became_active":"2023-12-19T16:15:20.593842+0000","last_became_peered":"2023-12-19T16:15:20.593842+0000","last_unstale":"2023-12-19T16:15:24.611868+0000","last_undegraded":"2023-12-19T16:15:24.611868+0000","last_fullsized":"2023-12-19T16:15:24.611868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.583063+0000","last_change":"2023-12-19T16:15:20.574706+0000","last_active":"2023-12-19T16:15:24.583063+0000","last_peered":"2023-12-19T16:15:24.583063+0000","last_clean":"2023-12-19T16:15:24.583063+0000","last_became_active":"2023-12-19T16:15:20.574376+0000","last_became_peered":"2023-12-19T16:15:20.574376+0000","last_unstale":"2023-12-19T16:15:24.583063+0000","last_undegraded":"2023-12-19T16:15:24.583063+0000","last_fullsized":"2023-12-19T16:15:24.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:24.100960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.612667+0000","last_change":"2023-12-19T16:15:20.605920+0000","last_active":"2023-12-19T16:15:24.612667+0000","last_peered":"2023-12-19T16:15:24.612667+0000","last_clean":"2023-12-19T16:15:24.612667+0000","last_became_active":"2023-12-19T16:15:20.605610+0000","last_became_peered":"2023-12-19T16:15:20.605610+0000","last_unstale":"2023-12-19T16:15:24.612667+0000","last_undegraded":"2023-12-19T16:15:24.612667+0000","last_fullsized":"2023-12-19T16:15:24.612667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:40.102328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.581912+0000","last_change":"2023-12-19T16:15:20.594793+0000","last_active":"2023-12-19T16:15:24.581912+0000","last_peered":"2023-12-19T16:15:24.581912+0000","last_clean":"2023-12-19T16:15:24.581912+0000","last_became_active":"2023-12-19T16:15:20.593463+0000","last_became_peered":"2023-12-19T16:15:20.593463+0000","last_unstale":"2023-12-19T16:15:24.581912+0000","last_undegraded":"2023-12-19T16:15:24.581912+0000","last_fullsized":"2023-12-19T16:15:24.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:03.362525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.588263+0000","last_change":"2023-12-19T16:15:20.590564+0000","last_active":"2023-12-19T16:15:24.588263+0000","last_peered":"2023-12-19T16:15:24.588263+0000","last_clean":"2023-12-19T16:15:24.588263+0000","last_became_active":"2023-12-19T16:15:20.590320+0000","last_became_peered":"2023-12-19T16:15:20.590320+0000","last_unstale":"2023-12-19T16:15:24.588263+0000","last_undegraded":"2023-12-19T16:15:24.588263+0000","last_fullsized":"2023-12-19T16:15:24.588263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:05.532173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.609610+0000","last_change":"2023-12-19T16:15:20.603717+0000","last_active":"2023-12-19T16:15:24.609610+0000","last_peered":"2023-12-19T16:15:24.609610+0000","last_clean":"2023-12-19T16:15:24.609610+0000","last_became_active":"2023-12-19T16:15:20.603426+0000","last_became_peered":"2023-12-19T16:15:20.603426+0000","last_unstale":"2023-12-19T16:15:24.609610+0000","last_undegraded":"2023-12-19T16:15:24.609610+0000","last_fullsized":"2023-12-19T16:15:24.609610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:17.293025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:24.616243+0000","last_change":"2023-12-19T16:15:20.614781+0000","last_active":"2023-12-19T16:15:24.616243+0000","last_peered":"2023-12-19T16:15:24.616243+0000","last_clean":"2023-12-19T16:15:24.616243+0000","last_became_active":"2023-12-19T16:15:20.614271+0000","last_became_peered":"2023-12-19T16:15:20.614271+0000","last_unstale":"2023-12-19T16:15:24.616243+0000","last_undegraded":"2023-12-19T16:15:24.616243+0000","last_fullsized":"2023-12-19T16:15:24.616243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:20.163646+0000","last_clean_scrub_stamp":"2023-12-19T16:15:20.163646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:33.230783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3220000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1720000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4829999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5119999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4379999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1289999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:49.252 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T16:15:49.252 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T16:15:49.252 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T16:15:49.252 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T16:15:49.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.419+0000 7fc6934a7640 1 Processor -- start 2023-12-19T16:15:49.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6934a7640 1 -- start start 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6934a7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc68c15c730 0x7fc68c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6934a7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c0cea00 0x7fc68c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6934a7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0b65c0 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6934a7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c15cb10 con 0x7fc68c15c730 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6934a7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0b84c0 con 0x7fc68c0cea00 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6924a5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc68c15c730 0x7fc68c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc692ca6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc68c0cd3a0 0x7fc68c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59568/0 (socket says 172.21.15.119:59568) 2023-12-19T16:15:49.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc692ca6640 1 -- 172.21.15.119:0/880709320 learned_addr learned my addr 172.21.15.119:0/880709320 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:49.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc691ca4640 1 --2- 172.21.15.119:0/880709320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c0cea00 0x7fc68c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6924a5640 1 -- 172.21.15.119:0/880709320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c0cea00 msgr2=0x7fc68c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6924a5640 1 --2- 172.21.15.119:0/880709320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c0cea00 0x7fc68c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6924a5640 1 -- 172.21.15.119:0/880709320 >> v1:172.21.15.119:6789/0 conn(0x7fc68c0cd3a0 legacy=0x7fc68c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6924a5640 1 -- 172.21.15.119:0/880709320 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0cd960 con 0x7fc68c15c730 2023-12-19T16:15:49.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.423+0000 7fc6914a3640 1 -- 172.21.15.119:0/880709320 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754716333 0 0) 0x7fc68c0b65c0 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6924a5640 1 --2- 172.21.15.119:0/880709320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c15c730 0x7fc68c0b7f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6880097c0 tx=0x7fc68801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5508cf80180d53 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6914a3640 1 -- 172.21.15.119:0/880709320 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880a8970 con 0x7fc68c15c730 2023-12-19T16:15:49.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6914a3640 1 -- 172.21.15.119:0/880709320 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880a8ad0 con 0x7fc68c15c730 2023-12-19T16:15:49.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6914a3640 1 -- 172.21.15.119:0/880709320 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880a8e60 con 0x7fc68c15c730 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 -- 172.21.15.119:0/880709320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c15c730 msgr2=0x7fc68c0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 --2- 172.21.15.119:0/880709320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c15c730 0x7fc68c0b7f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6880097c0 tx=0x7fc68801ec70 comp rx=0 tx=0).stop 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 -- 172.21.15.119:0/880709320 shutdown_connections 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 --2- 172.21.15.119:0/880709320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c0cea00 0x7fc68c0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 --2- 172.21.15.119:0/880709320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c15c730 0x7fc68c0b7f80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 -- 172.21.15.119:0/880709320 >> 172.21.15.119:0/880709320 conn(0x7fc68c06b120 msgr2=0x7fc68c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 -- 172.21.15.119:0/880709320 shutdown_connections 2023-12-19T16:15:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 -- 172.21.15.119:0/880709320 wait complete. 2023-12-19T16:15:49.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 Processor -- start 2023-12-19T16:15:49.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.427+0000 7fc6934a7640 1 -- start start 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 0x7fc68c0c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc68c0cea00 0x7fc68c1e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c15c730 0x7fc68c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c56b0 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c15f290 con 0x7fc68c0cea00 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c15e680 con 0x7fc68c15c730 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 0x7fc68c0c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 0x7fc68c0c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57096/0 (socket says 172.21.15.119:57096) 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 -- 172.21.15.119:0/1547781682 learned_addr learned my addr 172.21.15.119:0/1547781682 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc691ca4640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc68c0cea00 0x7fc68c1e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc692ca6640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c15c730 0x7fc68c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 -- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c15c730 msgr2=0x7fc68c0c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c15c730 0x7fc68c0c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 -- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc68c0cea00 msgr2=0x7fc68c1e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc68c0cea00 0x7fc68c1e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 -- 172.21.15.119:0/1547781682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688009420 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc691ca4640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc68c0cea00 0x7fc68c1e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6924a5640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 0x7fc68c0c5170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc68801c8a0 tx=0x7fc68801d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880b1e00 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688006e20 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688004230 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c15e960 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c15ef20 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c066c50 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.431+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc688004390 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.435+0000 7fc682ffd640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc670065a60 0x7fc670067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.435+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc688120c40 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.435+0000 7fc691ca4640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc670065a60 0x7fc670067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.435+0000 7fc691ca4640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc670065a60 0x7fc670067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc68c14d6f0 tx=0x7fc67c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.439+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc6880ee390 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc68c04e850 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc682ffd640 1 -- 172.21.15.119:0/1547781682 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc6880f19b0 con 0x7fc68c0cd3a0 2023-12-19T16:15:49.622 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:49.622 INFO:teuthology.orchestra.run.smithi119.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T16:15:49.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc670065a60 msgr2=0x7fc670067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc670065a60 0x7fc670067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc68c14d6f0 tx=0x7fc67c008040 comp rx=0 tx=0).stop 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 msgr2=0x7fc68c0c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 0x7fc68c0c5170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc68801c8a0 tx=0x7fc68801d4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 shutdown_connections 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc670065a60 0x7fc670067f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc68c0cea00 0x7fc68c1e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc68c15c730 0x7fc68c0c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 --2- 172.21.15.119:0/1547781682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc68c0cd3a0 0x7fc68c0c5170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 >> 172.21.15.119:0/1547781682 conn(0x7fc68c06b120 msgr2=0x7fc68c15b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 shutdown_connections 2023-12-19T16:15:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.619+0000 7fc6934a7640 1 -- 172.21.15.119:0/1547781682 wait complete. 2023-12-19T16:15:49.643 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T16:15:49.643 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:49.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 Processor -- start 2023-12-19T16:15:49.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 -- start start 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4b6c143f50 0x7f4b6c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c0c36c0 con 0x7f4b6c0afd10 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c06ca40 con 0x7f4b6c143f50 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b70b79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0b06d0 con 0x7f4b6c06c5b0 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4b6c143f50 0x7f4b6c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4b6c143f50 0x7f4b6c0c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57110/0 (socket says 172.21.15.119:57110) 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 -- 172.21.15.119:0/2216055737 learned_addr learned my addr 172.21.15.119:0/2216055737 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6affd640 1 --1- 172.21.15.119:0/2216055737 >> v1:172.21.15.119:6789/0 conn(0x7f4b6c0afd10 0x7f4b6c06bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59578/0 (socket says 172.21.15.119:59578) 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6bfff640 1 --2- 172.21.15.119:0/2216055737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 -- 172.21.15.119:0/2216055737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 msgr2=0x7f4b6c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 --2- 172.21.15.119:0/2216055737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 -- 172.21.15.119:0/2216055737 >> v1:172.21.15.119:6789/0 conn(0x7f4b6c0afd10 legacy=0x7f4b6c06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6b7fe640 1 -- 172.21.15.119:0/2216055737 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0c39a0 con 0x7f4b6c143f50 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.779+0000 7f4b6a7fc640 1 -- 172.21.15.119:0/2216055737 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179483027 0 0) 0x7f4b6c0c36c0 con 0x7f4b6c0afd10 2023-12-19T16:15:49.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b6b7fe640 1 --2- 172.21.15.119:0/2216055737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c0c4480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009870 tx=0x7f4b5c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8756b8de7fe920a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b6a7fc640 1 -- 172.21.15.119:0/2216055737 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0a9620 con 0x7f4b6c143f50 2023-12-19T16:15:49.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b6a7fc640 1 -- 172.21.15.119:0/2216055737 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c0a9780 con 0x7f4b6c143f50 2023-12-19T16:15:49.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b6a7fc640 1 -- 172.21.15.119:0/2216055737 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0a9b10 con 0x7f4b6c143f50 2023-12-19T16:15:49.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 -- 172.21.15.119:0/2216055737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 msgr2=0x7f4b6c0c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 --2- 172.21.15.119:0/2216055737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c0c4480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009870 tx=0x7f4b5c01c540 comp rx=0 tx=0).stop 2023-12-19T16:15:49.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 -- 172.21.15.119:0/2216055737 shutdown_connections 2023-12-19T16:15:49.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 --2- 172.21.15.119:0/2216055737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 --2- 172.21.15.119:0/2216055737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c0c4480 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 -- 172.21.15.119:0/2216055737 >> 172.21.15.119:0/2216055737 conn(0x7f4b6c0ce130 msgr2=0x7f4b6c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 -- 172.21.15.119:0/2216055737 shutdown_connections 2023-12-19T16:15:49.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 -- 172.21.15.119:0/2216055737 wait complete. 2023-12-19T16:15:49.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.783+0000 7f4b70b79640 1 Processor -- start 2023-12-19T16:15:49.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- start start 2023-12-19T16:15:49.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c0afd10 0x7f4b6c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c15d220 con 0x7f4b6c143f50 2023-12-19T16:15:49.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c158690 con 0x7f4b6c0afd10 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c13bb80 con 0x7f4b6c06c5b0 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57122/0 (socket says 172.21.15.119:57122) 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 -- 172.21.15.119:0/3440233583 learned_addr learned my addr 172.21.15.119:0/3440233583 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6b7fe640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6affd640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c0afd10 0x7f4b6c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 -- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 msgr2=0x7f4b6c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 -- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c0afd10 msgr2=0x7f4b6c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c0afd10 0x7f4b6c0ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 -- 172.21.15.119:0/3440233583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0094d0 con 0x7f4b6c143f50 2023-12-19T16:15:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6affd640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c0afd10 0x7f4b6c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:49.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b6bfff640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c157840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b64007e40 tx=0x7f4b6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64014620 con 0x7f4b6c143f50 2023-12-19T16:15:49.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400ee90 con 0x7f4b6c143f50 2023-12-19T16:15:49.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c1583b0 con 0x7f4b6c143f50 2023-12-19T16:15:49.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640149e0 con 0x7f4b6c143f50 2023-12-19T16:15:49.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c15c4e0 con 0x7f4b6c143f50 2023-12-19T16:15:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.787+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c04e850 con 0x7f4b6c143f50 2023-12-19T16:15:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.791+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b64014b40 con 0x7f4b6c143f50 2023-12-19T16:15:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.791+0000 7f4b53fff640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4b58065a60 0x7f4b58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.791+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b64083dd0 con 0x7f4b6c143f50 2023-12-19T16:15:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.791+0000 7f4b6b7fe640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4b58065a60 0x7f4b58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.791+0000 7f4b6b7fe640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4b58065a60 0x7f4b58067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0ae000 tx=0x7f4b5c0b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.795+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4b64051400 con 0x7f4b6c143f50 2023-12-19T16:15:49.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b6c15d9f0 con 0x7f4b6c143f50 2023-12-19T16:15:49.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b53fff640 1 -- 172.21.15.119:0/3440233583 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f4b64054a20 con 0x7f4b6c143f50 2023-12-19T16:15:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:49.952 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4b58065a60 msgr2=0x7f4b58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4b58065a60 0x7f4b58067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0ae000 tx=0x7f4b5c0b3040 comp rx=0 tx=0).stop 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 msgr2=0x7f4b6c157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c157840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b64007e40 tx=0x7f4b6400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 shutdown_connections 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4b58065a60 0x7f4b58067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c0afd10 0x7f4b6c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c143f50 0x7f4b6c157840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 --2- 172.21.15.119:0/3440233583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c5b0 0x7f4b6c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 >> 172.21.15.119:0/3440233583 conn(0x7f4b6c0ce130 msgr2=0x7f4b6c15de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 shutdown_connections 2023-12-19T16:15:49.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:49.947+0000 7f4b70b79640 1 -- 172.21.15.119:0/3440233583 wait complete. 2023-12-19T16:15:49.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:15:49.972 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:50.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.107+0000 7fa8c1c41640 1 Processor -- start 2023-12-19T16:15:50.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.107+0000 7fa8c1c41640 1 -- start start 2023-12-19T16:15:50.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8c1c41640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8bc1582d0 0x7fa8bc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8c1c41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc0ce3b0 0x7fa8bc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8c1c41640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc0c9390 con 0x7fa8bc070820 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8c1c41640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc0ced80 con 0x7fa8bc1582d0 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8c1c41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc15aee0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8bc1582d0 0x7fa8bc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8bc1582d0 0x7fa8bc0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57126/0 (socket says 172.21.15.119:57126) 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 -- 172.21.15.119:0/4178284318 learned_addr learned my addr 172.21.15.119:0/4178284318 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:50.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8baffd640 1 --1- 172.21.15.119:0/4178284318 >> v1:172.21.15.119:6789/0 conn(0x7fa8bc070820 0x7fa8bc0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59580/0 (socket says 172.21.15.119:59580) 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bbfff640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc0ce3b0 0x7fa8bc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 -- 172.21.15.119:0/4178284318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc0ce3b0 msgr2=0x7fa8bc0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc0ce3b0 0x7fa8bc0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 -- 172.21.15.119:0/4178284318 >> v1:172.21.15.119:6789/0 conn(0x7fa8bc070820 legacy=0x7fa8bc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bb7fe640 1 -- 172.21.15.119:0/4178284318 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc15b1c0 con 0x7fa8bc1582d0 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8ba7fc640 1 -- 172.21.15.119:0/4178284318 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877453920 0 0) 0x7fa8bc0c9390 con 0x7fa8bc070820 2023-12-19T16:15:50.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.111+0000 7fa8bbfff640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc0ce3b0 0x7fa8bc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:50.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8bb7fe640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc0c8e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009870 tx=0x7fa8ac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147ef29462d4731a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8ba7fc640 1 -- 172.21.15.119:0/4178284318 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0aa670 con 0x7fa8bc1582d0 2023-12-19T16:15:50.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8ba7fc640 1 -- 172.21.15.119:0/4178284318 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0aa7d0 con 0x7fa8bc1582d0 2023-12-19T16:15:50.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8ba7fc640 1 -- 172.21.15.119:0/4178284318 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0aab60 con 0x7fa8bc1582d0 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 -- 172.21.15.119:0/4178284318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc1582d0 msgr2=0x7fa8bc0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc0c8e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009870 tx=0x7fa8ac01c510 comp rx=0 tx=0).stop 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 -- 172.21.15.119:0/4178284318 shutdown_connections 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc0ce3b0 0x7fa8bc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/4178284318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc0c8e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 -- 172.21.15.119:0/4178284318 >> 172.21.15.119:0/4178284318 conn(0x7fa8bc06a2a0 msgr2=0x7fa8bc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 -- 172.21.15.119:0/4178284318 shutdown_connections 2023-12-19T16:15:50.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 -- 172.21.15.119:0/4178284318 wait complete. 2023-12-19T16:15:50.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 Processor -- start 2023-12-19T16:15:50.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.115+0000 7fa8c1c41640 1 -- start start 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc070820 0x7fa8bc15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 0x7fa8bc14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc15dd00 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc15d0f0 con 0x7fa8bc1582d0 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc15d3d0 con 0x7fa8bc070820 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 0x7fa8bc14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 0x7fa8bc14d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57138/0 (socket says 172.21.15.119:57138) 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 -- 172.21.15.119:0/124615706 learned_addr learned my addr 172.21.15.119:0/124615706 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8bb7fe640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc070820 0x7fa8bc15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8bbfff640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 -- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc070820 msgr2=0x7fa8bc15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc070820 0x7fa8bc15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 -- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8bc1582d0 msgr2=0x7fa8bc1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 -- 172.21.15.119:0/124615706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0094d0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8baffd640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 0x7fa8bc14d7b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00011f0 tx=0x7fa8b000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00074e0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b0007640 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc15d6b0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0004a10 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc15cda0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc15deb0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.119+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa8b0004b70 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.123+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa8a8065a60 0x7fa8a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.123+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8b0082980 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.123+0000 7fa8bb7fe640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa8a8065a60 0x7fa8a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.123+0000 7fa8bb7fe640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa8a8065a60 0x7fa8a8067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0ae000 tx=0x7fa8ac0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.127+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa8bc15deb0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.275+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8bc04e000 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.275+0000 7fa8a3fff640 1 -- 172.21.15.119:0/124615706 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8b00180a0 con 0x7fa8bc0ce3b0 2023-12-19T16:15:50.280 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa8a8065a60 msgr2=0x7fa8a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa8a8065a60 0x7fa8a8067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0ae000 tx=0x7fa8ac0b5040 comp rx=0 tx=0).stop 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 msgr2=0x7fa8bc14d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 0x7fa8bc14d7b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00011f0 tx=0x7fa8b000c9b0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 shutdown_connections 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa8a8065a60 0x7fa8a8067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8bc1582d0 0x7fa8bc1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8bc0ce3b0 0x7fa8bc14d7b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 --2- 172.21.15.119:0/124615706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8bc070820 0x7fa8bc15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 >> 172.21.15.119:0/124615706 conn(0x7fa8bc06a2a0 msgr2=0x7fa8bc151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 shutdown_connections 2023-12-19T16:15:50.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.279+0000 7fa8c1c41640 1 -- 172.21.15.119:0/124615706 wait complete. 2023-12-19T16:15:50.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:15:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 Processor -- start 2023-12-19T16:15:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 -- start start 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815c910 0x7f5aa8161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5aa806afc0 0x7f5aa80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5aa815ccf0 0x7f5aa80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa80ce700 con 0x7f5aa815ccf0 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa80cad80 con 0x7f5aa806afc0 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.439+0000 7f5aad70a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80cb020 con 0x7f5aa815c910 2023-12-19T16:15:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5aa815ccf0 0x7f5aa80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5aa815ccf0 0x7f5aa80b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57144/0 (socket says 172.21.15.119:57144) 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 -- 172.21.15.119:0/2635240987 learned_addr learned my addr 172.21.15.119:0/2635240987 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa6ffd640 1 --2- 172.21.15.119:0/2635240987 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815c910 0x7f5aa8161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5a9e7fc640 1 --2- 172.21.15.119:0/2635240987 >> v2:172.21.15.143:3300/0 conn(0x7f5aa806afc0 0x7f5aa80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 -- 172.21.15.119:0/2635240987 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815c910 msgr2=0x7f5aa8161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 --2- 172.21.15.119:0/2635240987 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815c910 0x7f5aa8161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 -- 172.21.15.119:0/2635240987 >> v2:172.21.15.143:3300/0 conn(0x7f5aa806afc0 msgr2=0x7f5aa80ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 --2- 172.21.15.119:0/2635240987 >> v2:172.21.15.143:3300/0 conn(0x7f5aa806afc0 0x7f5aa80ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 -- 172.21.15.119:0/2635240987 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa80cf1d0 con 0x7f5aa815ccf0 2023-12-19T16:15:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa77fe640 1 --2- 172.21.15.119:0/2635240987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815ccf0 0x7f5aa80b2070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80cf3c0 tx=0x7f5aa001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc7f6ac6f0fe6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa67fc640 1 -- 172.21.15.119:0/2635240987 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00a5730 con 0x7f5aa815ccf0 2023-12-19T16:15:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa67fc640 1 -- 172.21.15.119:0/2635240987 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa00a5890 con 0x7f5aa815ccf0 2023-12-19T16:15:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.443+0000 7f5aa67fc640 1 -- 172.21.15.119:0/2635240987 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00a5c20 con 0x7f5aa815ccf0 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- 172.21.15.119:0/2635240987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815ccf0 msgr2=0x7f5aa80b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- 172.21.15.119:0/2635240987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815ccf0 0x7f5aa80b2070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80cf3c0 tx=0x7f5aa001c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- 172.21.15.119:0/2635240987 shutdown_connections 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- 172.21.15.119:0/2635240987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815ccf0 0x7f5aa80b2070 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- 172.21.15.119:0/2635240987 >> v2:172.21.15.143:3300/0 conn(0x7f5aa806afc0 0x7f5aa80ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- 172.21.15.119:0/2635240987 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815c910 0x7f5aa8161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- 172.21.15.119:0/2635240987 >> 172.21.15.119:0/2635240987 conn(0x7f5aa80cd070 msgr2=0x7f5aa80cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- 172.21.15.119:0/2635240987 shutdown_connections 2023-12-19T16:15:50.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- 172.21.15.119:0/2635240987 wait complete. 2023-12-19T16:15:50.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 Processor -- start 2023-12-19T16:15:50.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- start start 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aa806afc0 0x7f5aa80c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 0x7f5aa80c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815ccf0 0x7f5aa80c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80ca780 con 0x7f5aa815c910 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81509d0 con 0x7f5aa806afc0 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aad70a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8150c40 con 0x7f5aa815ccf0 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 0x7f5aa80c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 0x7f5aa80c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57148/0 (socket says 172.21.15.119:57148) 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 -- 172.21.15.119:0/3719514329 learned_addr learned my addr 172.21.15.119:0/3719514329 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:50.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aa6ffd640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aa806afc0 0x7f5aa80c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5aa77fe640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815ccf0 0x7f5aa80c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 -- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815ccf0 msgr2=0x7f5aa80c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815ccf0 0x7f5aa80c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 -- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aa806afc0 msgr2=0x7f5aa80c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aa806afc0 0x7f5aa80c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.447+0000 7f5a9e7fc640 1 -- 172.21.15.119:0/3719514329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0009b30 con 0x7f5aa815c910 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9e7fc640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 0x7f5aa80c9510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800d800 tx=0x7f5a9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980096a0 con 0x7f5aa815c910 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98009800 con 0x7f5aa815c910 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98009bb0 con 0x7f5aa815c910 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa81548e0 con 0x7f5aa815c910 2023-12-19T16:15:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa8154ea0 con 0x7f5aa815c910 2023-12-19T16:15:50.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa804e000 con 0x7f5aa815c910 2023-12-19T16:15:50.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a98009d10 con 0x7f5aa815c910 2023-12-19T16:15:50.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9ffff640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a88065a60 0x7f5a88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a98083810 con 0x7f5aa815c910 2023-12-19T16:15:50.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.451+0000 7f5aa6ffd640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a88065a60 0x7f5a88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.455+0000 7f5aa6ffd640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a88065a60 0x7f5a88067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5aa81567b0 tx=0x7f5a90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.455+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5a98050f80 con 0x7f5aa815c910 2023-12-19T16:15:50.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.607+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5aa806c9c0 con 0x7f5aa815c910 2023-12-19T16:15:50.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.607+0000 7f5a9ffff640 1 -- 172.21.15.119:0/3719514329 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a980545a0 con 0x7f5aa815c910 2023-12-19T16:15:50.612 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:50.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a88065a60 msgr2=0x7f5a88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a88065a60 0x7f5a88067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5aa81567b0 tx=0x7f5a90008040 comp rx=0 tx=0).stop 2023-12-19T16:15:50.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 msgr2=0x7f5aa80c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 0x7f5aa80c9510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800d800 tx=0x7f5a9800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 shutdown_connections 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a88065a60 0x7f5a88067f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aa815ccf0 0x7f5aa80c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa815c910 0x7f5aa80c9510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 --2- 172.21.15.119:0/3719514329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aa806afc0 0x7f5aa80c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 >> 172.21.15.119:0/3719514329 conn(0x7f5aa80cd070 msgr2=0x7f5aa80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 shutdown_connections 2023-12-19T16:15:50.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.611+0000 7f5aad70a640 1 -- 172.21.15.119:0/3719514329 wait complete. 2023-12-19T16:15:50.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:15:50.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f147602d640 1 Processor -- start 2023-12-19T16:15:50.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f147602d640 1 -- start start 2023-12-19T16:15:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f147602d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14700ceac0 0x7f14700c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f147602d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700c9390 con 0x7f1470070820 2023-12-19T16:15:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f147602d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147015aee0 con 0x7f14701582d0 2023-12-19T16:15:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f147602d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147015b1c0 con 0x7f14700ceac0 2023-12-19T16:15:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1470070820 0x7f14700ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59584/0 (socket says 172.21.15.119:59584) 2023-12-19T16:15:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146effd640 1 -- 172.21.15.119:0/3899796490 learned_addr learned my addr 172.21.15.119:0/3899796490 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146ffff640 1 --2- 172.21.15.119:0/3899796490 >> v2:172.21.15.143:3300/0 conn(0x7f14700ceac0 0x7f14700c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317744258 0 0) 0x7f14700c9390 con 0x7f1470070820 2023-12-19T16:15:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1458003530 con 0x7f1470070820 2023-12-19T16:15:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704594086 0 0) 0x7f147015aee0 con 0x7f14701582d0 2023-12-19T16:15:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14700c9390 con 0x7f14701582d0 2023-12-19T16:15:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146ffff640 1 -- 172.21.15.119:0/3899796490 >> v1:172.21.15.143:6789/0 conn(0x7f14701582d0 legacy=0x7f14700ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146ffff640 1 -- 172.21.15.119:0/3899796490 >> v1:172.21.15.119:6789/0 conn(0x7f1470070820 legacy=0x7f14700ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.771+0000 7f146ffff640 1 -- 172.21.15.119:0/3899796490 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015b4a0 con 0x7f14700ceac0 2023-12-19T16:15:50.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f146ffff640 1 --2- 172.21.15.119:0/3899796490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14700c8e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1468009d90 tx=0x7f146801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d442c7c18a6f91 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680a5a00 con 0x7f14700ceac0 2023-12-19T16:15:50.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14680a5b60 con 0x7f14700ceac0 2023-12-19T16:15:50.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f146e7fc640 1 -- 172.21.15.119:0/3899796490 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680ad440 con 0x7f14700ceac0 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 -- 172.21.15.119:0/3899796490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 msgr2=0x7f14700c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 --2- 172.21.15.119:0/3899796490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14700c8e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1468009d90 tx=0x7f146801c920 comp rx=0 tx=0).stop 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 -- 172.21.15.119:0/3899796490 shutdown_connections 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 --2- 172.21.15.119:0/3899796490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14700c8e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 -- 172.21.15.119:0/3899796490 >> 172.21.15.119:0/3899796490 conn(0x7f147006a2a0 msgr2=0x7f14700aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 -- 172.21.15.119:0/3899796490 shutdown_connections 2023-12-19T16:15:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.775+0000 7f147602d640 1 -- 172.21.15.119:0/3899796490 wait complete. 2023-12-19T16:15:50.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 Processor -- start 2023-12-19T16:15:50.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 -- start start 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 0x7f14700cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14701529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14701582d0 0x7f14700abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470152f30 con 0x7f1470070820 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700ad1e0 con 0x7f14700ceac0 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700ac330 con 0x7f14701582d0 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 0x7f14700cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 0x7f14700cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57164/0 (socket says 172.21.15.119:57164) 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 -- 172.21.15.119:0/4267973097 learned_addr learned my addr 172.21.15.119:0/4267973097 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146effd640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14701529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146ffff640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14701582d0 0x7f14700abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 -- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14701582d0 msgr2=0x7f14700abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14701582d0 0x7f14700abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 -- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 msgr2=0x7f14701529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14701529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 -- 172.21.15.119:0/4267973097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468009a70 con 0x7f1470070820 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f146f7fe640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 0x7f14700cd030 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f146000c460 tx=0x7f146000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600052d0 con 0x7f1470070820 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460005450 con 0x7f1470070820 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460003840 con 0x7f1470070820 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700ac5d0 con 0x7f1470070820 2023-12-19T16:15:50.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.779+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14700acb90 con 0x7f1470070820 2023-12-19T16:15:50.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.783+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147004e000 con 0x7f1470070820 2023-12-19T16:15:50.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.783+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14600039a0 con 0x7f1470070820 2023-12-19T16:15:50.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.783+0000 7f1457fff640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.783+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f14600829f0 con 0x7f1470070820 2023-12-19T16:15:50.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.783+0000 7f146effd640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.783+0000 7f146effd640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f14700abda0 tx=0x7f1464009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.787+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14600500c0 con 0x7f1470070820 2023-12-19T16:15:50.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14700b0c00 con 0x7f1470070820 2023-12-19T16:15:50.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f1457fff640 1 -- 172.21.15.119:0/4267973097 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14600170a0 con 0x7f1470070820 2023-12-19T16:15:50.941 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:15:50.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 msgr2=0x7f145c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f14700abda0 tx=0x7f1464009040 comp rx=0 tx=0).stop 2023-12-19T16:15:50.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 msgr2=0x7f14700cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 0x7f14700cd030 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f146000c460 tx=0x7f146000c920 comp rx=0 tx=0).stop 2023-12-19T16:15:50.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 shutdown_connections 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14700ceac0 0x7f14701529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14701582d0 0x7f14700abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 --2- 172.21.15.119:0/4267973097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1470070820 0x7f14700cd030 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 >> 172.21.15.119:0/4267973097 conn(0x7f147006a2a0 msgr2=0x7f14700ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 shutdown_connections 2023-12-19T16:15:50.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:50.939+0000 7f147602d640 1 -- 172.21.15.119:0/4267973097 wait complete. 2023-12-19T16:15:50.962 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:15:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff652352640 1 Processor -- start 2023-12-19T16:15:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff652352640 1 -- start start 2023-12-19T16:15:51.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff652352640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff64c0ceac0 0x7ff64c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff652352640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0c9390 con 0x7ff64c1582d0 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff652352640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c15aee0 con 0x7ff64c070820 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff652352640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c15b1c0 con 0x7ff64c0ceac0 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff64bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff64c1582d0 0x7ff64c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59592/0 (socket says 172.21.15.119:59592) 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff64bfff640 1 -- 172.21.15.119:0/2260639803 learned_addr learned my addr 172.21.15.119:0/2260639803 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff6508ef640 1 --2- 172.21.15.119:0/2260639803 >> v2:172.21.15.119:3300/0 conn(0x7ff64c0ceac0 0x7ff64c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff6508ef640 1 -- 172.21.15.119:0/2260639803 >> v1:172.21.15.143:6789/0 conn(0x7ff64c070820 legacy=0x7ff64c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff6508ef640 1 -- 172.21.15.119:0/2260639803 >> v1:172.21.15.119:6789/0 conn(0x7ff64c1582d0 legacy=0x7ff64c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff6508ef640 1 -- 172.21.15.119:0/2260639803 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c15b4a0 con 0x7ff64c0ceac0 2023-12-19T16:15:51.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.099+0000 7ff64affd640 1 -- 172.21.15.119:0/2260639803 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473476601 0 0) 0x7ff64c0c9390 con 0x7ff64c1582d0 2023-12-19T16:15:51.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff6508ef640 1 --2- 172.21.15.119:0/2260639803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c8e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff644009d90 tx=0x7ff64401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eb6198d0fd9898 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff64affd640 1 -- 172.21.15.119:0/2260639803 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440a5a00 con 0x7ff64c0ceac0 2023-12-19T16:15:51.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff64affd640 1 -- 172.21.15.119:0/2260639803 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6440a5b60 con 0x7ff64c0ceac0 2023-12-19T16:15:51.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff64affd640 1 -- 172.21.15.119:0/2260639803 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440ad440 con 0x7ff64c0ceac0 2023-12-19T16:15:51.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 -- 172.21.15.119:0/2260639803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c0ceac0 msgr2=0x7ff64c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 --2- 172.21.15.119:0/2260639803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c8e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff644009d90 tx=0x7ff64401c920 comp rx=0 tx=0).stop 2023-12-19T16:15:51.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 -- 172.21.15.119:0/2260639803 shutdown_connections 2023-12-19T16:15:51.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 --2- 172.21.15.119:0/2260639803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c8e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 -- 172.21.15.119:0/2260639803 >> 172.21.15.119:0/2260639803 conn(0x7ff64c06a2a0 msgr2=0x7ff64c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 -- 172.21.15.119:0/2260639803 shutdown_connections 2023-12-19T16:15:51.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.103+0000 7ff652352640 1 -- 172.21.15.119:0/2260639803 wait complete. 2023-12-19T16:15:51.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 Processor -- start 2023-12-19T16:15:51.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 -- start start 2023-12-19T16:15:51.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 0x7ff64c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff64c1582d0 0x7ff64c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c156a30 con 0x7ff64c070820 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c156d10 con 0x7ff64c0ceac0 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c0c65a0 con 0x7ff64c1582d0 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 0x7ff64c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 0x7ff64c159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57190/0 (socket says 172.21.15.119:57190) 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 -- 172.21.15.119:0/3008781139 learned_addr learned my addr 172.21.15.119:0/3008781139 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64b7fe640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff6508ef640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff64c1582d0 0x7ff64c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 -- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff64c1582d0 msgr2=0x7ff64c0c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff64c1582d0 0x7ff64c0c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 -- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff64c0ceac0 msgr2=0x7ff64c0c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 -- 172.21.15.119:0/3008781139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644009a70 con 0x7ff64c070820 2023-12-19T16:15:51.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff6508ef640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff64c1582d0 0x7ff64c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff64bfff640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 0x7ff64c159a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c410 tx=0x7ff63c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0074e0 con 0x7ff64c070820 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c007640 con 0x7ff64c070820 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c0c6880 con 0x7ff64c070820 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c004a30 con 0x7ff64c070820 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.107+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c156ff0 con 0x7ff64c070820 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.111+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c0c6400 con 0x7ff64c070820 2023-12-19T16:15:51.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.111+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff63c004b90 con 0x7ff64c070820 2023-12-19T16:15:51.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.111+0000 7ff648ff9640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff638065a60 0x7ff638067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.111+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff63c0833a0 con 0x7ff64c070820 2023-12-19T16:15:51.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.111+0000 7ff64b7fe640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff638065a60 0x7ff638067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.111+0000 7ff64b7fe640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff638065a60 0x7ff638067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff64c1f6700 tx=0x7ff640009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.115+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff64c0c6400 con 0x7ff64c070820 2023-12-19T16:15:51.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff64c0c6400 con 0x7ff64c070820 2023-12-19T16:15:51.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff648ff9640 1 -- 172.21.15.119:0/3008781139 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff64c0c6400 con 0x7ff64c070820 2023-12-19T16:15:51.273 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:51.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff638065a60 msgr2=0x7ff638067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff638065a60 0x7ff638067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff64c1f6700 tx=0x7ff640009040 comp rx=0 tx=0).stop 2023-12-19T16:15:51.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 msgr2=0x7ff64c159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 0x7ff64c159a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c410 tx=0x7ff63c00c8d0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 shutdown_connections 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff638065a60 0x7ff638067f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff64c0ceac0 0x7ff64c0c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff64c1582d0 0x7ff64c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 --2- 172.21.15.119:0/3008781139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64c070820 0x7ff64c159a60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 >> 172.21.15.119:0/3008781139 conn(0x7ff64c06a2a0 msgr2=0x7ff64c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 shutdown_connections 2023-12-19T16:15:51.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.271+0000 7ff652352640 1 -- 172.21.15.119:0/3008781139 wait complete. 2023-12-19T16:15:51.294 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:51.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.427+0000 7f7a5df09640 1 Processor -- start 2023-12-19T16:15:51.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.427+0000 7f7a5df09640 1 -- start start 2023-12-19T16:15:51.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a5df09640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7a581570c0 0x7f7a5806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a5df09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5806c320 0x7f7a580c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a5df09640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a580c9e30 0x7f7a580ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a5df09640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5806c7a0 con 0x7f7a580c9e30 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a5df09640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a580c9460 con 0x7f7a581570c0 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a5df09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581574a0 con 0x7f7a5806c320 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a580c9e30 0x7f7a580ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a580c9e30 0x7f7a580ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57198/0 (socket says 172.21.15.119:57198) 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 -- 172.21.15.119:0/3993788807 learned_addr learned my addr 172.21.15.119:0/3993788807 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a577fe640 1 --2- 172.21.15.119:0/3993788807 >> v2:172.21.15.143:3300/0 conn(0x7f7a581570c0 0x7f7a5806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a56ffd640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5806c320 0x7f7a580c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 -- 172.21.15.119:0/3993788807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5806c320 msgr2=0x7f7a580c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5806c320 0x7f7a580c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 -- 172.21.15.119:0/3993788807 >> v2:172.21.15.143:3300/0 conn(0x7f7a581570c0 msgr2=0x7f7a5806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:51.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 --2- 172.21.15.119:0/3993788807 >> v2:172.21.15.143:3300/0 conn(0x7f7a581570c0 0x7f7a5806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 -- 172.21.15.119:0/3993788807 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580c8b30 con 0x7f7a580c9e30 2023-12-19T16:15:51.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a56ffd640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5806c320 0x7f7a580c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:51.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.431+0000 7f7a57fff640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580ca2c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a5806e280 tx=0x7f7a5001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9385a45007ec5d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a567fc640 1 -- 172.21.15.119:0/3993788807 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500a5790 con 0x7f7a580c9e30 2023-12-19T16:15:51.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a567fc640 1 -- 172.21.15.119:0/3993788807 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a500a58f0 con 0x7f7a580c9e30 2023-12-19T16:15:51.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a567fc640 1 -- 172.21.15.119:0/3993788807 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500a5c80 con 0x7f7a580c9e30 2023-12-19T16:15:51.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- 172.21.15.119:0/3993788807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 msgr2=0x7f7a580ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580ca2c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a5806e280 tx=0x7f7a5001c910 comp rx=0 tx=0).stop 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- 172.21.15.119:0/3993788807 shutdown_connections 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580ca2c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- 172.21.15.119:0/3993788807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5806c320 0x7f7a580c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- 172.21.15.119:0/3993788807 >> v2:172.21.15.143:3300/0 conn(0x7f7a581570c0 0x7f7a5806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- 172.21.15.119:0/3993788807 >> 172.21.15.119:0/3993788807 conn(0x7f7a5806a3e0 msgr2=0x7f7a580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- 172.21.15.119:0/3993788807 shutdown_connections 2023-12-19T16:15:51.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- 172.21.15.119:0/3993788807 wait complete. 2023-12-19T16:15:51.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 Processor -- start 2023-12-19T16:15:51.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- start start 2023-12-19T16:15:51.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5806c320 0x7f7a581556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a581570c0 0x7f7a580c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58155be0 con 0x7f7a580c9e30 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580c7010 con 0x7f7a5806c320 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.435+0000 7f7a5df09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580c72f0 con 0x7f7a581570c0 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57202/0 (socket says 172.21.15.119:57202) 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 -- 172.21.15.119:0/220095614 learned_addr learned my addr 172.21.15.119:0/220095614 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a577fe640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5806c320 0x7f7a581556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a57fff640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a581570c0 0x7f7a580c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 -- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a581570c0 msgr2=0x7f7a580c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a581570c0 0x7f7a580c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 -- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5806c320 msgr2=0x7f7a581556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5806c320 0x7f7a581556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 -- 172.21.15.119:0/220095614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50009b30 con 0x7f7a580c9e30 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a577fe640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5806c320 0x7f7a581556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a57fff640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a581570c0 0x7f7a580c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a56ffd640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580c6490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c7c0 tx=0x7f7a4c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c007a30 con 0x7f7a580c9e30 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c007b90 con 0x7f7a580c9e30 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c00ce70 con 0x7f7a580c9e30 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a580c75d0 con 0x7f7a580c9e30 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a580c7b90 con 0x7f7a580c9e30 2023-12-19T16:15:51.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a580735b0 con 0x7f7a580c9e30 2023-12-19T16:15:51.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a4c0113f0 con 0x7f7a580c9e30 2023-12-19T16:15:51.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a3ffff640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a44065a60 0x7f7a44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a4c083910 con 0x7f7a580c9e30 2023-12-19T16:15:51.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.439+0000 7f7a577fe640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a44065a60 0x7f7a44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.443+0000 7f7a577fe640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a44065a60 0x7f7a44067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a58156060 tx=0x7f7a48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.443+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7a4c050fe0 con 0x7f7a580c9e30 2023-12-19T16:15:51.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a5815ac40 con 0x7f7a580c9e30 2023-12-19T16:15:51.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a3ffff640 1 -- 172.21.15.119:0/220095614 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f7a5815ac40 con 0x7f7a580c9e30 2023-12-19T16:15:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:51.630 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:51.630 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:15:51.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a44065a60 msgr2=0x7f7a44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a44065a60 0x7f7a44067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a58156060 tx=0x7f7a48008040 comp rx=0 tx=0).stop 2023-12-19T16:15:51.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 msgr2=0x7f7a580c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580c6490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c7c0 tx=0x7f7a4c00cc80 comp rx=0 tx=0).stop 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 shutdown_connections 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a44065a60 0x7f7a44067f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a581570c0 0x7f7a580c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a580c9e30 0x7f7a580c6490 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 --2- 172.21.15.119:0/220095614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5806c320 0x7f7a581556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 >> 172.21.15.119:0/220095614 conn(0x7f7a5806a3e0 msgr2=0x7f7a580ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 shutdown_connections 2023-12-19T16:15:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.627+0000 7f7a5df09640 1 -- 172.21.15.119:0/220095614 wait complete. 2023-12-19T16:15:51.650 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.783+0000 7f4c236fc640 1 Processor -- start 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.783+0000 7f4c236fc640 1 -- start start 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c236fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c236fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4c1c06c320 0x7f4c1c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c236fc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0c9460 con 0x7f4c1c0c9e30 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c236fc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c06c7a0 con 0x7f4c1c06c320 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c236fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1574a0 con 0x7f4c1c1570c0 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c20c97640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4c1c06c320 0x7f4c1c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c21c99640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4c1c0c9e30 0x7f4c1c15d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59596/0 (socket says 172.21.15.119:59596) 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c20c97640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4c1c06c320 0x7f4c1c0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57204/0 (socket says 172.21.15.119:57204) 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c21c99640 1 -- 172.21.15.119:0/3738207368 learned_addr learned my addr 172.21.15.119:0/3738207368 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c21498640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c20c97640 1 -- 172.21.15.119:0/3738207368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 msgr2=0x7f4c1c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:51.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c20c97640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c13fff640 1 -- 172.21.15.119:0/3738207368 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136042236 0 0) 0x7f4c1c0c9460 con 0x7f4c1c0c9e30 2023-12-19T16:15:51.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c20c97640 1 -- 172.21.15.119:0/3738207368 >> v1:172.21.15.119:6789/0 conn(0x7f4c1c0c9e30 legacy=0x7f4c1c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c20c97640 1 -- 172.21.15.119:0/3738207368 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0c8b30 con 0x7f4c1c06c320 2023-12-19T16:15:51.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.787+0000 7f4c21498640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:51.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c20c97640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0c98f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0097c0 tx=0x7f4c0c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c16664b55063f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c13fff640 1 -- 172.21.15.119:0/3738207368 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0ab600 con 0x7f4c1c06c320 2023-12-19T16:15:51.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c13fff640 1 -- 172.21.15.119:0/3738207368 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c0a7050 con 0x7f4c1c06c320 2023-12-19T16:15:51.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c13fff640 1 -- 172.21.15.119:0/3738207368 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0ab980 con 0x7f4c1c06c320 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 -- 172.21.15.119:0/3738207368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 msgr2=0x7f4c1c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0c98f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0097c0 tx=0x7f4c0c01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 -- 172.21.15.119:0/3738207368 shutdown_connections 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0c98f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3738207368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 -- 172.21.15.119:0/3738207368 >> 172.21.15.119:0/3738207368 conn(0x7f4c1c06a3e0 msgr2=0x7f4c1c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 -- 172.21.15.119:0/3738207368 shutdown_connections 2023-12-19T16:15:51.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 -- 172.21.15.119:0/3738207368 wait complete. 2023-12-19T16:15:51.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 Processor -- start 2023-12-19T16:15:51.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.791+0000 7f4c236fc640 1 -- start start 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c1c0c9e30 0x7f4c1c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c157fb0 con 0x7f4c1c06c320 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c157680 con 0x7f4c1c0c9e30 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c157960 con 0x7f4c1c1570c0 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57212/0 (socket says 172.21.15.119:57212) 2023-12-19T16:15:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 -- 172.21.15.119:0/3044763741 learned_addr learned my addr 172.21.15.119:0/3044763741 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:51.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 -- 172.21.15.119:0/3044763741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 msgr2=0x7f4c1c151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 -- 172.21.15.119:0/3044763741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c1c0c9e30 msgr2=0x7f4c1c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c1c0c9e30 0x7f4c1c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 -- 172.21.15.119:0/3044763741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009420 con 0x7f4c1c06c320 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c21498640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0cade0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c7c0 tx=0x7f4c1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18007a30 con 0x7f4c1c06c320 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18007b90 con 0x7f4c1c06c320 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c157c40 con 0x7f4c1c06c320 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800ce70 con 0x7f4c1c06c320 2023-12-19T16:15:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0c7fe0 con 0x7f4c1c06c320 2023-12-19T16:15:51.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c0735b0 con 0x7f4c1c06c320 2023-12-19T16:15:51.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.795+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c180113f0 con 0x7f4c1c06c320 2023-12-19T16:15:51.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.799+0000 7f4c11ffb640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4c00065a60 0x7f4c00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.799+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c18083a30 con 0x7f4c1c06c320 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.799+0000 7f4c20c97640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4c00065a60 0x7f4c00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.799+0000 7f4c20c97640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4c00065a60 0x7f4c00067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0ad000 tx=0x7f4c0c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.799+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4c18051060 con 0x7f4c1c06c320 2023-12-19T16:15:51.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.951+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c1c04e000 con 0x7f4c1c06c320 2023-12-19T16:15:51.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c11ffb640 1 -- 172.21.15.119:0/3044763741 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f4c18054680 con 0x7f4c1c06c320 2023-12-19T16:15:51.957 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:51.957 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4c00065a60 msgr2=0x7f4c00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4c00065a60 0x7f4c00067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0ad000 tx=0x7f4c0c004740 comp rx=0 tx=0).stop 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 msgr2=0x7f4c1c0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0cade0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c7c0 tx=0x7f4c1800cc80 comp rx=0 tx=0).stop 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 shutdown_connections 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4c00065a60 0x7f4c00067f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c1c0c9e30 0x7f4c1c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c1c1570c0 0x7f4c1c151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 --2- 172.21.15.119:0/3044763741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c06c320 0x7f4c1c0cade0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 >> 172.21.15.119:0/3044763741 conn(0x7f4c1c06a3e0 msgr2=0x7f4c1c15c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 shutdown_connections 2023-12-19T16:15:51.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:51.955+0000 7f4c236fc640 1 -- 172.21.15.119:0/3044763741 wait complete. 2023-12-19T16:15:51.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:15:51.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:52.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 Processor -- start 2023-12-19T16:15:52.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 -- start start 2023-12-19T16:15:52.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f4160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f78f40c9690 0x7f78f4142020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f4142cd0 con 0x7f78f40c92b0 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f4142fb0 con 0x7f78f40c9690 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78fb0f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f41604c0 con 0x7f78f40ceac0 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f8e95640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f78f40c92b0 0x7f78f40ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59598/0 (socket says 172.21.15.119:59598) 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f8e95640 1 -- 172.21.15.119:0/3668624179 learned_addr learned my addr 172.21.15.119:0/3668624179 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f9696640 1 --2- 172.21.15.119:0/3668624179 >> v2:172.21.15.143:3300/0 conn(0x7f78f40c9690 0x7f78f4142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78ebfff640 1 --2- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f4160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78eb7fe640 1 -- 172.21.15.119:0/3668624179 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575782087 0 0) 0x7f78f4142cd0 con 0x7f78f40c92b0 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78eb7fe640 1 -- 172.21.15.119:0/3668624179 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78dc003530 con 0x7f78f40c92b0 2023-12-19T16:15:52.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f9696640 1 -- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 msgr2=0x7f78f4160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f9696640 1 --2- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f4160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f9696640 1 -- 172.21.15.119:0/3668624179 >> v1:172.21.15.119:6789/0 conn(0x7f78f40c92b0 legacy=0x7f78f40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.115+0000 7f78f9696640 1 -- 172.21.15.119:0/3668624179 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f41607a0 con 0x7f78f40c9690 2023-12-19T16:15:52.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78f9696640 1 --2- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f4142020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009d90 tx=0x7f78ec01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966192bee64e8e02 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78eb7fe640 1 -- 172.21.15.119:0/3668624179 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0a59a0 con 0x7f78f40c9690 2023-12-19T16:15:52.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78eb7fe640 1 -- 172.21.15.119:0/3668624179 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0a5b00 con 0x7f78f40c9690 2023-12-19T16:15:52.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78eb7fe640 1 -- 172.21.15.119:0/3668624179 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0a5e90 con 0x7f78f40c9690 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 msgr2=0x7f78f4142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f4142020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009d90 tx=0x7f78ec01c8c0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3668624179 shutdown_connections 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f4160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3668624179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f4142020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3668624179 >> 172.21.15.119:0/3668624179 conn(0x7f78f406a2a0 msgr2=0x7f78f40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3668624179 shutdown_connections 2023-12-19T16:15:52.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.119+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3668624179 wait complete. 2023-12-19T16:15:52.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 Processor -- start 2023-12-19T16:15:52.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 -- start start 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 0x7f78f40c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f40acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f41574e0 con 0x7f78f40c92b0 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c48e0 con 0x7f78f40c9690 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c4bc0 con 0x7f78f40ceac0 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 0x7f78f40c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 0x7f78f40c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57220/0 (socket says 172.21.15.119:57220) 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 -- 172.21.15.119:0/3117511500 learned_addr learned my addr 172.21.15.119:0/3117511500 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78ebfff640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f40acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f9696640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 -- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 msgr2=0x7f78f415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 -- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 msgr2=0x7f78f40acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f40acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 -- 172.21.15.119:0/3117511500 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009a70 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78f8e95640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 0x7f78f40c3f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c420 tx=0x7f78f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0005cf0 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0005e50 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00072d0 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f41576f0 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.123+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f40c44d0 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.127+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f40c4de0 con 0x7f78f40c92b0 2023-12-19T16:15:52.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.127+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78f0007430 con 0x7f78f40c92b0 2023-12-19T16:15:52.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.127+0000 7f78e97fa640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78e0065a60 0x7f78e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.127+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78f00828d0 con 0x7f78f40c92b0 2023-12-19T16:15:52.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.127+0000 7f78ebfff640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78e0065a60 0x7f78e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.127+0000 7f78ebfff640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78e0065a60 0x7f78e0067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78f4167520 tx=0x7f78e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.131+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78f00500e0 con 0x7f78f40c92b0 2023-12-19T16:15:52.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.283+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78f404e000 con 0x7f78f40c92b0 2023-12-19T16:15:52.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.283+0000 7f78e97fa640 1 -- 172.21.15.119:0/3117511500 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78f00170a0 con 0x7f78f40c92b0 2023-12-19T16:15:52.288 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78e0065a60 msgr2=0x7f78e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78e0065a60 0x7f78e0067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78f4167520 tx=0x7f78e4009190 comp rx=0 tx=0).stop 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 msgr2=0x7f78f40c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 0x7f78f40c3f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c420 tx=0x7f78f000c8e0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 shutdown_connections 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f78e0065a60 0x7f78e0067f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78f40c9690 0x7f78f40acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78f40ceac0 0x7f78f415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 --2- 172.21.15.119:0/3117511500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78f40c92b0 0x7f78f40c3f90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 >> 172.21.15.119:0/3117511500 conn(0x7f78f406a2a0 msgr2=0x7f78f41591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 shutdown_connections 2023-12-19T16:15:52.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.287+0000 7f78fb0f9640 1 -- 172.21.15.119:0/3117511500 wait complete. 2023-12-19T16:15:52.309 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:15:52.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 Processor -- start 2023-12-19T16:15:52.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 -- start start 2023-12-19T16:15:52.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f37f40cbff0 0x7f37f40cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f40cc960 con 0x7f37f40ca410 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f415aab0 con 0x7f37f40cbff0 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f896d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4070df0 con 0x7f37f4071870 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f259c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f37f40ca410 0x7f37f4159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:59604/0 (socket says 172.21.15.119:59604) 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f259c640 1 -- 172.21.15.119:0/2740511799 learned_addr learned my addr 172.21.15.119:0/2740511799 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f2d9d640 1 --2- 172.21.15.119:0/2740511799 >> v2:172.21.15.143:3300/0 conn(0x7f37f40cbff0 0x7f37f40cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37ebfff640 1 --2- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f1d9b640 1 -- 172.21.15.119:0/2740511799 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863235007 0 0) 0x7f37f40cc960 con 0x7f37f40ca410 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f1d9b640 1 -- 172.21.15.119:0/2740511799 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e0003530 con 0x7f37f40ca410 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f2d9d640 1 -- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 msgr2=0x7f37f4071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f2d9d640 1 --2- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f2d9d640 1 -- 172.21.15.119:0/2740511799 >> v1:172.21.15.119:6789/0 conn(0x7f37f40ca410 legacy=0x7f37f4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.447+0000 7f37f2d9d640 1 -- 172.21.15.119:0/2740511799 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f415a4f0 con 0x7f37f40cbff0 2023-12-19T16:15:52.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f2d9d640 1 --2- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40cbff0 0x7f37f40cc420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009d90 tx=0x7f37ec01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73ecdda9b8119d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f1d9b640 1 -- 172.21.15.119:0/2740511799 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0a5950 con 0x7f37f40cbff0 2023-12-19T16:15:52.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f1d9b640 1 -- 172.21.15.119:0/2740511799 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec0a5ab0 con 0x7f37f40cbff0 2023-12-19T16:15:52.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f1d9b640 1 -- 172.21.15.119:0/2740511799 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0a5e40 con 0x7f37f40cbff0 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 -- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40cbff0 msgr2=0x7f37f40cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 --2- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40cbff0 0x7f37f40cc420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009d90 tx=0x7f37ec01c890 comp rx=0 tx=0).stop 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 -- 172.21.15.119:0/2740511799 shutdown_connections 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 --2- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 --2- 172.21.15.119:0/2740511799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40cbff0 0x7f37f40cc420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 -- 172.21.15.119:0/2740511799 >> 172.21.15.119:0/2740511799 conn(0x7f37f406a2a0 msgr2=0x7f37f40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 -- 172.21.15.119:0/2740511799 shutdown_connections 2023-12-19T16:15:52.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.451+0000 7f37f896d640 1 -- 172.21.15.119:0/2740511799 wait complete. 2023-12-19T16:15:52.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 Processor -- start 2023-12-19T16:15:52.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 -- start start 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40ca410 0x7f37f41f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 0x7f37f40c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40c5cf0 con 0x7f37f40cbff0 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40c6870 con 0x7f37f40ca410 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40c5f40 con 0x7f37f4071870 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 0x7f37f40c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 0x7f37f40c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57226/0 (socket says 172.21.15.119:57226) 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 -- 172.21.15.119:0/3330804254 learned_addr learned my addr 172.21.15.119:0/3330804254 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37ebfff640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40ca410 0x7f37f41f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f259c640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 -- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 msgr2=0x7f37f4158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 -- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40ca410 msgr2=0x7f37f41f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40ca410 0x7f37f41f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 -- 172.21.15.119:0/3330804254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec009a70 con 0x7f37f40cbff0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f2d9d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 0x7f37f40c87a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009d90 tx=0x7f37ec019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0adce0 con 0x7f37f40cbff0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec0ade40 con 0x7f37f40cbff0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40c6220 con 0x7f37f40cbff0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0b9690 con 0x7f37f40cbff0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.455+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40c8ce0 con 0x7f37f40cbff0 2023-12-19T16:15:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.459+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f40c6a00 con 0x7f37f40cbff0 2023-12-19T16:15:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.459+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f37ec0039a0 con 0x7f37f40cbff0 2023-12-19T16:15:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.459+0000 7f37eaffd640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f37d4065a90 0x7f37d4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.459+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37ec11ea10 con 0x7f37f40cbff0 2023-12-19T16:15:52.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.459+0000 7f37f259c640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f37d4065a90 0x7f37d4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.459+0000 7f37f259c640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f37d4065a90 0x7f37d4067f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37e40011f0 tx=0x7f37e4007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.463+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f37ec0ec220 con 0x7f37f40cbff0 2023-12-19T16:15:52.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.615+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37f404e000 con 0x7f37f40cbff0 2023-12-19T16:15:52.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37eaffd640 1 -- 172.21.15.119:0/3330804254 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37ec009450 con 0x7f37f40cbff0 2023-12-19T16:15:52.622 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f37d4065a90 msgr2=0x7f37d4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f37d4065a90 0x7f37d4067f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37e40011f0 tx=0x7f37e4007d40 comp rx=0 tx=0).stop 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 msgr2=0x7f37f40c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 0x7f37f40c87a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009d90 tx=0x7f37ec019630 comp rx=0 tx=0).stop 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 shutdown_connections 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f37d4065a90 0x7f37d4067f50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37f40ca410 0x7f37f41f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37f40cbff0 0x7f37f40c87a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 --2- 172.21.15.119:0/3330804254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37f4071870 0x7f37f4158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 >> 172.21.15.119:0/3330804254 conn(0x7f37f406a2a0 msgr2=0x7f37f4154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 shutdown_connections 2023-12-19T16:15:52.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.619+0000 7f37f896d640 1 -- 172.21.15.119:0/3330804254 wait complete. 2023-12-19T16:15:52.642 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:15:52.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 Processor -- start 2023-12-19T16:15:52.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 -- start start 2023-12-19T16:15:52.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1e640ca410 0x7f1e64159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1e64159fb0 0x7f1e64071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e64070df0 con 0x7f1e64071db0 2023-12-19T16:15:52.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6415aab0 con 0x7f1e640ca410 2023-12-19T16:15:52.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e6a539640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6415a4f0 con 0x7f1e64159fb0 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1e640ca410 0x7f1e64159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1e640ca410 0x7f1e64159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56584/0 (socket says 172.21.15.119:56584) 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 -- 172.21.15.119:0/3084592005 learned_addr learned my addr 172.21.15.119:0/3084592005 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e637fe640 1 --2- 172.21.15.119:0/3084592005 >> v2:172.21.15.143:3300/0 conn(0x7f1e64159fb0 0x7f1e64071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 -- 172.21.15.119:0/3084592005 >> v2:172.21.15.143:3300/0 conn(0x7f1e64159fb0 msgr2=0x7f1e64071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 --2- 172.21.15.119:0/3084592005 >> v2:172.21.15.143:3300/0 conn(0x7f1e64159fb0 0x7f1e64071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 -- 172.21.15.119:0/3084592005 >> v1:172.21.15.119:6789/0 conn(0x7f1e64071db0 legacy=0x7f1e640cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e63fff640 1 -- 172.21.15.119:0/3084592005 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6415a7d0 con 0x7f1e640ca410 2023-12-19T16:15:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.779+0000 7f1e62ffd640 1 -- 172.21.15.119:0/3084592005 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039029690 0 0) 0x7f1e64070df0 con 0x7f1e64071db0 2023-12-19T16:15:52.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e63fff640 1 --2- 172.21.15.119:0/3084592005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e640ca410 0x7f1e64159a70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1e640cbeb0 tx=0x7f1e5401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d283da0952b34bac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e62ffd640 1 -- 172.21.15.119:0/3084592005 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540ac640 con 0x7f1e640ca410 2023-12-19T16:15:52.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e62ffd640 1 -- 172.21.15.119:0/3084592005 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540ac7a0 con 0x7f1e640ca410 2023-12-19T16:15:52.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e62ffd640 1 -- 172.21.15.119:0/3084592005 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540acb30 con 0x7f1e640ca410 2023-12-19T16:15:52.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 -- 172.21.15.119:0/3084592005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e640ca410 msgr2=0x7f1e64159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3084592005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e640ca410 0x7f1e64159a70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1e640cbeb0 tx=0x7f1e5401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 -- 172.21.15.119:0/3084592005 shutdown_connections 2023-12-19T16:15:52.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3084592005 >> v2:172.21.15.143:3300/0 conn(0x7f1e64159fb0 0x7f1e64071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3084592005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e640ca410 0x7f1e64159a70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 -- 172.21.15.119:0/3084592005 >> 172.21.15.119:0/3084592005 conn(0x7f1e6406a2a0 msgr2=0x7f1e640aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 -- 172.21.15.119:0/3084592005 shutdown_connections 2023-12-19T16:15:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.783+0000 7f1e6a539640 1 -- 172.21.15.119:0/3084592005 wait complete. 2023-12-19T16:15:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 Processor -- start 2023-12-19T16:15:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 -- start start 2023-12-19T16:15:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 0x7f1e641546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e640ca410 0x7f1e64154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e64159fb0 0x7f1e64141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641434b0 con 0x7f1e64071db0 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c1250 con 0x7f1e64159fb0 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641425e0 con 0x7f1e640ca410 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 0x7f1e641546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 0x7f1e641546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56598/0 (socket says 172.21.15.119:56598) 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 -- 172.21.15.119:0/3626162274 learned_addr learned my addr 172.21.15.119:0/3626162274 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e637fe640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e640ca410 0x7f1e64154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e68ad6640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e64159fb0 0x7f1e64141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 -- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e640ca410 msgr2=0x7f1e64154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e640ca410 0x7f1e64154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 -- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e64159fb0 msgr2=0x7f1e64141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e64159fb0 0x7f1e64141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 -- 172.21.15.119:0/3626162274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540094d0 con 0x7f1e64071db0 2023-12-19T16:15:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e63fff640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 0x7f1e641546b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e540af040 tx=0x7f1e54019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540b7670 con 0x7f1e64071db0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540b77d0 con 0x7f1e64071db0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e64142830 con 0x7f1e64071db0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540b7b60 con 0x7f1e64071db0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.787+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e64142df0 con 0x7f1e64071db0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.791+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e641435f0 con 0x7f1e64071db0 2023-12-19T16:15:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.791+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e540b3070 con 0x7f1e64071db0 2023-12-19T16:15:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.791+0000 7f1e60ff9640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1e50065a60 0x7f1e50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.791+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e5411dd60 con 0x7f1e64071db0 2023-12-19T16:15:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.791+0000 7f1e637fe640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1e50065a60 0x7f1e50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.791+0000 7f1e637fe640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1e50065a60 0x7f1e50067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e641554d0 tx=0x7f1e58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.795+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1e641435f0 con 0x7f1e64071db0 2023-12-19T16:15:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e641435f0 con 0x7f1e64071db0 2023-12-19T16:15:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e60ff9640 1 -- 172.21.15.119:0/3626162274 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e641435f0 con 0x7f1e64071db0 2023-12-19T16:15:52.946 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1e50065a60 msgr2=0x7f1e50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1e50065a60 0x7f1e50067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e641554d0 tx=0x7f1e58008040 comp rx=0 tx=0).stop 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 msgr2=0x7f1e641546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 0x7f1e641546b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e540af040 tx=0x7f1e54019270 comp rx=0 tx=0).stop 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 shutdown_connections 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1e50065a60 0x7f1e50067f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e64159fb0 0x7f1e64141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e640ca410 0x7f1e64154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 --2- 172.21.15.119:0/3626162274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e64071db0 0x7f1e641546b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 >> 172.21.15.119:0/3626162274 conn(0x7f1e6406a2a0 msgr2=0x7f1e64157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 shutdown_connections 2023-12-19T16:15:52.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:52.943+0000 7f1e6a539640 1 -- 172.21.15.119:0/3626162274 wait complete. 2023-12-19T16:15:52.968 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:15:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.103+0000 7f5f00f0b640 1 Processor -- start 2023-12-19T16:15:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.103+0000 7f5f00f0b640 1 -- start start 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5f00f0b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5f00f0b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5efc15d2d0 0x7f5efc15d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5f00f0b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc15cf10 con 0x7f5efc15cb30 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5f00f0b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc15e000 con 0x7f5efc15d2d0 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5f00f0b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0cf960 con 0x7f5efc0cefe0 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5efc15d2d0 0x7f5efc15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efb7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5efc15cb30 0x7f5efc06bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35592/0 (socket says 172.21.15.119:35592) 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efb7fe640 1 -- 172.21.15.119:0/1740484480 learned_addr learned my addr 172.21.15.119:0/1740484480 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efbfff640 1 -- 172.21.15.119:0/1740484480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 msgr2=0x7f5efc0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efbfff640 1 --2- 172.21.15.119:0/1740484480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efbfff640 1 -- 172.21.15.119:0/1740484480 >> v1:172.21.15.119:6789/0 conn(0x7f5efc15cb30 legacy=0x7f5efc06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efbfff640 1 -- 172.21.15.119:0/1740484480 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc06ae40 con 0x7f5efc15d2d0 2023-12-19T16:15:53.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.107+0000 7f5efa7fc640 1 -- 172.21.15.119:0/1740484480 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18851298 0 0) 0x7f5efc15cf10 con 0x7f5efc15cb30 2023-12-19T16:15:53.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5efbfff640 1 --2- 172.21.15.119:0/1740484480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15d760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21da4b417d9ceb75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5efa7fc640 1 -- 172.21.15.119:0/1740484480 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40a59e0 con 0x7f5efc15d2d0 2023-12-19T16:15:53.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5efa7fc640 1 -- 172.21.15.119:0/1740484480 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef40a5b40 con 0x7f5efc15d2d0 2023-12-19T16:15:53.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5efa7fc640 1 -- 172.21.15.119:0/1740484480 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40ad440 con 0x7f5efc15d2d0 2023-12-19T16:15:53.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1740484480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15d2d0 msgr2=0x7f5efc15d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1740484480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15d760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef401c920 comp rx=0 tx=0).stop 2023-12-19T16:15:53.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1740484480 shutdown_connections 2023-12-19T16:15:53.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1740484480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15d760 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1740484480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1740484480 >> 172.21.15.119:0/1740484480 conn(0x7f5efc089fb0 msgr2=0x7f5efc09b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1740484480 shutdown_connections 2023-12-19T16:15:53.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1740484480 wait complete. 2023-12-19T16:15:53.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 Processor -- start 2023-12-19T16:15:53.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- start start 2023-12-19T16:15:53.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 0x7f5efc15f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0cbeb0 con 0x7f5efc15cb30 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0c9b10 con 0x7f5efc15d2d0 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.111+0000 7f5f00f0b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0c9df0 con 0x7f5efc0cefe0 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 0x7f5efc15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 0x7f5efc15f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56624/0 (socket says 172.21.15.119:56624) 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 -- 172.21.15.119:0/1805354112 learned_addr learned my addr 172.21.15.119:0/1805354112 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efb7fe640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efbfff640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 -- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 msgr2=0x7f5efc0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 -- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5efc15d2d0 msgr2=0x7f5efc15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 -- 172.21.15.119:0/1805354112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009a70 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5efaffd640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 0x7f5efc15f280 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000b550 tx=0x7f5ef000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0010870 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef00109f0 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0010da0 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0ca0d0 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc14aa60 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc06a7c0 con 0x7f5efc15cb30 2023-12-19T16:15:53.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5ef000f3c0 con 0x7f5efc15cb30 2023-12-19T16:15:53.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5ee3fff640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ee8065a60 0x7f5ee8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.115+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ef0083450 con 0x7f5efc15cb30 2023-12-19T16:15:53.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.119+0000 7f5efb7fe640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ee8065a60 0x7f5ee8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.119+0000 7f5efb7fe640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ee8065a60 0x7f5ee8067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0010f0 tx=0x7f5eec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.119+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5ef0050b30 con 0x7f5efc15cb30 2023-12-19T16:15:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.267+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5efc04e850 con 0x7f5efc15cb30 2023-12-19T16:15:53.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.267+0000 7f5ee3fff640 1 -- 172.21.15.119:0/1805354112 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5ef0054150 con 0x7f5efc15cb30 2023-12-19T16:15:53.273 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ee8065a60 msgr2=0x7f5ee8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ee8065a60 0x7f5ee8067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0010f0 tx=0x7f5eec009040 comp rx=0 tx=0).stop 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 msgr2=0x7f5efc15f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 0x7f5efc15f280 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000b550 tx=0x7f5ef000ba10 comp rx=0 tx=0).stop 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 shutdown_connections 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ee8065a60 0x7f5ee8067f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5efc15d2d0 0x7f5efc15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc15cb30 0x7f5efc15f280 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 --2- 172.21.15.119:0/1805354112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5efc0cefe0 0x7f5efc0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 >> 172.21.15.119:0/1805354112 conn(0x7f5efc089fb0 msgr2=0x7f5efc06bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 shutdown_connections 2023-12-19T16:15:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.271+0000 7f5f00f0b640 1 -- 172.21.15.119:0/1805354112 wait complete. 2023-12-19T16:15:53.295 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:53.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.427+0000 7f2fa0509640 1 Processor -- start 2023-12-19T16:15:53.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.427+0000 7f2fa0509640 1 -- start start 2023-12-19T16:15:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2fa0509640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2f980cdd40 0x7f2f980cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2fa0509640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f98160690 con 0x7f2f9815c9d0 2023-12-19T16:15:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2fa0509640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980b0d80 con 0x7f2f9806fdb0 2023-12-19T16:15:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2fa0509640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f981603f0 con 0x7f2f980cdd40 2023-12-19T16:15:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9e2a5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2f9815c9d0 0x7f2f98160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35600/0 (socket says 172.21.15.119:35600) 2023-12-19T16:15:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9e2a5640 1 -- 172.21.15.119:0/2324929088 learned_addr learned my addr 172.21.15.119:0/2324929088 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377213688 0 0) 0x7f2f98160690 con 0x7f2f9815c9d0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f84003530 con 0x7f2f9815c9d0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/2324929088 >> v2:172.21.15.143:3300/0 conn(0x7f2f980cdd40 0x7f2f980cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3476167762 0 0) 0x7f2f84003530 con 0x7f2f9815c9d0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 >> v2:172.21.15.143:3300/0 conn(0x7f2f980cdd40 msgr2=0x7f2f980cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 --2- 172.21.15.119:0/2324929088 >> v2:172.21.15.143:3300/0 conn(0x7f2f980cdd40 0x7f2f980cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 >> v1:172.21.15.143:6789/0 conn(0x7f2f9806fdb0 legacy=0x7f2f980cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980ccb00 con 0x7f2f9815c9d0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f2f94001680 con 0x7f2f9815c9d0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 >> v1:172.21.15.119:6789/0 conn(0x7f2f9815c9d0 legacy=0x7f2f98160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f84003980 0x7f2f84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f84005190 0x7f2f8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f981603f0 con 0x7f2f840047d0 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8400c0e0 con 0x7f2f84005190 2023-12-19T16:15:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8400c2a0 con 0x7f2f84003980 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9e2a5640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f84003980 0x7f2f84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9eaa6640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f84005190 0x7f2f8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 -- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f84003980 msgr2=0x7f2f84003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f84003980 0x7f2f84003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 -- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f84005190 msgr2=0x7f2f8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f84005190 0x7f2f8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9daa4640 1 -- 172.21.15.119:0/2324929088 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84003530 con 0x7f2f840047d0 2023-12-19T16:15:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.431+0000 7f2f9eaa6640 1 -- 172.21.15.119:0/2324929088 reap_dead start 2023-12-19T16:15:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f84004c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800ba30 tx=0x7f2f8801c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec4efb5eb9936e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880ae620 con 0x7f2f840047d0 2023-12-19T16:15:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f880ae780 con 0x7f2f840047d0 2023-12-19T16:15:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2f9d2a3640 1 -- 172.21.15.119:0/2324929088 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880aeb30 con 0x7f2f840047d0 2023-12-19T16:15:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 -- 172.21.15.119:0/2324929088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 msgr2=0x7f2f84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f84004c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800ba30 tx=0x7f2f8801c680 comp rx=0 tx=0).stop 2023-12-19T16:15:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 -- 172.21.15.119:0/2324929088 shutdown_connections 2023-12-19T16:15:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 --2- 172.21.15.119:0/2324929088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f84004c50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 -- 172.21.15.119:0/2324929088 >> 172.21.15.119:0/2324929088 conn(0x7f2f9806a3e0 msgr2=0x7f2f980afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 -- 172.21.15.119:0/2324929088 shutdown_connections 2023-12-19T16:15:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 -- 172.21.15.119:0/2324929088 wait complete. 2023-12-19T16:15:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 Processor -- start 2023-12-19T16:15:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.435+0000 7f2fa0509640 1 -- start start 2023-12-19T16:15:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f98159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f980b0f10 0x7f2f9814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f9814a8b0 0x7f2f980af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980b1760 con 0x7f2f840047d0 2023-12-19T16:15:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9814ad60 con 0x7f2f980b0f10 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980b1480 con 0x7f2f9814a8b0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f98159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f98159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56650/0 (socket says 172.21.15.119:56650) 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 -- 172.21.15.119:0/862097666 learned_addr learned my addr 172.21.15.119:0/862097666 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f980b0f10 0x7f2f9814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9eaa6640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f9814a8b0 0x7f2f980af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 -- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f9814a8b0 msgr2=0x7f2f980af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f9814a8b0 0x7f2f980af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 -- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f980b0f10 msgr2=0x7f2f9814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f980b0f10 0x7f2f9814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 -- 172.21.15.119:0/862097666 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980c6ac0 con 0x7f2f840047d0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f9e2a5640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f98159ea0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f94012470 tx=0x7f2f94012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94014810 con 0x7f2f840047d0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94014970 con 0x7f2f840047d0 2023-12-19T16:15:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f980c6da0 con 0x7f2f840047d0 2023-12-19T16:15:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94014ce0 con 0x7f2f840047d0 2023-12-19T16:15:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9814e000 con 0x7f2f840047d0 2023-12-19T16:15:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f980735b0 con 0x7f2f840047d0 2023-12-19T16:15:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.439+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f940153e0 con 0x7f2f840047d0 2023-12-19T16:15:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.443+0000 7f2f8effd640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f7c065a60 0x7f2f7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.443+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f94086260 con 0x7f2f840047d0 2023-12-19T16:15:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.443+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f7c065a60 0x7f2f7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.443+0000 7f2f9daa4640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f7c065a60 0x7f2f7c067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b0000 tx=0x7f2f880046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.447+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2f94053940 con 0x7f2f840047d0 2023-12-19T16:15:53.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f980c6920 con 0x7f2f840047d0 2023-12-19T16:15:53.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2f8effd640 1 -- 172.21.15.119:0/862097666 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f2f980c6920 con 0x7f2f840047d0 2023-12-19T16:15:53.631 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:53.631 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:53.631 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:15:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f7c065a60 msgr2=0x7f2f7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f7c065a60 0x7f2f7c067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b0000 tx=0x7f2f880046d0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 msgr2=0x7f2f98159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f98159ea0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f94012470 tx=0x7f2f94012930 comp rx=0 tx=0).stop 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 shutdown_connections 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2f7c065a60 0x7f2f7c067f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f980b0f10 0x7f2f9814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f9814a8b0 0x7f2f980af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 --2- 172.21.15.119:0/862097666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f840047d0 0x7f2f98159ea0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 >> 172.21.15.119:0/862097666 conn(0x7f2f9806a3e0 msgr2=0x7f2f9815b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 shutdown_connections 2023-12-19T16:15:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.627+0000 7f2fa0509640 1 -- 172.21.15.119:0/862097666 wait complete. 2023-12-19T16:15:53.651 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:53.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 Processor -- start 2023-12-19T16:15:53.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 -- start start 2023-12-19T16:15:53.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb16415ca40 0x7fb1640cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1640ce3f0 0x7fb1640cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1640cfa70 con 0x7fb1640cf610 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1640d11c0 con 0x7fb16415ca40 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16882d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640d0310 con 0x7fb1640ce3f0 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb16415ca40 0x7fb1640cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb16415ca40 0x7fb1640cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56666/0 (socket says 172.21.15.119:56666) 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 -- 172.21.15.119:0/1325631605 learned_addr learned my addr 172.21.15.119:0/1325631605 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:53.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb161d9b640 1 --2- 172.21.15.119:0/1325631605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1640ce3f0 0x7fb1640cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 -- 172.21.15.119:0/1325631605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1640ce3f0 msgr2=0x7fb1640cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 --2- 172.21.15.119:0/1325631605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1640ce3f0 0x7fb1640cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 -- 172.21.15.119:0/1325631605 >> v1:172.21.15.119:6789/0 conn(0x7fb1640cf610 legacy=0x7fb1641605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.787+0000 7fb16259c640 1 -- 172.21.15.119:0/1325631605 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640d05b0 con 0x7fb16415ca40 2023-12-19T16:15:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16259c640 1 --2- 172.21.15.119:0/1325631605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb16415ca40 0x7fb1640cdeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb154006fd0 tx=0x7fb15401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1237cbde51741e28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16159a640 1 -- 172.21.15.119:0/1325631605 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1540ab640 con 0x7fb16415ca40 2023-12-19T16:15:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16159a640 1 -- 172.21.15.119:0/1325631605 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1540a7070 con 0x7fb16415ca40 2023-12-19T16:15:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16159a640 1 -- 172.21.15.119:0/1325631605 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1540ab9c0 con 0x7fb16415ca40 2023-12-19T16:15:53.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 -- 172.21.15.119:0/1325631605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb16415ca40 msgr2=0x7fb1640cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 --2- 172.21.15.119:0/1325631605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb16415ca40 0x7fb1640cdeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb154006fd0 tx=0x7fb15401c520 comp rx=0 tx=0).stop 2023-12-19T16:15:53.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 -- 172.21.15.119:0/1325631605 shutdown_connections 2023-12-19T16:15:53.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 --2- 172.21.15.119:0/1325631605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1640ce3f0 0x7fb1640cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 --2- 172.21.15.119:0/1325631605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb16415ca40 0x7fb1640cdeb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 -- 172.21.15.119:0/1325631605 >> 172.21.15.119:0/1325631605 conn(0x7fb164089fb0 msgr2=0x7fb1640d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 -- 172.21.15.119:0/1325631605 shutdown_connections 2023-12-19T16:15:53.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.791+0000 7fb16882d640 1 -- 172.21.15.119:0/1325631605 wait complete. 2023-12-19T16:15:53.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 Processor -- start 2023-12-19T16:15:53.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- start start 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1640ce3f0 0x7fb16415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 0x7fb1640c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb16415ca40 0x7fb1640c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640c8510 con 0x7fb1640cf610 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16415d1d0 con 0x7fb1640ce3f0 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640c7c70 con 0x7fb16415ca40 2023-12-19T16:15:53.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 0x7fb1640c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 0x7fb1640c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56672/0 (socket says 172.21.15.119:56672) 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 -- 172.21.15.119:0/922278750 learned_addr learned my addr 172.21.15.119:0/922278750 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16259c640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1640ce3f0 0x7fb16415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb162d9d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb16415ca40 0x7fb1640c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 -- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb16415ca40 msgr2=0x7fb1640c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb16415ca40 0x7fb1640c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 -- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1640ce3f0 msgr2=0x7fb16415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1640ce3f0 0x7fb16415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 -- 172.21.15.119:0/922278750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154009480 con 0x7fb1640cf610 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb162d9d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb16415ca40 0x7fb1640c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb161d9b640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 0x7fb1640c70b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb15800d800 tx=0x7fb15800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800b6c0 con 0x7fb1640cf610 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15800b820 con 0x7fb1640cf610 2023-12-19T16:15:53.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640c7f50 con 0x7fb1640cf610 2023-12-19T16:15:53.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800bbd0 con 0x7fb1640cf610 2023-12-19T16:15:53.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16414bcf0 con 0x7fb1640cf610 2023-12-19T16:15:53.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.795+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1640d1630 con 0x7fb1640cf610 2023-12-19T16:15:53.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.799+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb15800bd30 con 0x7fb1640cf610 2023-12-19T16:15:53.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.799+0000 7fb152ffd640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb144065a60 0x7fb144067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.799+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb158083a30 con 0x7fb1640cf610 2023-12-19T16:15:53.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.799+0000 7fb16259c640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb144065a60 0x7fb144067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.799+0000 7fb16259c640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb144065a60 0x7fb144067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1540af000 tx=0x7fb154009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.803+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb1640d1630 con 0x7fb1640cf610 2023-12-19T16:15:53.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.955+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb16415d380 con 0x7fb1640cf610 2023-12-19T16:15:53.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb152ffd640 1 -- 172.21.15.119:0/922278750 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fb16415d380 con 0x7fb1640cf610 2023-12-19T16:15:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:53.961 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:15:24.980518+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:53.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb144065a60 msgr2=0x7fb144067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb144065a60 0x7fb144067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1540af000 tx=0x7fb154009040 comp rx=0 tx=0).stop 2023-12-19T16:15:53.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 msgr2=0x7fb1640c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 0x7fb1640c70b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb15800d800 tx=0x7fb15800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 shutdown_connections 2023-12-19T16:15:53.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb144065a60 0x7fb144067f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb16415ca40 0x7fb1640c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1640cf610 0x7fb1640c70b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 --2- 172.21.15.119:0/922278750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1640ce3f0 0x7fb16415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 >> 172.21.15.119:0/922278750 conn(0x7fb164089fb0 msgr2=0x7fb1640cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 shutdown_connections 2023-12-19T16:15:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:53.959+0000 7fb16882d640 1 -- 172.21.15.119:0/922278750 wait complete. 2023-12-19T16:15:53.983 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:54.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.115+0000 7f8720b0a640 1 Processor -- start 2023-12-19T16:15:54.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.115+0000 7f8720b0a640 1 -- start start 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8720b0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c0cac10 0x7f871c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8720b0a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f871c06fdb0 0x7f871c070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8720b0a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c15f100 con 0x7f871c15a680 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8720b0a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0707a0 con 0x7f871c06fdb0 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8720b0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0ca7d0 con 0x7f871c0cac10 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f871c06fdb0 0x7f871c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871a59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f871c15a680 0x7f871c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35624/0 (socket says 172.21.15.119:35624) 2023-12-19T16:15:54.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871a59c640 1 -- 172.21.15.119:0/2262476805 learned_addr learned my addr 172.21.15.119:0/2262476805 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8711d9b640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c0cac10 0x7f871c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871ad9d640 1 -- 172.21.15.119:0/2262476805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c0cac10 msgr2=0x7f871c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871ad9d640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c0cac10 0x7f871c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8719d9b640 1 -- 172.21.15.119:0/2262476805 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155400903 0 0) 0x7f871c15f100 con 0x7f871c15a680 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871ad9d640 1 -- 172.21.15.119:0/2262476805 >> v1:172.21.15.119:6789/0 conn(0x7f871c15a680 legacy=0x7f871c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f871ad9d640 1 -- 172.21.15.119:0/2262476805 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c15e860 con 0x7f871c06fdb0 2023-12-19T16:15:54.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.119+0000 7f8711d9b640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c0cac10 0x7f871c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:54.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f871ad9d640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c070260 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8714009d90 tx=0x7f871401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1b760e8d5be6f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8719d9b640 1 -- 172.21.15.119:0/2262476805 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140a5980 con 0x7f871c06fdb0 2023-12-19T16:15:54.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8719d9b640 1 -- 172.21.15.119:0/2262476805 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87140a5ae0 con 0x7f871c06fdb0 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8719d9b640 1 -- 172.21.15.119:0/2262476805 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140a5e70 con 0x7f871c06fdb0 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 -- 172.21.15.119:0/2262476805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 msgr2=0x7f871c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c070260 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8714009d90 tx=0x7f871401c8c0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 -- 172.21.15.119:0/2262476805 shutdown_connections 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c070260 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 --2- 172.21.15.119:0/2262476805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c0cac10 0x7f871c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 -- 172.21.15.119:0/2262476805 >> 172.21.15.119:0/2262476805 conn(0x7f871c06a3e0 msgr2=0x7f871c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 -- 172.21.15.119:0/2262476805 shutdown_connections 2023-12-19T16:15:54.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 -- 172.21.15.119:0/2262476805 wait complete. 2023-12-19T16:15:54.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 Processor -- start 2023-12-19T16:15:54.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.123+0000 7f8720b0a640 1 -- start start 2023-12-19T16:15:54.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f871c0cac10 0x7f871c164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c15a680 0x7f871c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c164720 con 0x7f871c06fdb0 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0c6ba0 con 0x7f871c0cac10 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0c6e40 con 0x7f871c15a680 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56692/0 (socket says 172.21.15.119:56692) 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 -- 172.21.15.119:0/1909447587 learned_addr learned my addr 172.21.15.119:0/1909447587 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8711d9b640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f871c0cac10 0x7f871c164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871ad9d640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c15a680 0x7f871c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 -- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c15a680 msgr2=0x7f871c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c15a680 0x7f871c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 -- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f871c0cac10 msgr2=0x7f871c164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f871c0cac10 0x7f871c164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 -- 172.21.15.119:0/1909447587 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714009a70 con 0x7f871c06fdb0 2023-12-19T16:15:54.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871ad9d640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c15a680 0x7f871c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8711d9b640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f871c0cac10 0x7f871c164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f871a59c640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c152150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f870c0011f0 tx=0x7f870c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0074e0 con 0x7f871c06fdb0 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c007640 con 0x7f871c06fdb0 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c1640d0 con 0x7f871c06fdb0 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c004a10 con 0x7f871c06fdb0 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c151ef0 con 0x7f871c06fdb0 2023-12-19T16:15:54.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c0735b0 con 0x7f871c06fdb0 2023-12-19T16:15:54.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.127+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f870c004b70 con 0x7f871c06fdb0 2023-12-19T16:15:54.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.131+0000 7f87137fe640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86fc065a60 0x7f86fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.131+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f870c082a40 con 0x7f871c06fdb0 2023-12-19T16:15:54.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.131+0000 7f8711d9b640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86fc065a60 0x7f86fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.131+0000 7f8711d9b640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86fc065a60 0x7f86fc067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f871c0c7140 tx=0x7f8704008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.135+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f870c050070 con 0x7f871c06fdb0 2023-12-19T16:15:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.315+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871c0adb70 con 0x7f871c06fdb0 2023-12-19T16:15:54.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.315+0000 7f87137fe640 1 -- 172.21.15.119:0/1909447587 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f870c018090 con 0x7f871c06fdb0 2023-12-19T16:15:54.320 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:15:54.320 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:54.321 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:15:54.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86fc065a60 msgr2=0x7f86fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86fc065a60 0x7f86fc067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f871c0c7140 tx=0x7f8704008040 comp rx=0 tx=0).stop 2023-12-19T16:15:54.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 msgr2=0x7f871c152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c152150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f870c0011f0 tx=0x7f870c00c9b0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 shutdown_connections 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86fc065a60 0x7f86fc067f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f871c0cac10 0x7f871c164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f871c15a680 0x7f871c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 --2- 172.21.15.119:0/1909447587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871c06fdb0 0x7f871c152150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 >> 172.21.15.119:0/1909447587 conn(0x7f871c06a3e0 msgr2=0x7f871c15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 shutdown_connections 2023-12-19T16:15:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.319+0000 7f8720b0a640 1 -- 172.21.15.119:0/1909447587 wait complete. 2023-12-19T16:15:54.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:15:20.558027+0000', 'modified': '2023-12-19T16:15:43.194399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6837/2766451211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6835', 'nonce': 2766451211}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 2766451211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:15:54.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:15:54.744 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T16:15:54.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a02525640 1 Processor -- start 2023-12-19T16:15:54.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a02525640 1 -- start start 2023-12-19T16:15:54.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a02525640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 0x7f79fc168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a02525640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc0d11c0 con 0x7f79fc15ca40 2023-12-19T16:15:54.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a02525640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc0d0310 con 0x7f79fc0cf0d0 2023-12-19T16:15:54.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a02525640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0d05b0 con 0x7f79fc0cf530 2023-12-19T16:15:54.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79fbfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f79fc15ca40 0x7f79fc0cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35634/0 (socket says 172.21.15.119:35634) 2023-12-19T16:15:54.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79fbfff640 1 -- 172.21.15.119:0/2639092207 learned_addr learned my addr 172.21.15.119:0/2639092207 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:54.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 0x7f79fc168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477460182 0 0) 0x7f79fc0d11c0 con 0x7f79fc15ca40 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e4003530 con 0x7f79fc15ca40 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980786555 0 0) 0x7f79e4003530 con 0x7f79fc15ca40 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 msgr2=0x7f79fc168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 0x7f79fc168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 >> v1:172.21.15.143:6789/0 conn(0x7f79fc0cf0d0 legacy=0x7f79fc1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0d0890 con 0x7f79fc15ca40 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f79ec001800 con 0x7f79fc15ca40 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 >> v1:172.21.15.119:6789/0 conn(0x7f79fc15ca40 legacy=0x7f79fc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.883+0000 7f79faffd640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 0x7f79e40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79e4003f30 0x7f79e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e4004d10 0x7f79e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0d05b0 con 0x7f79e4004d10 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e400ba70 con 0x7f79e4003f30 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e400bc30 con 0x7f79fc0cf530 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e4004d10 0x7f79e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79fbfff640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 0x7f79e40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79e4003f30 0x7f79e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 -- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 msgr2=0x7f79e40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79fc0cf530 0x7f79e40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 -- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79e4003f30 msgr2=0x7f79e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79e4003f30 0x7f79e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 -- 172.21.15.119:0/2639092207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4003530 con 0x7f79e4004d10 2023-12-19T16:15:54.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e4004d10 0x7f79e4005190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009fc0 tx=0x7f79f401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426476ea99e5a9fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40a5c70 con 0x7f79e4004d10 2023-12-19T16:15:54.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f400f040 con 0x7f79e4004d10 2023-12-19T16:15:54.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.887+0000 7f79faffd640 1 -- 172.21.15.119:0/2639092207 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40ad440 con 0x7f79e4004d10 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- 172.21.15.119:0/2639092207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e4004d10 msgr2=0x7f79e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 --2- 172.21.15.119:0/2639092207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e4004d10 0x7f79e4005190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009fc0 tx=0x7f79f401cc60 comp rx=0 tx=0).stop 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 -- 172.21.15.119:0/2639092207 reap_dead start 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- 172.21.15.119:0/2639092207 shutdown_connections 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- 172.21.15.119:0/2639092207 >> 172.21.15.119:0/2639092207 conn(0x7f79fc089fb0 msgr2=0x7f79fc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- 172.21.15.119:0/2639092207 shutdown_connections 2023-12-19T16:15:54.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- 172.21.15.119:0/2639092207 wait complete. 2023-12-19T16:15:54.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 Processor -- start 2023-12-19T16:15:54.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- start start 2023-12-19T16:15:54.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79e4004d10 0x7f79fc157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79fc0c8430 0x7f79fc0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 0x7f79fc15e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c73d0 con 0x7f79fc15e020 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c7670 con 0x7f79fc0c8430 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a02525640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c7950 con 0x7f79e4004d10 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 0x7f79fc15e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 0x7f79fc15e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56708/0 (socket says 172.21.15.119:56708) 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 -- 172.21.15.119:0/1753598861 learned_addr learned my addr 172.21.15.119:0/1753598861 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79e4004d10 0x7f79fc157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79fc0c8430 0x7f79fc0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 -- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79e4004d10 msgr2=0x7f79fc157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79e4004d10 0x7f79fc157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 -- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79fc0c8430 msgr2=0x7f79fc0c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79fc0c8430 0x7f79fc0c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.891+0000 7f7a00ac2640 1 -- 172.21.15.119:0/1753598861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0c7c30 con 0x7f79fc15e020 2023-12-19T16:15:54.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 0x7f79fc15e4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79f40b0040 tx=0x7f79f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79f8ff9640 1 -- 172.21.15.119:0/1753598861 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40039a0 con 0x7f79fc15e020 2023-12-19T16:15:54.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79f8ff9640 1 -- 172.21.15.119:0/1753598861 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4003b00 con 0x7f79fc15e020 2023-12-19T16:15:54.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79f8ff9640 1 -- 172.21.15.119:0/1753598861 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4003e90 con 0x7f79fc15e020 2023-12-19T16:15:54.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc0c7f10 con 0x7f79fc15e020 2023-12-19T16:15:54.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc0cc0f0 con 0x7f79fc15e020 2023-12-19T16:15:54.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79f8ff9640 1 -- 172.21.15.119:0/1753598861 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f79f40b4040 con 0x7f79fc15e020 2023-12-19T16:15:54.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79f8ff9640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f79e8065a90 0x7f79e8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79f8ff9640 1 -- 172.21.15.119:0/1753598861 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79f411d1e0 con 0x7f79fc15e020 2023-12-19T16:15:54.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.895+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f79e8065a90 0x7f79e8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 Processor -- start 2023-12-19T16:15:54.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- start start 2023-12-19T16:15:54.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f79e8065a90 0x7f79e8067f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c10 tx=0x7f79ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6aa6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6990 0x563dc6a5bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6a5c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc687fc90 con 0x563dc6aa6070 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc68b1220 con 0x563dc6a5c1c0 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dc68ae7f0 con 0x563dc6aa6990 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6aa6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6aa6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56710/0 (socket says 172.21.15.119:56710) 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 -- 172.21.15.119:0/1296666744 learned_addr learned my addr 172.21.15.119:0/1296666744 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6a5c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6990 0x563dc6a5bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 -- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6990 msgr2=0x563dc6a5bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6990 0x563dc6a5bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 -- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 msgr2=0x563dc6a5c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6a5c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 -- 172.21.15.119:0/1296666744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dc65a6890 con 0x563dc6aa6070 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6aa6450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79ec007590 tx=0x7f79ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617b08e0a31d1ea1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79e1ffb640 1 -- 172.21.15.119:0/1296666744 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec007c40 con 0x563dc6aa6070 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79e1ffb640 1 -- 172.21.15.119:0/1296666744 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec007da0 con 0x563dc6aa6070 2023-12-19T16:15:54.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f79e1ffb640 1 -- 172.21.15.119:0/1296666744 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0145d0 con 0x563dc6aa6070 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- 172.21.15.119:0/1296666744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 msgr2=0x563dc6aa6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6aa6450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79ec007590 tx=0x7f79ec014000 comp rx=0 tx=0).stop 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- 172.21.15.119:0/1296666744 shutdown_connections 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6a5c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6990 0x563dc6a5bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1296666744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6aa6450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- 172.21.15.119:0/1296666744 >> 172.21.15.119:0/1296666744 conn(0x563dc6a62950 msgr2=0x563dc6a5a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- 172.21.15.119:0/1296666744 shutdown_connections 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- 172.21.15.119:0/1296666744 wait complete. 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.899+0000 7f7a0588b000 1 -- start start 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 Processor -- start 2023-12-19T16:15:54.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6a61740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6070 0x563dc6a68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6990 0x563dc6a685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc68aa0e0 con 0x563dc6a5c1c0 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc6849310 con 0x563dc6aa6990 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dc6867770 con 0x563dc6aa6070 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 10 client.0 _ll_register_callbacks cb 0x563dc6a47b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6a61740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6a61740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56718/0 (socket says 172.21.15.119:56718) 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 -- 172.21.15.119:0/743185543 learned_addr learned my addr 172.21.15.119:0/743185543 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6990 0x563dc6a685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6070 0x563dc6a68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 -- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6070 msgr2=0x563dc6a68080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6070 0x563dc6a68080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 -- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6990 msgr2=0x563dc6a685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6990 0x563dc6a685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 -- 172.21.15.119:0/743185543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc0d0890 con 0x563dc6a5c1c0 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fbfff640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6a61740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79ec026040 tx=0x7f79ec001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5a61a5521b4c72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 1 -- 172.21.15.119:0/743185543 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec02e620 con 0x563dc6a5c1c0 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dc6879c10 con 0x563dc6a5c1c0 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 1 -- 172.21.15.119:0/743185543 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79ec01d050 con 0x563dc6a5c1c0 2023-12-19T16:15:54.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 1 -- 172.21.15.119:0/743185543 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79ec000f80 con 0x563dc6a5c1c0 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 10 client.4848 fetch_fsmap learned FSMap version 9 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563dc686f260 con 0x563dc6a5c1c0 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 1 -- 172.21.15.119:0/743185543 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563dc6879c10 con 0x563dc6a5c1c0 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 1 -- 172.21.15.119:0/743185543 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f79ec02e780 con 0x563dc6a5c1c0 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 10 client.4848 fetch_fsmap finished waiting for FSMap version 9 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 10 client.4848 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 20 client.4848 populate_metadata read hostname 'smithi119' 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aad8d0 0x563dc6aadcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 4 client.4848 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 --> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dc68a8a30 con 0x563dc6aad8d0 2023-12-19T16:15:54.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aad8d0 0x563dc6aadcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79daffd640 10 client.4848 ms_handle_connect on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.903+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aad8d0 0x563dc6aadcb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c521d4774cd10a server_cookie=120d237c70f54ba8 in_seq=0 out_seq=0 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f79daffd640 1 -- 172.21.15.119:0/743185543 <== mds.0 v2:172.21.15.119:6835/2766451211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563dc68a8a30 con 0x563dc6aad8d0 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f79daffd640 10 client.4848 handle_command_reply: tid=0 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 client.4848 shutdown 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 msgr2=0x563dc6a61740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6a61740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79ec026040 tx=0x7f79ec001b90 comp rx=0 tx=0).stop 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 shutdown_connections 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aad8d0 0x563dc6aadcb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6990 0x563dc6a685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6aa6070 0x563dc6a68080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f79daffd640 0 client.4848 ms_handle_reset on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 --2- 172.21.15.119:0/743185543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6a61740 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 >> 172.21.15.119:0/743185543 conn(0x563dc6a62950 msgr2=0x563dc6a5ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 shutdown_connections 2023-12-19T16:15:54.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 1 -- 172.21.15.119:0/743185543 wait complete. 2023-12-19T16:15:54.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.907+0000 7f7a0588b000 20 client.4848 trim_cache size 0 max 16384 2023-12-19T16:15:54.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.919+0000 7f7a0588b000 1 Processor -- start 2023-12-19T16:15:54.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.919+0000 7f7a0588b000 1 -- start start 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6afded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6afe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6070 0x563dc6afe950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc6567940 con 0x563dc6a5c1c0 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc697ab30 con 0x563dc6aa6070 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dc689f1f0 con 0x563dc6a62950 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6afe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6afe410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56730/0 (socket says 172.21.15.119:56730) 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 -- 172.21.15.119:0/1913792567 learned_addr learned my addr 172.21.15.119:0/1913792567 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6afded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6070 0x563dc6afe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 -- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 msgr2=0x563dc6afded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6afded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 -- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6070 msgr2=0x563dc6afe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6070 0x563dc6afe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 -- 172.21.15.119:0/1913792567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dc68553b0 con 0x563dc6a5c1c0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fbfff640 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6afded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6afe410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79f0001230 tx=0x7f79f0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b0d907723109a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79e27fc640 1 -- 172.21.15.119:0/1913792567 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f001c040 con 0x563dc6a5c1c0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79e27fc640 1 -- 172.21.15.119:0/1913792567 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f001e2b0 con 0x563dc6a5c1c0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f79e27fc640 1 -- 172.21.15.119:0/1913792567 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f001e420 con 0x563dc6a5c1c0 2023-12-19T16:15:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- 172.21.15.119:0/1913792567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 msgr2=0x563dc6afe410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6afe410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79f0001230 tx=0x7f79f0009040 comp rx=0 tx=0).stop 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- 172.21.15.119:0/1913792567 shutdown_connections 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6aa6070 0x563dc6afe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6a5c1c0 0x563dc6afe410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 --2- 172.21.15.119:0/1913792567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6afded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- 172.21.15.119:0/1913792567 >> 172.21.15.119:0/1913792567 conn(0x563dc6a61d50 msgr2=0x563dc6a67f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- 172.21.15.119:0/1913792567 shutdown_connections 2023-12-19T16:15:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- 172.21.15.119:0/1913792567 wait complete. 2023-12-19T16:15:54.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 -- start start 2023-12-19T16:15:54.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.923+0000 7f7a0588b000 1 Processor -- start 2023-12-19T16:15:54.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6ab7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6ab80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6ab8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc68a5a50 con 0x563dc6aa6070 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc6a539d0 con 0x563dc6a5c1c0 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dc68edce0 con 0x563dc6a62950 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 10 client.0 _ll_register_callbacks cb 0x563dc6858640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6ab8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6ab8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56744/0 (socket says 172.21.15.119:56744) 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 -- 172.21.15.119:0/3632004895 learned_addr learned my addr 172.21.15.119:0/3632004895 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79fbfff640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6ab7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79fb7fe640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6ab80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 -- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 msgr2=0x563dc6ab80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6ab80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 -- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 msgr2=0x563dc6ab7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6ab7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 -- 172.21.15.119:0/3632004895 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc0d0310 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a00ac2640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6ab8600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79f4002240 tx=0x7f79f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57801d835a2432dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 1 -- 172.21.15.119:0/3632004895 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40f6540 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 1 -- 172.21.15.119:0/3632004895 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79f40edb00 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dc686fe00 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 1 -- 172.21.15.119:0/3632004895 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79f411b0a0 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 10 client.4854 fetch_fsmap learned FSMap version 9 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563dc65a6cc0 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 1 -- 172.21.15.119:0/3632004895 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563dc686fe00 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 1 -- 172.21.15.119:0/3632004895 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f79f4005d20 con 0x563dc6aa6070 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 10 client.4854 fetch_fsmap finished waiting for FSMap version 9 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 10 client.4854 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T16:15:54.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 20 client.4854 populate_metadata read hostname 'smithi119' 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aa6990 0x563dc6ab8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 4 client.4854 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 --> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563dc68a3160 con 0x563dc6aa6990 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79fbfff640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aa6990 0x563dc6ab8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79fbfff640 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aa6990 0x563dc6ab8b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a85351614ac59af server_cookie=17955e3c40668cd5 in_seq=0 out_seq=0 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 10 client.4854 ms_handle_connect on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 1 -- 172.21.15.119:0/3632004895 <== mds.0 v2:172.21.15.119:6835/2766451211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563dc68a3160 con 0x563dc6aa6990 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 10 client.4854 handle_command_reply: tid=0 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 client.4854 shutdown 2023-12-19T16:15:54.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 msgr2=0x563dc6ab8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6ab8600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79f4002240 tx=0x7f79f400b040 comp rx=0 tx=0).stop 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 shutdown_connections 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:6835/2766451211,v1:172.21.15.119:6837/2766451211] conn(0x563dc6aa6990 0x563dc6ab8b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dc6aa6070 0x563dc6ab8600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563dc6a62950 0x563dc6ab80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f79daffd640 0 client.4854 ms_handle_reset on v2:172.21.15.119:6835/2766451211 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 --2- 172.21.15.119:0/3632004895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563dc6a5c1c0 0x563dc6ab7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 >> 172.21.15.119:0/3632004895 conn(0x563dc6a61d50 msgr2=0x563dc6a67f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 shutdown_connections 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 1 -- 172.21.15.119:0/3632004895 wait complete. 2023-12-19T16:15:54.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.927+0000 7f7a0588b000 20 client.4854 trim_cache size 0 max 16384 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "95401411-8d68-4720-80be-89deeb6bcc32", 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4278, 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 34.370550688999998, 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 9, 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 24, 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 24, 2023-12-19T16:15:54.938 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 40.954063040999998 2023-12-19T16:15:54.939 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:15:54.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f79e8065a90 msgr2=0x7f79e8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f79e8065a90 0x7f79e8067f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c10 tx=0x7f79ec009040 comp rx=0 tx=0).stop 2023-12-19T16:15:54.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 msgr2=0x7f79fc15e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 0x7f79fc15e4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79f40b0040 tx=0x7f79f4009750 comp rx=0 tx=0).stop 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 shutdown_connections 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f79e8065a90 0x7f79e8067f50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79fc0c8430 0x7f79fc0c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79fc15e020 0x7f79fc15e4a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 --2- 172.21.15.119:0/1753598861 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79e4004d10 0x7f79fc157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 >> 172.21.15.119:0/1753598861 conn(0x7f79fc089fb0 msgr2=0x7f79fc0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 shutdown_connections 2023-12-19T16:15:54.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:54.931+0000 7f7a02525640 1 -- 172.21.15.119:0/1753598861 wait complete. 2023-12-19T16:15:54.952 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-19T16:15:54.962 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-19T16:15:54.963 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-19T16:15:54.963 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-19T16:15:54.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:54.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:54.963 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-19T16:15:54.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:54.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:54.963 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-19T16:15:54.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:54.964 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:54.964 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-19T16:15:54.964 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:54.964 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T16:15:54.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.964 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-19T16:15:54.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.976 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-12-19T16:15:55.043 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2023-12-19T16:15:55.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:15:55.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.046 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:15:55.056 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-19T16:15:55.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.057 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-19T16:15:55.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-12-19T16:15:55.291 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-19T16:15:55.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:55.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 Processor -- start 2023-12-19T16:15:55.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 -- start start 2023-12-19T16:15:55.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f839815a680 0x7f839815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f839806fdb0 0x7f8398070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839815f100 con 0x7f83980cac10 2023-12-19T16:15:55.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8398070780 con 0x7f839806fdb0 2023-12-19T16:15:55.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f839dbf0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980ca7d0 con 0x7f839815a680 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f839806fdb0 0x7f8398070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f839806fdb0 0x7f8398070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56748/0 (socket says 172.21.15.119:56748) 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 -- 172.21.15.119:0/3235786815 learned_addr learned my addr 172.21.15.119:0/3235786815 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f83977fe640 1 --2- 172.21.15.119:0/3235786815 >> v2:172.21.15.143:3300/0 conn(0x7f839815a680 0x7f839815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 -- 172.21.15.119:0/3235786815 >> v2:172.21.15.143:3300/0 conn(0x7f839815a680 msgr2=0x7f839815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 --2- 172.21.15.119:0/3235786815 >> v2:172.21.15.143:3300/0 conn(0x7f839815a680 0x7f839815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 -- 172.21.15.119:0/3235786815 >> v1:172.21.15.143:6789/0 conn(0x7f83980cac10 legacy=0x7f839815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.427+0000 7f8397fff640 1 -- 172.21.15.119:0/3235786815 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839815e860 con 0x7f839806fdb0 2023-12-19T16:15:55.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f8397fff640 1 --2- 172.21.15.119:0/3235786815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839806fdb0 0x7f8398070240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8390009e50 tx=0x7f839001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a2e6cea9334cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:55.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f83967fc640 1 -- 172.21.15.119:0/3235786815 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900a5800 con 0x7f839806fdb0 2023-12-19T16:15:55.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f83967fc640 1 -- 172.21.15.119:0/3235786815 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900a5960 con 0x7f839806fdb0 2023-12-19T16:15:55.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f83967fc640 1 -- 172.21.15.119:0/3235786815 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900a5cf0 con 0x7f839806fdb0 2023-12-19T16:15:55.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 -- 172.21.15.119:0/3235786815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839806fdb0 msgr2=0x7f8398070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 --2- 172.21.15.119:0/3235786815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839806fdb0 0x7f8398070240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8390009e50 tx=0x7f839001c940 comp rx=0 tx=0).stop 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 -- 172.21.15.119:0/3235786815 shutdown_connections 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 --2- 172.21.15.119:0/3235786815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839806fdb0 0x7f8398070240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 --2- 172.21.15.119:0/3235786815 >> v2:172.21.15.143:3300/0 conn(0x7f839815a680 0x7f839815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 -- 172.21.15.119:0/3235786815 >> 172.21.15.119:0/3235786815 conn(0x7f839806a3e0 msgr2=0x7f83980afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 -- 172.21.15.119:0/3235786815 shutdown_connections 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.431+0000 7f839dbf0640 1 -- 172.21.15.119:0/3235786815 wait complete. 2023-12-19T16:15:55.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 Processor -- start 2023-12-19T16:15:55.437 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 -- start start 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f839806fdb0 0x7f83981598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 0x7f839815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f839815a680 0x7f8398158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980c1e90 con 0x7f83980cac10 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980c2170 con 0x7f839806fdb0 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980c2450 con 0x7f839815a680 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 0x7f839815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 0x7f839815c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56750/0 (socket says 172.21.15.119:56750) 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 -- 172.21.15.119:0/1889987672 learned_addr learned my addr 172.21.15.119:0/1889987672 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f83977fe640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f839806fdb0 0x7f83981598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8397fff640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f839815a680 0x7f8398158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 -- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f839815a680 msgr2=0x7f8398158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f839815a680 0x7f8398158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 -- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f839806fdb0 msgr2=0x7f83981598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f839806fdb0 0x7f83981598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 -- 172.21.15.119:0/1889987672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009b30 con 0x7f83980cac10 2023-12-19T16:15:55.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8397fff640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f839815a680 0x7f8398158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f8396ffd640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 0x7f839815c7d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c370 tx=0x7f838c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0052d0 con 0x7f83980cac10 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c005430 con 0x7f83980cac10 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c007260 con 0x7f83980cac10 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980c2730 con 0x7f83980cac10 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.435+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980c2cf0 con 0x7f83980cac10 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.439+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83980735b0 con 0x7f83980cac10 2023-12-19T16:15:55.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.439+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f838c0073c0 con 0x7f83980cac10 2023-12-19T16:15:55.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.439+0000 7f837ffff640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8384065a60 0x7f8384067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.439+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f838c082780 con 0x7f83980cac10 2023-12-19T16:15:55.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.439+0000 7f83977fe640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8384065a60 0x7f8384067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.439+0000 7f83977fe640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8384065a60 0x7f8384067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8388009ac0 tx=0x7f8388009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:55.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.443+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f838c04fef0 con 0x7f83980cac10 2023-12-19T16:15:55.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f839804e000 con 0x7f83980cac10 2023-12-19T16:15:55.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f837ffff640 1 -- 172.21.15.119:0/1889987672 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f838c053510 con 0x7f83980cac10 2023-12-19T16:15:55.631 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T16:15:55.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8384065a60 msgr2=0x7f8384067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8384065a60 0x7f8384067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8388009ac0 tx=0x7f8388009190 comp rx=0 tx=0).stop 2023-12-19T16:15:55.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 msgr2=0x7f839815c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 0x7f839815c7d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c370 tx=0x7f838c00c830 comp rx=0 tx=0).stop 2023-12-19T16:15:55.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 shutdown_connections 2023-12-19T16:15:55.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8384065a60 0x7f8384067f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f839815a680 0x7f8398158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83980cac10 0x7f839815c7d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 --2- 172.21.15.119:0/1889987672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f839806fdb0 0x7f83981598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.627+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 >> 172.21.15.119:0/1889987672 conn(0x7f839806a3e0 msgr2=0x7f8398164d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:55.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.631+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 shutdown_connections 2023-12-19T16:15:55.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:55.631+0000 7f839dbf0640 1 -- 172.21.15.119:0/1889987672 wait complete. 2023-12-19T16:15:55.651 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:55.652 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:15:55.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.653 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:15:55.663 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.665 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T16:15:55.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.665 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:55.665 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:55.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2023-12-19T16:15:55.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2023-12-19T16:15:55.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2023-12-19T16:15:55.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T16:15:55.666 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:55.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.778 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:55.797 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:15:55.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.800 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:15:55.850 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:55.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.852 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:55.852 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:55.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:55.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:55.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:55.852 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:55.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.947 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:15:55.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.958 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-12-19T16:15:56.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.014 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:56.014 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:56.014 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:15:56.014 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T16:15:56.014 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:56.095 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T16:15:56.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.095 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:56.095 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:56.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T16:15:56.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T16:15:56.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T16:15:56.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T16:15:56.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T16:15:56.096 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:56.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.236 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:56.236 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:56.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:15:56.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T16:15:56.236 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:56.277 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:15:56.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:56.277 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:56.329 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:15:56.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:56.329 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:56.380 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:56.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:56.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:56.512 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:56.514 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:56.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.515 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:56.564 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:15:56.565 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:15:56.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:56.634 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:56.634 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:56.698 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:56.699 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:56.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.699 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:56.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:15:56.703+0000 7f6a0ece2580 -1 init, newargv = 0x55ce3b869fd0 newargc=15 2023-12-19T16:15:56.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[46308]: starting ceph client 2023-12-19T16:15:56.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[46308]: starting fuse 2023-12-19T16:15:56.719 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:15:56.720 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:15:56.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:15:56.720 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:15:56.720 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:15:56.720 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:15:56.721 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:56.722 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:15:56.722 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:15:56.722 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:15:56.722 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:15:56.722 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:56.722 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:15:56.723 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:15:56.724 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:56.724 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:15:56.724 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:15:56.842 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.46308.asok 2023-12-19T16:15:57.028 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46308.asok 2023-12-19T16:15:57.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.028 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46308.asok status 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "46308", 2023-12-19T16:15:57.196 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4866, 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4866 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1420470471 2023-12-19T16:15:57.197 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1420470471 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4866 192.168.0.1:0/1420470471", 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/1420470471", 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 9, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 24, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:15:57.198 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:15:57.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:57.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.347+0000 7f410f36d640 1 Processor -- start 2023-12-19T16:15:57.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.347+0000 7f410f36d640 1 -- start start 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410f36d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f410815a680 0x7f410815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410f36d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410815f100 con 0x7f41080cac10 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410f36d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41080ca7d0 con 0x7f410806fdb0 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410f36d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410815e860 con 0x7f410815a680 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410c908640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f41080cac10 0x7f410815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35644/0 (socket says 172.21.15.119:35644) 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410c908640 1 -- 172.21.15.119:0/1849834499 learned_addr learned my addr 172.21.15.119:0/1849834499 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410d109640 1 --2- 172.21.15.119:0/1849834499 >> v2:172.21.15.119:3300/0 conn(0x7f410815a680 0x7f410815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410d109640 1 -- 172.21.15.119:0/1849834499 >> v1:172.21.15.143:6789/0 conn(0x7f410806fdb0 legacy=0x7f41080c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410d109640 1 -- 172.21.15.119:0/1849834499 >> v1:172.21.15.119:6789/0 conn(0x7f41080cac10 legacy=0x7f410815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f410d109640 1 -- 172.21.15.119:0/1849834499 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410815eb40 con 0x7f410815a680 2023-12-19T16:15:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.351+0000 7f40fffff640 1 -- 172.21.15.119:0/1849834499 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201219198 0 0) 0x7f410815f100 con 0x7f41080cac10 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410d109640 1 --2- 172.21.15.119:0/1849834499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410815a680 0x7f410815e160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f41040097f0 tx=0x7f410401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4a3f3955d20900 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f40fffff640 1 -- 172.21.15.119:0/1849834499 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040ac410 con 0x7f410815a680 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f40fffff640 1 -- 172.21.15.119:0/1849834499 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41040ac570 con 0x7f410815a680 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f40fffff640 1 -- 172.21.15.119:0/1849834499 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040ac900 con 0x7f410815a680 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 -- 172.21.15.119:0/1849834499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410815a680 msgr2=0x7f410815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 --2- 172.21.15.119:0/1849834499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410815a680 0x7f410815e160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f41040097f0 tx=0x7f410401c3b0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 -- 172.21.15.119:0/1849834499 shutdown_connections 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 --2- 172.21.15.119:0/1849834499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410815a680 0x7f410815e160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 -- 172.21.15.119:0/1849834499 >> 172.21.15.119:0/1849834499 conn(0x7f410806a3e0 msgr2=0x7f41080afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 -- 172.21.15.119:0/1849834499 shutdown_connections 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 -- 172.21.15.119:0/1849834499 wait complete. 2023-12-19T16:15:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 Processor -- start 2023-12-19T16:15:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.355+0000 7f410f36d640 1 -- start start 2023-12-19T16:15:57.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410806fdb0 0x7f4108158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 0x7f4108151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410815a680 0x7f4108152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108154750 con 0x7f41080cac10 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080c2ef0 con 0x7f410806fdb0 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41081580e0 con 0x7f410815a680 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 0x7f4108151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 0x7f4108151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56770/0 (socket says 172.21.15.119:56770) 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 -- 172.21.15.119:0/2342369811 learned_addr learned my addr 172.21.15.119:0/2342369811 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410d109640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410806fdb0 0x7f4108158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410d90a640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410815a680 0x7f4108152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 -- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410815a680 msgr2=0x7f4108152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410815a680 0x7f4108152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 -- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410806fdb0 msgr2=0x7f4108158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410806fdb0 0x7f4108158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 -- 172.21.15.119:0/2342369811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4104009420 con 0x7f41080cac10 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410d90a640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410815a680 0x7f4108152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410c908640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 0x7f4108151e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40f80011f0 tx=0x7f40f800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f80074e0 con 0x7f41080cac10 2023-12-19T16:15:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f8007640 con 0x7f41080cac10 2023-12-19T16:15:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8004a10 con 0x7f41080cac10 2023-12-19T16:15:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41081583c0 con 0x7f41080cac10 2023-12-19T16:15:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41080c2b80 con 0x7f41080cac10 2023-12-19T16:15:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41080735b0 con 0x7f41080cac10 2023-12-19T16:15:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.359+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40f8004b70 con 0x7f41080cac10 2023-12-19T16:15:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.363+0000 7f40fdffb640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40ec065a90 0x7f40ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.363+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40f80825c0 con 0x7f41080cac10 2023-12-19T16:15:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.363+0000 7f410d109640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40ec065a90 0x7f40ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.363+0000 7f410d109640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40ec065a90 0x7f40ec067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41040ae000 tx=0x7f4104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.367+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f40f804fd30 con 0x7f41080cac10 2023-12-19T16:15:57.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f410804e000 con 0x7f41080cac10 2023-12-19T16:15:57.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f40fdffb640 1 -- 172.21.15.119:0/2342369811 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f40f8053350 con 0x7f41080cac10 2023-12-19T16:15:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T16:15:57.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40ec065a90 msgr2=0x7f40ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40ec065a90 0x7f40ec067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41040ae000 tx=0x7f4104008040 comp rx=0 tx=0).stop 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 msgr2=0x7f4108151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 0x7f4108151e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40f80011f0 tx=0x7f40f800c9b0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 shutdown_connections 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40ec065a90 0x7f40ec067f50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410815a680 0x7f4108152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41080cac10 0x7f4108151e30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 --2- 172.21.15.119:0/2342369811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410806fdb0 0x7f4108158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 >> 172.21.15.119:0/2342369811 conn(0x7f410806a3e0 msgr2=0x7f410815c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 shutdown_connections 2023-12-19T16:15:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:57.547+0000 7f410f36d640 1 -- 172.21.15.119:0/2342369811 wait complete. 2023-12-19T16:15:57.570 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:57.571 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-19T16:15:57.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.571 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:15:57.582 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:57.582 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:57.582 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:57.582 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.582 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:57.582 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42401sec preferred_lft 42401sec 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.583 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:15:57.584 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.585 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:57.642 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:15:57.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.644 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:57.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.700 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:57.700 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:57.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:57.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:57.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:57.700 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:57.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.790 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:15:57.799 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:15:57.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.800 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-12-19T16:15:57.848 INFO:teuthology.orchestra.run.smithi119.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-19T16:15:57.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.850 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:57.850 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:57.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:15:57.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-19T16:15:57.850 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:57.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether d6:66:d5:41:71:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.993 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::d466:d5ff:fe41:71f2/64 scope link 2023-12-19T16:15:57.994 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.995 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether d6:66:d5:41:71:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::d466:d5ff:fe41:71f2/64 scope link 2023-12-19T16:15:58.057 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.059 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-19T16:15:58.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-19T16:15:58.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-19T16:15:58.060 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:58.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.201 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:15:58.202 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:15:58.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.1 up 2023-12-19T16:15:58.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T16:15:58.202 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:15:58.241 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-19T16:15:58.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:58.241 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:58.293 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-19T16:15:58.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:58.294 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:58.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:58.409 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:58.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:58.475 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:58.477 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:58.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.477 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:58.530 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:15:58.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-19T16:15:58.530 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-19T16:15:58.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:15:58.598 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:15:58.598 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:15:58.659 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:15:58.661 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:15:58.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.662 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:15:58.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:2023-12-19T16:15:58.667+0000 7fcb923cb580 -1 init, newargv = 0x5591dad37110 newargc=15 2023-12-19T16:15:58.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:ceph-fuse[46442]: starting ceph client 2023-12-19T16:15:58.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:ceph-fuse[46442]: starting fuse 2023-12-19T16:15:58.680 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:15:58.681 INFO:teuthology.orchestra.run.smithi119.stdout:44 2023-12-19T16:15:58.681 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-19T16:15:58.681 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:15:58.682 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.2")) 2023-12-19T16:15:58.683 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:15:58.806 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.2.46442.asok 2023-12-19T16:15:58.991 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46442.asok 2023-12-19T16:15:58.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.992 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46442.asok status 2023-12-19T16:15:59.160 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:15:59.160 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:15:59.160 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:15:59.160 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "2", 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "46442", 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:59.161 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4881, 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4881 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 795008534 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:15:59.163 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 795008534 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4881 192.168.0.2:0/795008534", 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.2:0/795008534", 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:15:59.164 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 9, 2023-12-19T16:15:59.165 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 24, 2023-12-19T16:15:59.165 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:15:59.166 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:15:59.166 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:15:59.166 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:15:59.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 Processor -- start 2023-12-19T16:15:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 -- start start 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c15ca40 0x7fae8c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fae8c0ce3f0 0x7fae8c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fae8c0cf610 0x7fae8c1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c0cfa70 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c0d11c0 con 0x7fae8c0cf610 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9336d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0d0310 con 0x7fae8c15ca40 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fae8c0ce3f0 0x7fae8c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fae8c0ce3f0 0x7fae8c0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56778/0 (socket says 172.21.15.119:56778) 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 -- 172.21.15.119:0/2646033048 learned_addr learned my addr 172.21.15.119:0/2646033048 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae91109640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c15ca40 0x7fae8c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9190a640 1 --2- 172.21.15.119:0/2646033048 >> v2:172.21.15.143:3300/0 conn(0x7fae8c0cf610 0x7fae8c1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 -- 172.21.15.119:0/2646033048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c15ca40 msgr2=0x7fae8c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c15ca40 0x7fae8c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 -- 172.21.15.119:0/2646033048 >> v2:172.21.15.143:3300/0 conn(0x7fae8c0cf610 msgr2=0x7fae8c1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:59.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 --2- 172.21.15.119:0/2646033048 >> v2:172.21.15.143:3300/0 conn(0x7fae8c0cf610 0x7fae8c1605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae90908640 1 -- 172.21.15.119:0/2646033048 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0d05b0 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae91109640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c15ca40 0x7fae8c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:59.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.311+0000 7fae9190a640 1 --2- 172.21.15.119:0/2646033048 >> v2:172.21.15.143:3300/0 conn(0x7fae8c0cf610 0x7fae8c1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae90908640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0cf0d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0b52f0 tx=0x7fae7c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157801d19d9f12bb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae83fff640 1 -- 172.21.15.119:0/2646033048 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0ab600 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae83fff640 1 -- 172.21.15.119:0/2646033048 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c0a7050 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae83fff640 1 -- 172.21.15.119:0/2646033048 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0ab980 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 -- 172.21.15.119:0/2646033048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 msgr2=0x7fae8c0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0cf0d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0b52f0 tx=0x7fae7c01c240 comp rx=0 tx=0).stop 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 -- 172.21.15.119:0/2646033048 shutdown_connections 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 --2- 172.21.15.119:0/2646033048 >> v2:172.21.15.143:3300/0 conn(0x7fae8c0cf610 0x7fae8c1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0cf0d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 --2- 172.21.15.119:0/2646033048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c15ca40 0x7fae8c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 -- 172.21.15.119:0/2646033048 >> 172.21.15.119:0/2646033048 conn(0x7fae8c089fb0 msgr2=0x7fae8c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 -- 172.21.15.119:0/2646033048 shutdown_connections 2023-12-19T16:15:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.315+0000 7fae9336d640 1 -- 172.21.15.119:0/2646033048 wait complete. 2023-12-19T16:15:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 Processor -- start 2023-12-19T16:15:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 -- start start 2023-12-19T16:15:59.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c0cf610 0x7fae8c0c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae8c15ca40 0x7fae8c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0ca1c0 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c15d040 con 0x7fae8c15ca40 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c15d320 con 0x7fae8c0cf610 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56780/0 (socket says 172.21.15.119:56780) 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 -- 172.21.15.119:0/2628138050 learned_addr learned my addr 172.21.15.119:0/2628138050 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae90908640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c0cf610 0x7fae8c0c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9190a640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae8c15ca40 0x7fae8c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 -- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c0cf610 msgr2=0x7fae8c0c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c0cf610 0x7fae8c0c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 -- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae8c15ca40 msgr2=0x7fae8c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae8c15ca40 0x7fae8c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 -- 172.21.15.119:0/2628138050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009480 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae90908640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c0cf610 0x7fae8c0c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9190a640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae8c15ca40 0x7fae8c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae91109640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0c6250 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e7e0 tx=0x7fae8800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880059a0 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae88005b00 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88005e90 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c15d600 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.319+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c15dbc0 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.323+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c04e000 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.323+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae88004030 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.323+0000 7fae81ffb640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae70065a60 0x7fae70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:59.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.323+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae88083320 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.323+0000 7fae90908640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae70065a60 0x7fae70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:59.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.323+0000 7fae90908640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae70065a60 0x7fae70067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0ad000 tx=0x7fae7c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:59.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.327+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae88050950 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae8c0cff10 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae81ffb640 1 -- 172.21.15.119:0/2628138050 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fae88053f70 con 0x7fae8c0ce3f0 2023-12-19T16:15:59.514 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T16:15:59.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae70065a60 msgr2=0x7fae70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae70065a60 0x7fae70067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0ad000 tx=0x7fae7c0a6000 comp rx=0 tx=0).stop 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 msgr2=0x7fae8c0c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0c6250 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e7e0 tx=0x7fae8800eca0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 shutdown_connections 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae70065a60 0x7fae70067f20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae8c15ca40 0x7fae8c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae8c0cf610 0x7fae8c0c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 --2- 172.21.15.119:0/2628138050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae8c0ce3f0 0x7fae8c0c6250 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 >> 172.21.15.119:0/2628138050 conn(0x7fae8c089fb0 msgr2=0x7fae8c06b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 shutdown_connections 2023-12-19T16:15:59.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:15:59.511+0000 7fae9336d640 1 -- 172.21.15.119:0/2628138050 wait complete. 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:59.534 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T16:15:59.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.535 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-19T16:15:59.545 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:59.545 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:59.545 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:59.545 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:59.545 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:59.545 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-12-19T16:15:59.546 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-19T16:15:59.547 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:59.547 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:59.547 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:45:78:be:da brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:59.547 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:59.547 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:59.548 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T16:15:59.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.548 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:15:59.548 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:15:59.548 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2023-12-19T16:15:59.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2023-12-19T16:15:59.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2023-12-19T16:15:59.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T16:15:59.549 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:15:59.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.667 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:59.687 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-19T16:15:59.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.689 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-19T16:15:59.770 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:59.771 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:59.772 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:59.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.772 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:15:59.772 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:15:59.772 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:59.772 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:59.772 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:59.772 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:15:59.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.865 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-19T16:15:59.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.874 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2023-12-19T16:15:59.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.931 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:15:59.931 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:15:59.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T16:15:59.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-19T16:15:59.931 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:00.015 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-19T16:16:00.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-19T16:16:00.016 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:00.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.176 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:16:00.176 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:16:00.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-19T16:16:00.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T16:16:00.176 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:00.220 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-19T16:16:00.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:00.220 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T16:16:00.270 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T16:16:00.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:00.270 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T16:16:00.321 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2023-12-19T16:16:00.387 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:00.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:00.449 INFO:teuthology.orchestra.run.smithi143.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:00.450 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:00.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.451 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2023-12-19T16:16:00.502 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:16:00.502 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-19T16:16:00.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2023-12-19T16:16:00.570 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:00.570 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:00.637 INFO:teuthology.orchestra.run.smithi143.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:00.639 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:00.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.639 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2023-12-19T16:16:00.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:2023-12-19T16:16:00.651+0000 7ff8294ce580 -1 init, newargv = 0x5647fe254050 newargc=15 2023-12-19T16:16:00.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:ceph-fuse[43900]: starting ceph client 2023-12-19T16:16:00.667 INFO:teuthology.orchestra.run.smithi143.stdout:43 2023-12-19T16:16:00.668 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> import glob 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> import re 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> import os 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> import subprocess 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:00.668 DEBUG:teuthology.orchestra.run.smithi143:> def _find_admin_socket(client_name): 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> files = glob.glob(asok_path) 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> # Given a non-glob path, it better be there 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> if "*" not in asok_path: 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> assert(len(files) == 1) 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> return files[0] 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> for f in files: 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:16:00.669 DEBUG:teuthology.orchestra.run.smithi143:> contents = proc_f.read() 2023-12-19T16:16:00.670 DEBUG:teuthology.orchestra.run.smithi143:> if mountpoint in contents: 2023-12-19T16:16:00.670 DEBUG:teuthology.orchestra.run.smithi143:> return f 2023-12-19T16:16:00.670 DEBUG:teuthology.orchestra.run.smithi143:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:16:00.670 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:00.670 DEBUG:teuthology.orchestra.run.smithi143:> print(_find_admin_socket("client.1")) 2023-12-19T16:16:00.670 DEBUG:teuthology.orchestra.run.smithi143:> ' 2023-12-19T16:16:00.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:ceph-fuse[43900]: starting fuse 2023-12-19T16:16:00.789 INFO:teuthology.orchestra.run.smithi143.stdout:/var/run/ceph/ceph-client.1.43900.asok 2023-12-19T16:16:00.973 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43900.asok 2023-12-19T16:16:00.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.973 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43900.asok status 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "metadata": { 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "entity_id": "1", 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "hostname": "smithi143", 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-19T16:16:01.142 INFO:teuthology.orchestra.run.smithi143.stdout: "pid": "43900", 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "root": "/" 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_count": 0, 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_pinned_count": 0, 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4756, 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "inst": { 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "name": { 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "client", 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "num": 4756 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 2151814684 2023-12-19T16:16:01.143 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 2151814684 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "inst_str": "client.4756 192.168.0.1:0/2151814684", 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "addr_str": "192.168.0.1:0/2151814684", 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "inode_count": 1, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_epoch": 9, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch": 24, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "blocklisted": false, 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs" 2023-12-19T16:16:01.144 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-12-19T16:16:01.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:16:01.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d3b52640 1 Processor -- start 2023-12-19T16:16:01.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d3b52640 1 -- start start 2023-12-19T16:16:01.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d3b52640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d3b52640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0d11c0 con 0x7f39cc15ca40 2023-12-19T16:16:01.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d3b52640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0d0310 con 0x7f39cc0cf0d0 2023-12-19T16:16:01.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d3b52640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0d05b0 con 0x7f39cc0cf530 2023-12-19T16:16:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d18ee640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f39cc15ca40 0x7f39cc0cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35648/0 (socket says 172.21.15.119:35648) 2023-12-19T16:16:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d18ee640 1 -- 172.21.15.119:0/4285540014 learned_addr learned my addr 172.21.15.119:0/4285540014 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d20ef640 1 --2- 172.21.15.119:0/4285540014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d20ef640 1 -- 172.21.15.119:0/4285540014 >> v1:172.21.15.143:6789/0 conn(0x7f39cc0cf0d0 legacy=0x7f39cc1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d20ef640 1 -- 172.21.15.119:0/4285540014 >> v1:172.21.15.119:6789/0 conn(0x7f39cc15ca40 legacy=0x7f39cc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.299+0000 7f39d20ef640 1 -- 172.21.15.119:0/4285540014 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0d0890 con 0x7f39cc0cf530 2023-12-19T16:16:01.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.303+0000 7f39d20ef640 1 --2- 172.21.15.119:0/4285540014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc168000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009dc0 tx=0x7f39c401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65d24bac0bac53f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.303+0000 7f39d08ec640 1 -- 172.21.15.119:0/4285540014 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40a5a00 con 0x7f39cc0cf530 2023-12-19T16:16:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.303+0000 7f39d08ec640 1 -- 172.21.15.119:0/4285540014 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c40a5b60 con 0x7f39cc0cf530 2023-12-19T16:16:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.303+0000 7f39d08ec640 1 -- 172.21.15.119:0/4285540014 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40ad440 con 0x7f39cc0cf530 2023-12-19T16:16:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 -- 172.21.15.119:0/4285540014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 msgr2=0x7f39cc168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 --2- 172.21.15.119:0/4285540014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc168000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009dc0 tx=0x7f39c401c940 comp rx=0 tx=0).stop 2023-12-19T16:16:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 -- 172.21.15.119:0/4285540014 shutdown_connections 2023-12-19T16:16:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 --2- 172.21.15.119:0/4285540014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc168000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 -- 172.21.15.119:0/4285540014 >> 172.21.15.119:0/4285540014 conn(0x7f39cc089fb0 msgr2=0x7f39cc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 -- 172.21.15.119:0/4285540014 shutdown_connections 2023-12-19T16:16:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.307+0000 7f39d3b52640 1 -- 172.21.15.119:0/4285540014 wait complete. 2023-12-19T16:16:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 Processor -- start 2023-12-19T16:16:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 -- start start 2023-12-19T16:16:01.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39cc0cf0d0 0x7f39cc06b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc1fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 0x7f39cc1f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc06bbf0 con 0x7f39cc0cf0d0 2023-12-19T16:16:01.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc1f9c10 con 0x7f39cc15ca40 2023-12-19T16:16:01.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d3b52640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc1f9ef0 con 0x7f39cc0cf530 2023-12-19T16:16:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 0x7f39cc1f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 0x7f39cc1f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:47030/0 (socket says 172.21.15.119:47030) 2023-12-19T16:16:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 -- 172.21.15.119:0/3750620283 learned_addr learned my addr 172.21.15.119:0/3750620283 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d10ed640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc1fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d18ee640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39cc0cf0d0 0x7f39cc06b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 -- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 msgr2=0x7f39cc1fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc1fa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 -- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39cc0cf0d0 msgr2=0x7f39cc06b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.311+0000 7f39d20ef640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39cc0cf0d0 0x7f39cc06b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39d20ef640 1 -- 172.21.15.119:0/3750620283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4009a70 con 0x7f39cc15ca40 2023-12-19T16:16:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39d10ed640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc1fa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39d20ef640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 0x7f39cc1f9370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f39c401a570 tx=0x7f39c40196e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40aed00 con 0x7f39cc15ca40 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c40aee80 con 0x7f39cc15ca40 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc1fa1d0 con 0x7f39cc15ca40 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40b7650 con 0x7f39cc15ca40 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc1faa30 con 0x7f39cc15ca40 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.315+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc04e000 con 0x7f39cc15ca40 2023-12-19T16:16:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.319+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39c40b4050 con 0x7f39cc15ca40 2023-12-19T16:16:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.319+0000 7f39c27fc640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39b0065a60 0x7f39b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.319+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f39c411e900 con 0x7f39cc15ca40 2023-12-19T16:16:01.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.319+0000 7f39d18ee640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39b0065a60 0x7f39b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.319+0000 7f39d18ee640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39b0065a60 0x7f39b0067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39c80010f0 tx=0x7f39c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:01.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.323+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39c40ebff0 con 0x7f39cc15ca40 2023-12-19T16:16:01.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.507+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39cc0cca50 con 0x7f39cc15ca40 2023-12-19T16:16:01.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.507+0000 7f39c27fc640 1 -- 172.21.15.119:0/3750620283 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f39c40b2070 con 0x7f39cc15ca40 2023-12-19T16:16:01.511 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T16:16:01.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39b0065a60 msgr2=0x7f39b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39b0065a60 0x7f39b0067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39c80010f0 tx=0x7f39c8009040 comp rx=0 tx=0).stop 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 msgr2=0x7f39cc1f9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 0x7f39cc1f9370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f39c401a570 tx=0x7f39c40196e0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 shutdown_connections 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39b0065a60 0x7f39b0067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39cc15ca40 0x7f39cc1f9370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39cc0cf530 0x7f39cc1fa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 --2- 172.21.15.119:0/3750620283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39cc0cf0d0 0x7f39cc06b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 >> 172.21.15.119:0/3750620283 conn(0x7f39cc089fb0 msgr2=0x7f39cc0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 shutdown_connections 2023-12-19T16:16:01.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:01.511+0000 7f39d3b52640 1 -- 172.21.15.119:0/3750620283 wait complete. 2023-12-19T16:16:01.532 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:16:01.533 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-19T16:16:01.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.533 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-19T16:16:01.543 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:45:78:be:da brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:01.544 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-12-19T16:16:01.545 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.546 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:16:01.609 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-19T16:16:01.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.611 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-19T16:16:01.664 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-19T16:16:01.664 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:16:01.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.665 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:16:01.665 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:16:01.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:16:01.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:16:01.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:16:01.666 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:01.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.760 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-19T16:16:01.769 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T16:16:01.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.770 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2023-12-19T16:16:01.826 INFO:teuthology.orchestra.run.smithi143.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-19T16:16:01.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.827 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:16:01.827 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:16:01.827 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T16:16:01.827 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-19T16:16:01.827 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:01.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.908 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T16:16:01.970 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:01.970 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:15:e6:4d:81:76 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c15:e6ff:fe4d:8176/64 scope link 2023-12-19T16:16:01.971 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.973 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T16:16:02.038 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:15:e6:4d:81:76 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c15:e6ff:fe4d:8176/64 scope link 2023-12-19T16:16:02.039 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:02.040 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-19T16:16:02.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-19T16:16:02.041 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:02.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:02.179 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-19T16:16:02.180 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-19T16:16:02.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.1 up 2023-12-19T16:16:02.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T16:16:02.180 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-19T16:16:02.219 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-19T16:16:02.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:02.220 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:02.270 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-19T16:16:02.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:02.270 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:02.324 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2023-12-19T16:16:02.387 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:02.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:02.451 INFO:teuthology.orchestra.run.smithi143.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:02.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:02.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:02.454 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2023-12-19T16:16:02.506 INFO:teuthology.orchestra.run.smithi143.stdout:43 2023-12-19T16:16:02.506 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-19T16:16:02.506 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-19T16:16:02.552 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2023-12-19T16:16:02.574 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:02.574 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:02.636 INFO:teuthology.orchestra.run.smithi143.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:02.638 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:02.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:02.638 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2023-12-19T16:16:02.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi143.stderr:2023-12-19T16:16:02.643+0000 7fcd71ec1580 -1 init, newargv = 0x561938127e50 newargc=15 2023-12-19T16:16:02.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi143.stderr:ceph-fuse[44008]: starting ceph client 2023-12-19T16:16:02.656 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi143.stderr:ceph-fuse[44008]: starting fuse 2023-12-19T16:16:02.657 INFO:teuthology.orchestra.run.smithi143.stdout:43 2023-12-19T16:16:02.657 INFO:teuthology.orchestra.run.smithi143.stdout:44 2023-12-19T16:16:02.657 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-19T16:16:02.657 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:02.657 DEBUG:teuthology.orchestra.run.smithi143:> import glob 2023-12-19T16:16:02.657 DEBUG:teuthology.orchestra.run.smithi143:> import re 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> import os 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> import subprocess 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> def _find_admin_socket(client_name): 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> files = glob.glob(asok_path) 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> # Given a non-glob path, it better be there 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> if "*" not in asok_path: 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> assert(len(files) == 1) 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> return files[0] 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> for f in files: 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:16:02.658 DEBUG:teuthology.orchestra.run.smithi143:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> contents = proc_f.read() 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> if mountpoint in contents: 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> return f 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> print(_find_admin_socket("client.3")) 2023-12-19T16:16:02.659 DEBUG:teuthology.orchestra.run.smithi143:> ' 2023-12-19T16:16:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:/var/run/ceph/ceph-client.3.44008.asok 2023-12-19T16:16:02.961 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44008.asok 2023-12-19T16:16:02.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:02.961 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44008.asok status 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "metadata": { 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "entity_id": "3", 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "hostname": "smithi143", 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "pid": "44008", 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "root": "/" 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:03.129 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_count": 0, 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_pinned_count": 0, 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4670, 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "inst": { 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "name": { 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "client", 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "num": 4670 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.2:0", 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 4063367956 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: } 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2023-12-19T16:16:03.130 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.2:0", 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 4063367956 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "inst_str": "client.4670 192.168.0.2:0/4063367956", 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "addr_str": "192.168.0.2:0/4063367956", 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "inode_count": 1, 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_epoch": 9, 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch": 26, 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "blocklisted": false, 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs" 2023-12-19T16:16:03.131 INFO:teuthology.orchestra.run.smithi143.stdout:} 2023-12-19T16:16:03.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.144 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:16:03.144 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:03.155 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:16:03.155 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:03.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:03.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.218 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:16:03.218 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-19T16:16:03.269 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:16:03.269 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-19T16:16:03.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-19T16:16:03.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.338 DEBUG:teuthology.orchestra.run.smithi143:> stat --file-system '--printf=%T 2023-12-19T16:16:03.338 DEBUG:teuthology.orchestra.run.smithi143:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-19T16:16:03.347 INFO:teuthology.orchestra.run.smithi143.stdout:fuseblk 2023-12-19T16:16:03.348 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-19T16:16:03.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T16:16:03.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.410 DEBUG:teuthology.orchestra.run.smithi143:> stat --file-system '--printf=%T 2023-12-19T16:16:03.410 DEBUG:teuthology.orchestra.run.smithi143:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:03.463 INFO:teuthology.orchestra.run.smithi143.stdout:fuseblk 2023-12-19T16:16:03.463 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:03.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:03.463 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:03.530 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T16:16:03.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:03.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.691+0000 7f427ca8c640 1 Processor -- start 2023-12-19T16:16:03.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.691+0000 7f427ca8c640 1 -- start start 2023-12-19T16:16:03.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427ca8c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4278071d40 0x7f4278070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427ca8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806c1c0 0x7f42780c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427ca8c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780c8ab0 con 0x7f427806bde0 2023-12-19T16:16:03.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427ca8c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4278159b20 con 0x7f4278071d40 2023-12-19T16:16:03.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427ca8c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780cdf00 con 0x7f427806c1c0 2023-12-19T16:16:03.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4276d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806c1c0 0x7f42780c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427659c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f427806bde0 0x7f42780c1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:42410/0 (socket says 172.21.15.119:42410) 2023-12-19T16:16:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427659c640 1 -- 172.21.15.119:0/2410984720 learned_addr learned my addr 172.21.15.119:0/2410984720 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4275d9b640 1 --2- 172.21.15.119:0/2410984720 >> v2:172.21.15.143:3300/0 conn(0x7f4278071d40 0x7f4278070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427559a640 1 -- 172.21.15.119:0/2410984720 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471244649 0 0) 0x7f42780c8ab0 con 0x7f427806bde0 2023-12-19T16:16:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f427559a640 1 -- 172.21.15.119:0/2410984720 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260003530 con 0x7f427806bde0 2023-12-19T16:16:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4276d9d640 1 -- 172.21.15.119:0/2410984720 >> v2:172.21.15.143:3300/0 conn(0x7f4278071d40 msgr2=0x7f4278070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4276d9d640 1 --2- 172.21.15.119:0/2410984720 >> v2:172.21.15.143:3300/0 conn(0x7f4278071d40 0x7f4278070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4276d9d640 1 -- 172.21.15.119:0/2410984720 >> v1:172.21.15.143:6789/0 conn(0x7f427806bde0 legacy=0x7f42780c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4276d9d640 1 -- 172.21.15.119:0/2410984720 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780c8d90 con 0x7f427806c1c0 2023-12-19T16:16:03.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.695+0000 7f4275d9b640 1 --2- 172.21.15.119:0/2410984720 >> v2:172.21.15.143:3300/0 conn(0x7f4278071d40 0x7f4278070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f4276d9d640 1 --2- 172.21.15.119:0/2410984720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806c1c0 0x7f42780c9b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4270009dc0 tx=0x7f427001c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9770593044200067 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427559a640 1 -- 172.21.15.119:0/2410984720 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a57f0 con 0x7f427806c1c0 2023-12-19T16:16:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427559a640 1 -- 172.21.15.119:0/2410984720 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42700a5950 con 0x7f427806c1c0 2023-12-19T16:16:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427559a640 1 -- 172.21.15.119:0/2410984720 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a5ce0 con 0x7f427806c1c0 2023-12-19T16:16:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 -- 172.21.15.119:0/2410984720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806c1c0 msgr2=0x7f42780c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 --2- 172.21.15.119:0/2410984720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806c1c0 0x7f42780c9b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4270009dc0 tx=0x7f427001c930 comp rx=0 tx=0).stop 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 -- 172.21.15.119:0/2410984720 shutdown_connections 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 --2- 172.21.15.119:0/2410984720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806c1c0 0x7f42780c9b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 --2- 172.21.15.119:0/2410984720 >> v2:172.21.15.143:3300/0 conn(0x7f4278071d40 0x7f4278070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 -- 172.21.15.119:0/2410984720 >> 172.21.15.119:0/2410984720 conn(0x7f427806a2a0 msgr2=0x7f42780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 -- 172.21.15.119:0/2410984720 shutdown_connections 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 -- 172.21.15.119:0/2410984720 wait complete. 2023-12-19T16:16:03.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 Processor -- start 2023-12-19T16:16:03.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.699+0000 7f427ca8c640 1 -- start start 2023-12-19T16:16:03.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806bde0 0x7f427814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 0x7f4278166280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4278071d40 0x7f42780cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427814eaf0 con 0x7f427806c1c0 2023-12-19T16:16:03.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278158500 con 0x7f4278071d40 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42781587a0 con 0x7f427806bde0 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 0x7f4278166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 0x7f4278166280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60284/0 (socket says 172.21.15.119:60284) 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 -- 172.21.15.119:0/1924330042 learned_addr learned my addr 172.21.15.119:0/1924330042 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427659c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806bde0 0x7f427814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4276d9d640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4278071d40 0x7f42780cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 -- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806bde0 msgr2=0x7f427814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806bde0 0x7f427814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 -- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4278071d40 msgr2=0x7f42780cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4278071d40 0x7f42780cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 -- 172.21.15.119:0/1924330042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009420 con 0x7f427806c1c0 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4275d9b640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 0x7f4278166280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f426c00e980 tx=0x7f426c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00ca00 con 0x7f427806c1c0 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c00cb60 con 0x7f427806c1c0 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4270009a70 con 0x7f427806c1c0 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c013470 con 0x7f427806c1c0 2023-12-19T16:16:03.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4278158d60 con 0x7f427806c1c0 2023-12-19T16:16:03.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.703+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42780cd2a0 con 0x7f427806c1c0 2023-12-19T16:16:03.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.707+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f426c0135d0 con 0x7f427806c1c0 2023-12-19T16:16:03.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.707+0000 7f4266ffd640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4258065a60 0x7f4258067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.707+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f426c083bb0 con 0x7f427806c1c0 2023-12-19T16:16:03.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.707+0000 7f427659c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4258065a60 0x7f4258067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.707+0000 7f427659c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4258065a60 0x7f4258067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4268007ad0 tx=0x7f4268007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.711+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f426c051170 con 0x7f427806c1c0 2023-12-19T16:16:03.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.859+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f427804e000 con 0x7f427806c1c0 2023-12-19T16:16:03.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f4266ffd640 1 -- 172.21.15.119:0/1924330042 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f426c017090 con 0x7f427806c1c0 2023-12-19T16:16:03.866 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:03.866 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4258065a60 msgr2=0x7f4258067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4258065a60 0x7f4258067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4268007ad0 tx=0x7f4268007a40 comp rx=0 tx=0).stop 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 msgr2=0x7f4278166280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 0x7f4278166280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f426c00e980 tx=0x7f426c00ee40 comp rx=0 tx=0).stop 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 shutdown_connections 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4258065a60 0x7f4258067f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4278071d40 0x7f42780cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427806c1c0 0x7f4278166280 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 --2- 172.21.15.119:0/1924330042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f427806bde0 0x7f427814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 >> 172.21.15.119:0/1924330042 conn(0x7f427806a2a0 msgr2=0x7f42780cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 shutdown_connections 2023-12-19T16:16:03.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:03.863+0000 7f427ca8c640 1 -- 172.21.15.119:0/1924330042 wait complete. 2023-12-19T16:16:03.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:03.887 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:04.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f4487d25640 1 Processor -- start 2023-12-19T16:16:04.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f4487d25640 1 -- start start 2023-12-19T16:16:04.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f4487d25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f44800c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f4487d25640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800c9730 con 0x7f44800ceaa0 2023-12-19T16:16:04.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f4487d25640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800c8e00 con 0x7f44801598d0 2023-12-19T16:16:04.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f4487d25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800c90e0 con 0x7f4480153020 2023-12-19T16:16:04.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f44862c2640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f44800ceaa0 0x7f4480070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55240/0 (socket says 172.21.15.119:55240) 2023-12-19T16:16:04.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.023+0000 7f44862c2640 1 -- 172.21.15.119:0/3348661132 learned_addr learned my addr 172.21.15.119:0/3348661132 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4485ac1640 1 --2- 172.21.15.119:0/3348661132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f44800c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794413193 0 0) 0x7f44800c9730 con 0x7f44800ceaa0 2023-12-19T16:16:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c005740 con 0x7f44800ceaa0 2023-12-19T16:16:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915275805 0 0) 0x7f44800c8e00 con 0x7f44801598d0 2023-12-19T16:16:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44800c9730 con 0x7f44801598d0 2023-12-19T16:16:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4485ac1640 1 -- 172.21.15.119:0/3348661132 >> v1:172.21.15.143:6789/0 conn(0x7f44801598d0 legacy=0x7f44800ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4485ac1640 1 -- 172.21.15.119:0/3348661132 >> v1:172.21.15.119:6789/0 conn(0x7f44800ceaa0 legacy=0x7f4480070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4485ac1640 1 -- 172.21.15.119:0/3348661132 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800c93c0 con 0x7f4480153020 2023-12-19T16:16:04.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4485ac1640 1 --2- 172.21.15.119:0/3348661132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f44800c9bc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f447c0097f0 tx=0x7f447c01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb91d3ca77c2df1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0ab600 con 0x7f4480153020 2023-12-19T16:16:04.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0a7050 con 0x7f4480153020 2023-12-19T16:16:04.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.027+0000 7f4484abf640 1 -- 172.21.15.119:0/3348661132 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0ab980 con 0x7f4480153020 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- 172.21.15.119:0/3348661132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 msgr2=0x7f44800c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 --2- 172.21.15.119:0/3348661132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f44800c9bc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f447c0097f0 tx=0x7f447c01c340 comp rx=0 tx=0).stop 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- 172.21.15.119:0/3348661132 shutdown_connections 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 --2- 172.21.15.119:0/3348661132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f44800c9bc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- 172.21.15.119:0/3348661132 >> 172.21.15.119:0/3348661132 conn(0x7f448006a2a0 msgr2=0x7f44800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- 172.21.15.119:0/3348661132 shutdown_connections 2023-12-19T16:16:04.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- 172.21.15.119:0/3348661132 wait complete. 2023-12-19T16:16:04.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 Processor -- start 2023-12-19T16:16:04.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- start start 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 0x7f44800b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f4480070550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44801598d0 0x7f4480070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800b31b0 con 0x7f44800ceaa0 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800b1080 con 0x7f44801598d0 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4487d25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800b2370 con 0x7f4480153020 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 0x7f44800b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 0x7f44800b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60288/0 (socket says 172.21.15.119:60288) 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 -- 172.21.15.119:0/3268474653 learned_addr learned my addr 172.21.15.119:0/3268474653 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f44862c2640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44801598d0 0x7f4480070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f44852c0640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f4480070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 -- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 msgr2=0x7f4480070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f4480070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 -- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44801598d0 msgr2=0x7f4480070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44801598d0 0x7f4480070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.031+0000 7f4485ac1640 1 -- 172.21.15.119:0/3268474653 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c009420 con 0x7f44800ceaa0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f4485ac1640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 0x7f44800b2c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f447c018fb0 tx=0x7f447c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0b7450 con 0x7f44800ceaa0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0b75d0 con 0x7f44800ceaa0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0b7980 con 0x7f44800ceaa0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800b12d0 con 0x7f44800ceaa0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44800b1890 con 0x7f44800ceaa0 2023-12-19T16:16:04.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448004e000 con 0x7f44800ceaa0 2023-12-19T16:16:04.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f447c0b7ae0 con 0x7f44800ceaa0 2023-12-19T16:16:04.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44767fc640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4464065a60 0x7f4464067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f447c11dbb0 con 0x7f44800ceaa0 2023-12-19T16:16:04.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.035+0000 7f44852c0640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4464065a60 0x7f4464067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.039+0000 7f44852c0640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4464065a60 0x7f4464067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44800c8970 tx=0x7f4470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.039+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f447c0eb200 con 0x7f44800ceaa0 2023-12-19T16:16:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.187+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44800b3350 con 0x7f44800ceaa0 2023-12-19T16:16:04.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.187+0000 7f44767fc640 1 -- 172.21.15.119:0/3268474653 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f447c0bb0a0 con 0x7f44800ceaa0 2023-12-19T16:16:04.192 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:04.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4464065a60 msgr2=0x7f4464067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4464065a60 0x7f4464067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44800c8970 tx=0x7f4470009040 comp rx=0 tx=0).stop 2023-12-19T16:16:04.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 msgr2=0x7f44800b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 0x7f44800b2c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f447c018fb0 tx=0x7f447c01abe0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 shutdown_connections 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4464065a60 0x7f4464067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44801598d0 0x7f4480070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4480153020 0x7f4480070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 --2- 172.21.15.119:0/3268474653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44800ceaa0 0x7f44800b2c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 >> 172.21.15.119:0/3268474653 conn(0x7f448006a2a0 msgr2=0x7f44800ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 shutdown_connections 2023-12-19T16:16:04.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.191+0000 7f4487d25640 1 -- 172.21.15.119:0/3268474653 wait complete. 2023-12-19T16:16:04.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:04.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 Processor -- start 2023-12-19T16:16:04.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 -- start start 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7ad40cb000 0x7f7ad415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ad40cb3e0 0x7f7ad415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40b61f0 con 0x7f7ad415e8f0 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad415ee70 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.351+0000 7f7ad9979640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad415f150 con 0x7f7ad40cb000 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ad40cb3e0 0x7f7ad415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7ad9178640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7ad415e8f0 0x7f7ad40ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55252/0 (socket says 172.21.15.119:55252) 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ad40cb3e0 0x7f7ad415e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60296/0 (socket says 172.21.15.119:60296) 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7ad9178640 1 -- 172.21.15.119:0/2242358965 learned_addr learned my addr 172.21.15.119:0/2242358965 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7ad8977640 1 --2- 172.21.15.119:0/2242358965 >> v2:172.21.15.143:3300/0 conn(0x7f7ad40cb000 0x7f7ad415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 -- 172.21.15.119:0/2242358965 >> v2:172.21.15.143:3300/0 conn(0x7f7ad40cb000 msgr2=0x7f7ad415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:04.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 --2- 172.21.15.119:0/2242358965 >> v2:172.21.15.143:3300/0 conn(0x7f7ad40cb000 0x7f7ad415b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 -- 172.21.15.119:0/2242358965 >> v1:172.21.15.119:6789/0 conn(0x7f7ad415e8f0 legacy=0x7f7ad40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 -- 172.21.15.119:0/2242358965 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad415b0f0 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7ad8977640 1 --2- 172.21.15.119:0/2242358965 >> v2:172.21.15.143:3300/0 conn(0x7f7ad40cb000 0x7f7ad415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:04.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acbfff640 1 --2- 172.21.15.119:0/2242358965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad415e3b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40b2950 tx=0x7f7ac401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d33397f473b4d5f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acb7fe640 1 -- 172.21.15.119:0/2242358965 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40ab600 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acb7fe640 1 -- 172.21.15.119:0/2242358965 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40a7050 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.355+0000 7f7acb7fe640 1 -- 172.21.15.119:0/2242358965 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40ab980 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- 172.21.15.119:0/2242358965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 msgr2=0x7f7ad415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 --2- 172.21.15.119:0/2242358965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad415e3b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40b2950 tx=0x7f7ac401c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- 172.21.15.119:0/2242358965 shutdown_connections 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 --2- 172.21.15.119:0/2242358965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad415e3b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 --2- 172.21.15.119:0/2242358965 >> v2:172.21.15.143:3300/0 conn(0x7f7ad40cb000 0x7f7ad415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- 172.21.15.119:0/2242358965 >> 172.21.15.119:0/2242358965 conn(0x7f7ad4069ca0 msgr2=0x7f7ad406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- 172.21.15.119:0/2242358965 shutdown_connections 2023-12-19T16:16:04.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- 172.21.15.119:0/2242358965 wait complete. 2023-12-19T16:16:04.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 Processor -- start 2023-12-19T16:16:04.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- start start 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ad40cb000 0x7f7ad415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad40b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ad415e8f0 0x7f7ad4164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41649b0 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415d8b0 con 0x7f7ad415e8f0 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9979640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41643a0 con 0x7f7ad40cb000 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad40b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad40b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60310/0 (socket says 172.21.15.119:60310) 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 -- 172.21.15.119:0/4110472019 learned_addr learned my addr 172.21.15.119:0/4110472019 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:04.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad8977640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ad40cb000 0x7f7ad415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7ad9178640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ad415e8f0 0x7f7ad4164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 -- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ad40cb000 msgr2=0x7f7ad415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ad40cb000 0x7f7ad415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 -- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ad415e8f0 msgr2=0x7f7ad4164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ad415e8f0 0x7f7ad4164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.359+0000 7f7acbfff640 1 -- 172.21.15.119:0/4110472019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009420 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7acbfff640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad40b0fc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4019fd0 tx=0x7f7ac401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b37d0 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40b3930 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b3cc0 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad415d5d0 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad415e540 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad4164b60 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ac40b2070 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ac97fa640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7ac0065a60 0x7f7ac0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7ac411d790 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.363+0000 7f7ad8977640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7ac0065a60 0x7f7ac0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.367+0000 7f7ad8977640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7ac0065a60 0x7f7ac0067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00045f0 tx=0x7f7ad0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.367+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7ad4164b60 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.519+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ad4164b60 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.519+0000 7f7ac97fa640 1 -- 172.21.15.119:0/4110472019 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ad4164b60 con 0x7f7ad40cb3e0 2023-12-19T16:16:04.524 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:04.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7ac0065a60 msgr2=0x7f7ac0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7ac0065a60 0x7f7ac0067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00045f0 tx=0x7f7ad0008040 comp rx=0 tx=0).stop 2023-12-19T16:16:04.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 msgr2=0x7f7ad40b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad40b0fc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4019fd0 tx=0x7f7ac401abe0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 shutdown_connections 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7ac0065a60 0x7f7ac0067f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ad415e8f0 0x7f7ad4164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ad40cb3e0 0x7f7ad40b0fc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 --2- 172.21.15.119:0/4110472019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ad40cb000 0x7f7ad415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 >> 172.21.15.119:0/4110472019 conn(0x7f7ad4069ca0 msgr2=0x7f7ad406c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 shutdown_connections 2023-12-19T16:16:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.523+0000 7f7ad9979640 1 -- 172.21.15.119:0/4110472019 wait complete. 2023-12-19T16:16:04.544 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:04.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.683+0000 7f14808d0640 1 Processor -- start 2023-12-19T16:16:04.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.683+0000 7f14808d0640 1 -- start start 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f14808d0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f147c0cb810 0x7f147c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f14808d0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f147c06c1d0 0x7f147c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f14808d0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c15d8c0 con 0x7f147c06bdf0 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f14808d0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c15dba0 con 0x7f147c06c1d0 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f14808d0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c15de80 con 0x7f147c0cb810 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f147c06c1d0 0x7f147c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f147c06c1d0 0x7f147c14ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60314/0 (socket says 172.21.15.119:60314) 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 -- 172.21.15.119:0/1344546062 learned_addr learned my addr 172.21.15.119:0/1344546062 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:04.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147259c640 1 --2- 172.21.15.119:0/1344546062 >> v2:172.21.15.143:3300/0 conn(0x7f147c0cb810 0x7f147c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 -- 172.21.15.119:0/1344546062 >> v2:172.21.15.143:3300/0 conn(0x7f147c0cb810 msgr2=0x7f147c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:04.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 --2- 172.21.15.119:0/1344546062 >> v2:172.21.15.143:3300/0 conn(0x7f147c0cb810 0x7f147c15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 -- 172.21.15.119:0/1344546062 >> v1:172.21.15.143:6789/0 conn(0x7f147c06bdf0 legacy=0x7f147c0c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 -- 172.21.15.119:0/1344546062 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0c8880 con 0x7f147c06c1d0 2023-12-19T16:16:04.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.687+0000 7f147b59e640 1 --2- 172.21.15.119:0/1344546062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c06c1d0 0x7f147c14ff90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f147c0cd250 tx=0x7f147401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d224443550f832 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f147a59c640 1 -- 172.21.15.119:0/1344546062 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a57d0 con 0x7f147c06c1d0 2023-12-19T16:16:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f147a59c640 1 -- 172.21.15.119:0/1344546062 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740a5930 con 0x7f147c06c1d0 2023-12-19T16:16:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f147a59c640 1 -- 172.21.15.119:0/1344546062 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a5cc0 con 0x7f147c06c1d0 2023-12-19T16:16:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- 172.21.15.119:0/1344546062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c06c1d0 msgr2=0x7f147c14ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 --2- 172.21.15.119:0/1344546062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c06c1d0 0x7f147c14ff90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f147c0cd250 tx=0x7f147401c910 comp rx=0 tx=0).stop 2023-12-19T16:16:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- 172.21.15.119:0/1344546062 shutdown_connections 2023-12-19T16:16:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 --2- 172.21.15.119:0/1344546062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c06c1d0 0x7f147c14ff90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 --2- 172.21.15.119:0/1344546062 >> v2:172.21.15.143:3300/0 conn(0x7f147c0cb810 0x7f147c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- 172.21.15.119:0/1344546062 >> 172.21.15.119:0/1344546062 conn(0x7f147c06a2a0 msgr2=0x7f147c0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- 172.21.15.119:0/1344546062 shutdown_connections 2023-12-19T16:16:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- 172.21.15.119:0/1344546062 wait complete. 2023-12-19T16:16:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 Processor -- start 2023-12-19T16:16:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- start start 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f147c06bdf0 0x7f147c071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f147c06c1d0 0x7f147c151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 0x7f147c14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1535c0 con 0x7f147c0cb810 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1537f0 con 0x7f147c06bdf0 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.691+0000 7f14808d0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c153ad0 con 0x7f147c06c1d0 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 0x7f147c14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 0x7f147c14c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60316/0 (socket says 172.21.15.119:60316) 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 -- 172.21.15.119:0/1873384168 learned_addr learned my addr 172.21.15.119:0/1873384168 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147ad9d640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f147c06bdf0 0x7f147c071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147259c640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f147c06c1d0 0x7f147c151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 -- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f147c06c1d0 msgr2=0x7f147c151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f147c06c1d0 0x7f147c151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 -- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f147c06bdf0 msgr2=0x7f147c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f147c06bdf0 0x7f147c071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 -- 172.21.15.119:0/1873384168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009b30 con 0x7f147c0cb810 2023-12-19T16:16:04.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f147b59e640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 0x7f147c14c6c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1474019520 tx=0x7f14740196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740b8670 con 0x7f147c0cb810 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740b87d0 con 0x7f147c0cb810 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740b8b80 con 0x7f147c0cb810 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c153db0 con 0x7f147c0cb810 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c0c6bb0 con 0x7f147c0cb810 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c04e850 con 0x7f147c0cb810 2023-12-19T16:16:04.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14740b8ce0 con 0x7f147c0cb810 2023-12-19T16:16:04.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f1473fff640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.695+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f147411eb80 con 0x7f147c0cb810 2023-12-19T16:16:04.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.699+0000 7f147ad9d640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.699+0000 7f147ad9d640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b40e0 tx=0x7f1464009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.703+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14740ec320 con 0x7f147c0cb810 2023-12-19T16:16:04.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f147c0b4110 con 0x7f147c0cb810 2023-12-19T16:16:04.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f1473fff640 1 -- 172.21.15.119:0/1873384168 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14740ef940 con 0x7f147c0cb810 2023-12-19T16:16:04.854 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 msgr2=0x7f145c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b40e0 tx=0x7f1464009040 comp rx=0 tx=0).stop 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 msgr2=0x7f147c14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 0x7f147c14c6c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1474019520 tx=0x7f14740196b0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 shutdown_connections 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f145c065a60 0x7f145c067f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f147c0cb810 0x7f147c14c6c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f147c06c1d0 0x7f147c151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 --2- 172.21.15.119:0/1873384168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f147c06bdf0 0x7f147c071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 >> 172.21.15.119:0/1873384168 conn(0x7f147c06a2a0 msgr2=0x7f147c15b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 shutdown_connections 2023-12-19T16:16:04.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:04.851+0000 7f14808d0640 1 -- 172.21.15.119:0/1873384168 wait complete. 2023-12-19T16:16:04.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:05.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.011+0000 7f5ef7752640 1 Processor -- start 2023-12-19T16:16:05.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.011+0000 7f5ef7752640 1 -- start start 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.011+0000 7f5ef7752640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00ca410 0x7f5ef0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.011+0000 7f5ef7752640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ef00cbff0 0x7f5ef00cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef7752640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef0070df0 con 0x7f5ef0159fb0 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef7752640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef015aab0 con 0x7f5ef00cbff0 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef7752640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00cc980 con 0x7f5ef00ca410 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef5cef640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ef00cbff0 0x7f5ef00cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef54ee640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00ca410 0x7f5ef0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef4ced640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5ef0159fb0 0x7f5ef0071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:42432/0 (socket says 172.21.15.119:42432) 2023-12-19T16:16:05.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef4ced640 1 -- 172.21.15.119:0/3655733650 learned_addr learned my addr 172.21.15.119:0/3655733650 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef5cef640 1 -- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00ca410 msgr2=0x7f5ef0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef5cef640 1 --2- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00ca410 0x7f5ef0159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef5cef640 1 -- 172.21.15.119:0/3655733650 >> v1:172.21.15.143:6789/0 conn(0x7f5ef0159fb0 legacy=0x7f5ef0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef5cef640 1 -- 172.21.15.119:0/3655733650 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef015a4f0 con 0x7f5ef00cbff0 2023-12-19T16:16:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ee7fff640 1 -- 172.21.15.119:0/3655733650 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014393166 0 0) 0x7f5ef0070df0 con 0x7f5ef0159fb0 2023-12-19T16:16:05.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.015+0000 7f5ef5cef640 1 --2- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef00cbff0 0x7f5ef00cc440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009d90 tx=0x7f5ee801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4433895e168e6e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ee7fff640 1 -- 172.21.15.119:0/3655733650 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80a59e0 con 0x7f5ef00cbff0 2023-12-19T16:16:05.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ee7fff640 1 -- 172.21.15.119:0/3655733650 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee80a5b40 con 0x7f5ef00cbff0 2023-12-19T16:16:05.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ee7fff640 1 -- 172.21.15.119:0/3655733650 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80ad440 con 0x7f5ef00cbff0 2023-12-19T16:16:05.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef00cbff0 msgr2=0x7f5ef00cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 --2- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef00cbff0 0x7f5ef00cc440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009d90 tx=0x7f5ee801c920 comp rx=0 tx=0).stop 2023-12-19T16:16:05.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- 172.21.15.119:0/3655733650 shutdown_connections 2023-12-19T16:16:05.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 --2- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef00cbff0 0x7f5ef00cc440 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 --2- 172.21.15.119:0/3655733650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00ca410 0x7f5ef0159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- 172.21.15.119:0/3655733650 >> 172.21.15.119:0/3655733650 conn(0x7f5ef006a2a0 msgr2=0x7f5ef00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- 172.21.15.119:0/3655733650 shutdown_connections 2023-12-19T16:16:05.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- 172.21.15.119:0/3655733650 wait complete. 2023-12-19T16:16:05.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 Processor -- start 2023-12-19T16:16:05.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- start start 2023-12-19T16:16:05.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 0x7f5ef0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00cbff0 0x7f5ef00c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef0159fb0 0x7f5ef00c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00c2b10 con 0x7f5ef00ca410 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01516e0 con 0x7f5ef0159fb0 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef7752640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01541e0 con 0x7f5ef00cbff0 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef54ee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 0x7f5ef0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef54ee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 0x7f5ef0155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60330/0 (socket says 172.21.15.119:60330) 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.019+0000 7f5ef54ee640 1 -- 172.21.15.119:0/2578395285 learned_addr learned my addr 172.21.15.119:0/2578395285 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef5cef640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef0159fb0 0x7f5ef00c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef4ced640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00cbff0 0x7f5ef00c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef54ee640 1 -- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00cbff0 msgr2=0x7f5ef00c0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef54ee640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00cbff0 0x7f5ef00c0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef54ee640 1 -- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef0159fb0 msgr2=0x7f5ef00c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef54ee640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef0159fb0 0x7f5ef00c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef54ee640 1 -- 172.21.15.119:0/2578395285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009a70 con 0x7f5ef00ca410 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef5cef640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef0159fb0 0x7f5ef00c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef4ced640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00cbff0 0x7f5ef00c0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef54ee640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 0x7f5ef0155dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00e870 tx=0x7f5eec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec009510 con 0x7f5ef00ca410 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec00eec0 con 0x7f5ef00ca410 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00cae0 con 0x7f5ef00ca410 2023-12-19T16:16:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef0151930 con 0x7f5ef00ca410 2023-12-19T16:16:05.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef0151ef0 con 0x7f5ef00ca410 2023-12-19T16:16:05.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef004e000 con 0x7f5ef00ca410 2023-12-19T16:16:05.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5eec00cc40 con 0x7f5ef00ca410 2023-12-19T16:16:05.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.023+0000 7f5ee5ffb640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ed4065a90 0x7f5ed4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.027+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5eec0836e0 con 0x7f5ef00ca410 2023-12-19T16:16:05.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.027+0000 7f5ef4ced640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ed4065a90 0x7f5ed4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.027+0000 7f5ef4ced640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ed4065a90 0x7f5ed4067f50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00c88b0 tx=0x7f5ee0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.027+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5eec050bf0 con 0x7f5ef00ca410 2023-12-19T16:16:05.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5ef00ccc90 con 0x7f5ef00ca410 2023-12-19T16:16:05.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ee5ffb640 1 -- 172.21.15.119:0/2578395285 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5eec054210 con 0x7f5ef00ca410 2023-12-19T16:16:05.182 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:05.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ed4065a90 msgr2=0x7f5ed4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ed4065a90 0x7f5ed4067f50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00c88b0 tx=0x7f5ee0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 msgr2=0x7f5ef0155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 0x7f5ef0155dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00e870 tx=0x7f5eec00ec70 comp rx=0 tx=0).stop 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 shutdown_connections 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ed4065a90 0x7f5ed4067f50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ef0159fb0 0x7f5ef00c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ef00cbff0 0x7f5ef00c0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.179+0000 7f5ef7752640 1 --2- 172.21.15.119:0/2578395285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ef00ca410 0x7f5ef0155dd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.183+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 >> 172.21.15.119:0/2578395285 conn(0x7f5ef006a2a0 msgr2=0x7f5ef00acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.183+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 shutdown_connections 2023-12-19T16:16:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.183+0000 7f5ef7752640 1 -- 172.21.15.119:0/2578395285 wait complete. 2023-12-19T16:16:05.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:05.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 Processor -- start 2023-12-19T16:16:05.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 -- start start 2023-12-19T16:16:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f140cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9f140cd3a0 0x7f9f140cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1415cb10 con 0x7f9f1415c730 2023-12-19T16:16:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f140b65c0 con 0x7f9f140cd3a0 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19e2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140cd960 con 0x7f9f140cea00 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f140cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f140cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:56938/0 (socket says 172.21.15.119:56938) 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f18e28640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9f1415c730 0x7f9f140b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:42436/0 (socket says 172.21.15.119:42436) 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 -- 172.21.15.119:0/2709349928 learned_addr learned my addr 172.21.15.119:0/2709349928 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f19629640 1 --2- 172.21.15.119:0/2709349928 >> v2:172.21.15.143:3300/0 conn(0x7f9f140cd3a0 0x7f9f140cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 -- 172.21.15.119:0/2709349928 >> v2:172.21.15.143:3300/0 conn(0x7f9f140cd3a0 msgr2=0x7f9f140cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 --2- 172.21.15.119:0/2709349928 >> v2:172.21.15.143:3300/0 conn(0x7f9f140cd3a0 0x7f9f140cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 -- 172.21.15.119:0/2709349928 >> v1:172.21.15.143:6789/0 conn(0x7f9f1415c730 legacy=0x7f9f140b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f137fe640 1 -- 172.21.15.119:0/2709349928 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529254700 0 0) 0x7f9f1415cb10 con 0x7f9f1415c730 2023-12-19T16:16:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.343+0000 7f9f13fff640 1 -- 172.21.15.119:0/2709349928 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140cdc40 con 0x7f9f140cea00 2023-12-19T16:16:05.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f13fff640 1 --2- 172.21.15.119:0/2709349928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f140cef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009870 tx=0x7f9f0001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbe352dc237cf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f137fe640 1 -- 172.21.15.119:0/2709349928 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000a8a30 con 0x7f9f140cea00 2023-12-19T16:16:05.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f137fe640 1 -- 172.21.15.119:0/2709349928 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f000a8b90 con 0x7f9f140cea00 2023-12-19T16:16:05.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f137fe640 1 -- 172.21.15.119:0/2709349928 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000b0440 con 0x7f9f140cea00 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 -- 172.21.15.119:0/2709349928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 msgr2=0x7f9f140cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/2709349928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f140cef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009870 tx=0x7f9f0001ed30 comp rx=0 tx=0).stop 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 -- 172.21.15.119:0/2709349928 shutdown_connections 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/2709349928 >> v2:172.21.15.143:3300/0 conn(0x7f9f140cd3a0 0x7f9f140cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/2709349928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f140cef60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 -- 172.21.15.119:0/2709349928 >> 172.21.15.119:0/2709349928 conn(0x7f9f1406b120 msgr2=0x7f9f1406b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 -- 172.21.15.119:0/2709349928 shutdown_connections 2023-12-19T16:16:05.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.347+0000 7f9f19e2a640 1 -- 172.21.15.119:0/2709349928 wait complete. 2023-12-19T16:16:05.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 Processor -- start 2023-12-19T16:16:05.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- start start 2023-12-19T16:16:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 0x7f9f14151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f141f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f1415c730 0x7f9f140c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f141f2a80 con 0x7f9f140cd3a0 2023-12-19T16:16:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c8ca0 con 0x7f9f1415c730 2023-12-19T16:16:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14151920 con 0x7f9f140cea00 2023-12-19T16:16:05.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 0x7f9f14151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 0x7f9f14151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60344/0 (socket says 172.21.15.119:60344) 2023-12-19T16:16:05.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 -- 172.21.15.119:0/3714023278 learned_addr learned my addr 172.21.15.119:0/3714023278 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:05.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f13fff640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f141f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19629640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f1415c730 0x7f9f140c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 -- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 msgr2=0x7f9f141f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f141f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 -- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f1415c730 msgr2=0x7f9f140c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f1415c730 0x7f9f140c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 -- 172.21.15.119:0/3714023278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000094d0 con 0x7f9f140cd3a0 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19629640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f1415c730 0x7f9f140c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f18e28640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 0x7f9f14151280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800c450 tx=0x7f9f0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08007480 con 0x7f9f140cd3a0 2023-12-19T16:16:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08007600 con 0x7f9f140cd3a0 2023-12-19T16:16:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08004a30 con 0x7f9f140cd3a0 2023-12-19T16:16:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f14151c00 con 0x7f9f140cd3a0 2023-12-19T16:16:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f141521c0 con 0x7f9f140cd3a0 2023-12-19T16:16:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.351+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f14066c50 con 0x7f9f140cd3a0 2023-12-19T16:16:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.355+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9f08004b90 con 0x7f9f140cd3a0 2023-12-19T16:16:05.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.355+0000 7f9f117fa640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9ef8065a60 0x7f9ef8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.355+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9f080825d0 con 0x7f9f140cd3a0 2023-12-19T16:16:05.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.355+0000 7f9f13fff640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9ef8065a60 0x7f9ef8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.355+0000 7f9f13fff640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9ef8065a60 0x7f9ef8067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b2000 tx=0x7f9f00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.359+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9f0804fc20 con 0x7f9f140cd3a0 2023-12-19T16:16:05.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.511+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f1404e850 con 0x7f9f140cd3a0 2023-12-19T16:16:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f117fa640 1 -- 172.21.15.119:0/3714023278 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f9f08053240 con 0x7f9f140cd3a0 2023-12-19T16:16:05.517 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:05.517 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9ef8065a60 msgr2=0x7f9ef8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9ef8065a60 0x7f9ef8067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b2000 tx=0x7f9f00009040 comp rx=0 tx=0).stop 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 msgr2=0x7f9f14151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 0x7f9f14151280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800c450 tx=0x7f9f0800c910 comp rx=0 tx=0).stop 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 shutdown_connections 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9ef8065a60 0x7f9ef8067f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f1415c730 0x7f9f140c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f140cea00 0x7f9f141f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 --2- 172.21.15.119:0/3714023278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f140cd3a0 0x7f9f14151280 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 >> 172.21.15.119:0/3714023278 conn(0x7f9f1406b120 msgr2=0x7f9f1415b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 shutdown_connections 2023-12-19T16:16:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.515+0000 7f9f19e2a640 1 -- 172.21.15.119:0/3714023278 wait complete. 2023-12-19T16:16:05.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:05.538 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:05.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.674+0000 7f29e0f25640 1 Processor -- start 2023-12-19T16:16:05.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.674+0000 7f29e0f25640 1 -- start start 2023-12-19T16:16:05.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.674+0000 7f29e0f25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29dc0cc700 0x7f29dc071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.674+0000 7f29e0f25640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc070df0 con 0x7f29dc071870 2023-12-19T16:16:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.674+0000 7f29e0f25640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc15a4f0 con 0x7f29dc0ca410 2023-12-19T16:16:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.674+0000 7f29e0f25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc15aab0 con 0x7f29dc0cc700 2023-12-19T16:16:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29d9d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f29dc071870 0x7f29dc0cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55266/0 (socket says 172.21.15.119:55266) 2023-12-19T16:16:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29d9d9b640 1 -- 172.21.15.119:0/1780243524 learned_addr learned my addr 172.21.15.119:0/1780243524 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29dad9d640 1 --2- 172.21.15.119:0/1780243524 >> v2:172.21.15.119:3300/0 conn(0x7f29dc0cc700 0x7f29dc071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29d959a640 1 -- 172.21.15.119:0/1780243524 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261222457 0 0) 0x7f29dc070df0 con 0x7f29dc071870 2023-12-19T16:16:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29dad9d640 1 -- 172.21.15.119:0/1780243524 >> v1:172.21.15.143:6789/0 conn(0x7f29dc0ca410 legacy=0x7f29dc159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29dad9d640 1 -- 172.21.15.119:0/1780243524 >> v1:172.21.15.119:6789/0 conn(0x7f29dc071870 legacy=0x7f29dc0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29dad9d640 1 -- 172.21.15.119:0/1780243524 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc15a7d0 con 0x7f29dc0cc700 2023-12-19T16:16:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29dad9d640 1 --2- 172.21.15.119:0/1780243524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0cc700 0x7f29dc071d00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009d90 tx=0x7f29d401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf59e8ad5210dc1f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29d959a640 1 -- 172.21.15.119:0/1780243524 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40a59e0 con 0x7f29dc0cc700 2023-12-19T16:16:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29d959a640 1 -- 172.21.15.119:0/1780243524 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d40a5b40 con 0x7f29dc0cc700 2023-12-19T16:16:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.678+0000 7f29d959a640 1 -- 172.21.15.119:0/1780243524 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40ad440 con 0x7f29dc0cc700 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- 172.21.15.119:0/1780243524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0cc700 msgr2=0x7f29dc071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1780243524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0cc700 0x7f29dc071d00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009d90 tx=0x7f29d401c920 comp rx=0 tx=0).stop 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- 172.21.15.119:0/1780243524 shutdown_connections 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1780243524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0cc700 0x7f29dc071d00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- 172.21.15.119:0/1780243524 >> 172.21.15.119:0/1780243524 conn(0x7f29dc06a2a0 msgr2=0x7f29dc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- 172.21.15.119:0/1780243524 shutdown_connections 2023-12-19T16:16:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- 172.21.15.119:0/1780243524 wait complete. 2023-12-19T16:16:05.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 Processor -- start 2023-12-19T16:16:05.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- start start 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc071870 0x7f29dc1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 0x7f29dc0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29dc0ae290 0x7f29dc1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0af4d0 con 0x7f29dc0ca410 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1496e0 con 0x7f29dc071870 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29e0f25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0ae8c0 con 0x7f29dc0ae290 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29d9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 0x7f29dc0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29d9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 0x7f29dc0add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60358/0 (socket says 172.21.15.119:60358) 2023-12-19T16:16:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.682+0000 7f29d9d9b640 1 -- 172.21.15.119:0/1583110931 learned_addr learned my addr 172.21.15.119:0/1583110931 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:05.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29dad9d640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29dc0ae290 0x7f29dc1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29da59c640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc071870 0x7f29dc1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29d9d9b640 1 -- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29dc0ae290 msgr2=0x7f29dc1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29d9d9b640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29dc0ae290 0x7f29dc1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29d9d9b640 1 -- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc071870 msgr2=0x7f29dc1491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29d9d9b640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc071870 0x7f29dc1491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29d9d9b640 1 -- 172.21.15.119:0/1583110931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d4009a70 con 0x7f29dc0ca410 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29dad9d640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29dc0ae290 0x7f29dc1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29da59c640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc071870 0x7f29dc1491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29d9d9b640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 0x7f29dc0add50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c410 tx=0x7f29d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00074e0 con 0x7f29dc0ca410 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0007640 con 0x7f29dc0ca410 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc0aeba0 con 0x7f29dc0ca410 2023-12-19T16:16:05.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0004a30 con 0x7f29dc0ca410 2023-12-19T16:16:05.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc0af160 con 0x7f29dc0ca410 2023-12-19T16:16:05.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc0af320 con 0x7f29dc0ca410 2023-12-19T16:16:05.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f29d0004b90 con 0x7f29dc0ca410 2023-12-19T16:16:05.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.686+0000 7f29caffd640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29bc065a60 0x7f29bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.690+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f29d0083380 con 0x7f29dc0ca410 2023-12-19T16:16:05.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.690+0000 7f29da59c640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29bc065a60 0x7f29bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.690+0000 7f29da59c640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29bc065a60 0x7f29bc067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29cc000f70 tx=0x7f29cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.694+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f29d0050930 con 0x7f29dc0ca410 2023-12-19T16:16:05.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29dc0cbbb0 con 0x7f29dc0ca410 2023-12-19T16:16:05.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29caffd640 1 -- 172.21.15.119:0/1583110931 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29d0053f50 con 0x7f29dc0ca410 2023-12-19T16:16:05.846 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:05.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29bc065a60 msgr2=0x7f29bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29bc065a60 0x7f29bc067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29cc000f70 tx=0x7f29cc009040 comp rx=0 tx=0).stop 2023-12-19T16:16:05.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 msgr2=0x7f29dc0add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 0x7f29dc0add50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c410 tx=0x7f29d000c8d0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 shutdown_connections 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29bc065a60 0x7f29bc067f20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29dc0ae290 0x7f29dc1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29dc0ca410 0x7f29dc0add50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 --2- 172.21.15.119:0/1583110931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc071870 0x7f29dc1491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 >> 172.21.15.119:0/1583110931 conn(0x7f29dc06a2a0 msgr2=0x7f29dc158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 shutdown_connections 2023-12-19T16:16:05.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:05.842+0000 7f29e0f25640 1 -- 172.21.15.119:0/1583110931 wait complete. 2023-12-19T16:16:05.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:06.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.002+0000 7f09aa8d1640 1 Processor -- start 2023-12-19T16:16:06.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.002+0000 7f09aa8d1640 1 -- start start 2023-12-19T16:16:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.002+0000 7f09aa8d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f09a41582d0 0x7f09a40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.002+0000 7f09aa8d1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a40c9390 con 0x7f09a4070820 2023-12-19T16:16:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.002+0000 7f09aa8d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a415aee0 con 0x7f09a40ce3b0 2023-12-19T16:16:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.002+0000 7f09aa8d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a415b1c0 con 0x7f09a41582d0 2023-12-19T16:16:06.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f09a4070820 0x7f09a40ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55274/0 (socket says 172.21.15.119:55274) 2023-12-19T16:16:06.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a37fe640 1 -- 172.21.15.119:0/2001193877 learned_addr learned my addr 172.21.15.119:0/2001193877 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:06.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a3fff640 1 --2- 172.21.15.119:0/2001193877 >> v2:172.21.15.143:3300/0 conn(0x7f09a41582d0 0x7f09a40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850139207 0 0) 0x7f09a40c9390 con 0x7f09a4070820 2023-12-19T16:16:06.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f098c003530 con 0x7f09a4070820 2023-12-19T16:16:06.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199085897 0 0) 0x7f09a415aee0 con 0x7f09a40ce3b0 2023-12-19T16:16:06.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a40c9390 con 0x7f09a40ce3b0 2023-12-19T16:16:06.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a3fff640 1 -- 172.21.15.119:0/2001193877 >> v1:172.21.15.143:6789/0 conn(0x7f09a40ce3b0 legacy=0x7f09a40cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a3fff640 1 -- 172.21.15.119:0/2001193877 >> v1:172.21.15.119:6789/0 conn(0x7f09a4070820 legacy=0x7f09a40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a3fff640 1 -- 172.21.15.119:0/2001193877 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a415b4a0 con 0x7f09a41582d0 2023-12-19T16:16:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.006+0000 7f09a3fff640 1 --2- 172.21.15.119:0/2001193877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a40c8e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09940097c0 tx=0x7f099401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bee9bcc4cb31d54 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940ab670 con 0x7f09a41582d0 2023-12-19T16:16:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940ab7d0 con 0x7f09a41582d0 2023-12-19T16:16:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09a2ffd640 1 -- 172.21.15.119:0/2001193877 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940abb60 con 0x7f09a41582d0 2023-12-19T16:16:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- 172.21.15.119:0/2001193877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 msgr2=0x7f09a40c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/2001193877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a40c8e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09940097c0 tx=0x7f099401c450 comp rx=0 tx=0).stop 2023-12-19T16:16:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- 172.21.15.119:0/2001193877 shutdown_connections 2023-12-19T16:16:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/2001193877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a40c8e50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- 172.21.15.119:0/2001193877 >> 172.21.15.119:0/2001193877 conn(0x7f09a406a2a0 msgr2=0x7f09a40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- 172.21.15.119:0/2001193877 shutdown_connections 2023-12-19T16:16:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- 172.21.15.119:0/2001193877 wait complete. 2023-12-19T16:16:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 Processor -- start 2023-12-19T16:16:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- start start 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 0x7f09a40c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09a40ce3b0 0x7f09a4156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a4156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a41548a0 con 0x7f09a4070820 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c7d00 con 0x7f09a41582d0 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09aa8d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c7f50 con 0x7f09a40ce3b0 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09a3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 0x7f09a40c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09a3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 0x7f09a40c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60362/0 (socket says 172.21.15.119:60362) 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.010+0000 7f09a3fff640 1 -- 172.21.15.119:0/4114740687 learned_addr learned my addr 172.21.15.119:0/4114740687 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a8e6e640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a4156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a37fe640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09a40ce3b0 0x7f09a4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a3fff640 1 -- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09a40ce3b0 msgr2=0x7f09a4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a3fff640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09a40ce3b0 0x7f09a4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a3fff640 1 -- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 msgr2=0x7f09a4156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a3fff640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a4156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a3fff640 1 -- 172.21.15.119:0/4114740687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009420 con 0x7f09a4070820 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a37fe640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09a40ce3b0 0x7f09a4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a3fff640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 0x7f09a40c54f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0994019060 tx=0x7f099401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940bf610 con 0x7f09a4070820 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940bf790 con 0x7f09a4070820 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940bfb40 con 0x7f09a4070820 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a40c8230 con 0x7f09a4070820 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a41544c0 con 0x7f09a4070820 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a404e000 con 0x7f09a4070820 2023-12-19T16:16:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09940b5400 con 0x7f09a4070820 2023-12-19T16:16:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a0ff9640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0990065a60 0x7f0990067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.014+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f099411df40 con 0x7f09a4070820 2023-12-19T16:16:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.018+0000 7f09a37fe640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0990065a60 0x7f0990067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.018+0000 7f09a37fe640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0990065a60 0x7f0990067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09a4155e90 tx=0x7f0998009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.018+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f09940eb6b0 con 0x7f09a4070820 2023-12-19T16:16:06.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09a40b0c00 con 0x7f09a4070820 2023-12-19T16:16:06.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09a0ff9640 1 -- 172.21.15.119:0/4114740687 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09940eecd0 con 0x7f09a4070820 2023-12-19T16:16:06.174 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0990065a60 msgr2=0x7f0990067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0990065a60 0x7f0990067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09a4155e90 tx=0x7f0998009040 comp rx=0 tx=0).stop 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 msgr2=0x7f09a40c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 0x7f09a40c54f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0994019060 tx=0x7f099401ac90 comp rx=0 tx=0).stop 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 shutdown_connections 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0990065a60 0x7f0990067f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09a41582d0 0x7f09a4156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09a40ce3b0 0x7f09a4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 --2- 172.21.15.119:0/4114740687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4070820 0x7f09a40c54f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.170+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 >> 172.21.15.119:0/4114740687 conn(0x7f09a406a2a0 msgr2=0x7f09a40ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.174+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 shutdown_connections 2023-12-19T16:16:06.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.174+0000 7f09aa8d1640 1 -- 172.21.15.119:0/4114740687 wait complete. 2023-12-19T16:16:06.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 Processor -- start 2023-12-19T16:16:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 -- start start 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d40b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3d40706e0 0x7fc3d40cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3d40ce3c0 0x7fc3d40b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d40ce850 con 0x7fc3d40706e0 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d40b17e0 con 0x7fc3d40ce3c0 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d95b3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4071b50 con 0x7fc3d41593f0 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3d40706e0 0x7fc3d40cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3d40706e0 0x7fc3d40cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60368/0 (socket says 172.21.15.119:60368) 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 -- 172.21.15.119:0/2995812649 learned_addr learned my addr 172.21.15.119:0/2995812649 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d2ffd640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d40b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d37fe640 1 --2- 172.21.15.119:0/2995812649 >> v2:172.21.15.143:3300/0 conn(0x7fc3d40ce3c0 0x7fc3d40b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 -- 172.21.15.119:0/2995812649 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 msgr2=0x7fc3d40b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d40b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 -- 172.21.15.119:0/2995812649 >> v2:172.21.15.143:3300/0 conn(0x7fc3d40ce3c0 msgr2=0x7fc3d40b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/2995812649 >> v2:172.21.15.143:3300/0 conn(0x7fc3d40ce3c0 0x7fc3d40b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d27fc640 1 -- 172.21.15.119:0/2995812649 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d4071e30 con 0x7fc3d40706e0 2023-12-19T16:16:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d2ffd640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d40b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.334+0000 7fc3d37fe640 1 --2- 172.21.15.119:0/2995812649 >> v2:172.21.15.143:3300/0 conn(0x7fc3d40ce3c0 0x7fc3d40b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40cde80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40716e0 tx=0x7fc3c801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2504a2fa12bdb389 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d1ffb640 1 -- 172.21.15.119:0/2995812649 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40b3200 con 0x7fc3d40706e0 2023-12-19T16:16:06.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d1ffb640 1 -- 172.21.15.119:0/2995812649 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c80a8670 con 0x7fc3d40706e0 2023-12-19T16:16:06.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d1ffb640 1 -- 172.21.15.119:0/2995812649 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80a8a00 con 0x7fc3d40706e0 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 -- 172.21.15.119:0/2995812649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 msgr2=0x7fc3d40cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40cde80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40716e0 tx=0x7fc3c801e6e0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 -- 172.21.15.119:0/2995812649 shutdown_connections 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/2995812649 >> v2:172.21.15.143:3300/0 conn(0x7fc3d40ce3c0 0x7fc3d40b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40cde80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/2995812649 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d40b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 -- 172.21.15.119:0/2995812649 >> 172.21.15.119:0/2995812649 conn(0x7fc3d406d8d0 msgr2=0x7fc3d4069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 -- 172.21.15.119:0/2995812649 shutdown_connections 2023-12-19T16:16:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 -- 172.21.15.119:0/2995812649 wait complete. 2023-12-19T16:16:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.338+0000 7fc3d95b3640 1 Processor -- start 2023-12-19T16:16:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- start start 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d40ce3c0 0x7fc3d414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d41519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d414d990 con 0x7fc3d40706e0 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4151ee0 con 0x7fc3d40ce3c0 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4152160 con 0x7fc3d41593f0 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60370/0 (socket says 172.21.15.119:60370) 2023-12-19T16:16:06.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 -- 172.21.15.119:0/3472019402 learned_addr learned my addr 172.21.15.119:0/3472019402 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d40ce3c0 0x7fc3d414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 -- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 msgr2=0x7fc3d41519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d37fe640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d41519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d41519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 -- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d40ce3c0 msgr2=0x7fc3d414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d40ce3c0 0x7fc3d414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 -- 172.21.15.119:0/3472019402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80094d0 con 0x7fc3d40706e0 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d40ce3c0 0x7fc3d414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d2ffd640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40aec90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400d800 tx=0x7fc3c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40096c0 con 0x7fc3d40706e0 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c4009820 con 0x7fc3d40706e0 2023-12-19T16:16:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d4152440 con 0x7fc3d40706e0 2023-12-19T16:16:06.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4009bd0 con 0x7fc3d40706e0 2023-12-19T16:16:06.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d4152a00 con 0x7fc3d40706e0 2023-12-19T16:16:06.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.342+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d404e000 con 0x7fc3d40706e0 2023-12-19T16:16:06.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.346+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3c4009d30 con 0x7fc3d40706e0 2023-12-19T16:16:06.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.346+0000 7fc3bb7fe640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c0065a90 0x7fc3c0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.346+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc3c4083ca0 con 0x7fc3d40706e0 2023-12-19T16:16:06.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.346+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c0065a90 0x7fc3c0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.346+0000 7fc3d27fc640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c0065a90 0x7fc3c0067f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b0000 tx=0x7fc3c80a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.353 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.350+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc3c4051240 con 0x7fc3d40706e0 2023-12-19T16:16:06.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3d40cebc0 con 0x7fc3d40706e0 2023-12-19T16:16:06.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3bb7fe640 1 -- 172.21.15.119:0/3472019402 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3c4054860 con 0x7fc3d40706e0 2023-12-19T16:16:06.505 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c0065a90 msgr2=0x7fc3c0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c0065a90 0x7fc3c0067f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b0000 tx=0x7fc3c80a9000 comp rx=0 tx=0).stop 2023-12-19T16:16:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 msgr2=0x7fc3d40aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40aec90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400d800 tx=0x7fc3c400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 shutdown_connections 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c0065a90 0x7fc3c0067f50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d40ce3c0 0x7fc3d414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3d41593f0 0x7fc3d41519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 --2- 172.21.15.119:0/3472019402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3d40706e0 0x7fc3d40aec90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 >> 172.21.15.119:0/3472019402 conn(0x7fc3d406d8d0 msgr2=0x7fc3d4150870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 shutdown_connections 2023-12-19T16:16:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.502+0000 7fc3d95b3640 1 -- 172.21.15.119:0/3472019402 wait complete. 2023-12-19T16:16:06.526 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.662+0000 7f8bba5bc640 1 Processor -- start 2023-12-19T16:16:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.662+0000 7f8bba5bc640 1 -- start start 2023-12-19T16:16:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.662+0000 7f8bba5bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40ca410 0x7f8bb4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.662+0000 7f8bba5bc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb4070df0 con 0x7f8bb4159fb0 2023-12-19T16:16:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bba5bc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb415a4f0 con 0x7f8bb40cbff0 2023-12-19T16:16:06.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bba5bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb415aab0 con 0x7f8bb40ca410 2023-12-19T16:16:06.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8bb4159fb0 0x7f8bb4071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55286/0 (socket says 172.21.15.119:55286) 2023-12-19T16:16:06.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb37fe640 1 -- 172.21.15.119:0/798549827 learned_addr learned my addr 172.21.15.119:0/798549827 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb3fff640 1 --2- 172.21.15.119:0/798549827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40ca410 0x7f8bb4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195869158 0 0) 0x7f8bb4070df0 con 0x7f8bb4159fb0 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9c003530 con 0x7f8bb4159fb0 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719837768 0 0) 0x7f8bb415a4f0 con 0x7f8bb40cbff0 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb4070df0 con 0x7f8bb40cbff0 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb3fff640 1 -- 172.21.15.119:0/798549827 >> v1:172.21.15.143:6789/0 conn(0x7f8bb40cbff0 legacy=0x7f8bb40ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb3fff640 1 -- 172.21.15.119:0/798549827 >> v1:172.21.15.119:6789/0 conn(0x7f8bb4159fb0 legacy=0x7f8bb4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762321181 0 0) 0x7f8b9c003530 con 0x7f8bb4159fb0 2023-12-19T16:16:06.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.666+0000 7f8bb3fff640 1 -- 172.21.15.119:0/798549827 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb415a7d0 con 0x7f8bb40ca410 2023-12-19T16:16:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bb3fff640 1 --2- 172.21.15.119:0/798549827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40ca410 0x7f8bb4159a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40097f0 tx=0x7f8ba401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=918b13da3d5eed7f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8001680 con 0x7f8bb40ca410 2023-12-19T16:16:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba40a7050 con 0x7f8bb40ca410 2023-12-19T16:16:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bb2ffd640 1 -- 172.21.15.119:0/798549827 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba40ab620 con 0x7f8bb40ca410 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- 172.21.15.119:0/798549827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40ca410 msgr2=0x7f8bb4159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/798549827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40ca410 0x7f8bb4159a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40097f0 tx=0x7f8ba401c3b0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- 172.21.15.119:0/798549827 shutdown_connections 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/798549827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40ca410 0x7f8bb4159a70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- 172.21.15.119:0/798549827 >> 172.21.15.119:0/798549827 conn(0x7f8bb406a2a0 msgr2=0x7f8bb40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- 172.21.15.119:0/798549827 shutdown_connections 2023-12-19T16:16:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- 172.21.15.119:0/798549827 wait complete. 2023-12-19T16:16:06.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 Processor -- start 2023-12-19T16:16:06.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- start start 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bb40ca410 0x7f8bb41541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40cbff0 0x7f8bb4155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 0x7f8bb41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4155420 con 0x7f8bb4159fb0 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4155d80 con 0x7f8bb40ca410 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.670+0000 7f8bba5bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41547a0 con 0x7f8bb40cbff0 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 0x7f8bb41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 0x7f8bb41562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60386/0 (socket says 172.21.15.119:60386) 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 -- 172.21.15.119:0/2016666008 learned_addr learned my addr 172.21.15.119:0/2016666008 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb3fff640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bb40ca410 0x7f8bb41541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb37fe640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40cbff0 0x7f8bb4155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 -- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40cbff0 msgr2=0x7f8bb4155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40cbff0 0x7f8bb4155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 -- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bb40ca410 msgr2=0x7f8bb41541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bb40ca410 0x7f8bb41541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 -- 172.21.15.119:0/2016666008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4009420 con 0x7f8bb4159fb0 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb37fe640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40cbff0 0x7f8bb4155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb8b59640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 0x7f8bb41562f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c7c0 tx=0x7f8bac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac003b80 con 0x7f8bb4159fb0 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac003ce0 con 0x7f8bb4159fb0 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00aa50 con 0x7f8bb4159fb0 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb4154a80 con 0x7f8bb4159fb0 2023-12-19T16:16:06.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb4155040 con 0x7f8bb4159fb0 2023-12-19T16:16:06.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4155560 con 0x7f8bb4159fb0 2023-12-19T16:16:06.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.674+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8bac00abb0 con 0x7f8bb4159fb0 2023-12-19T16:16:06.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.678+0000 7f8bb0ff9640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ba0065a60 0x7f8ba0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.678+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8bac0833f0 con 0x7f8bb4159fb0 2023-12-19T16:16:06.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.678+0000 7f8bb3fff640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ba0065a60 0x7f8ba0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.678+0000 7f8bb3fff640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ba0065a60 0x7f8ba0067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40ad000 tx=0x7f8ba40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.682+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8bb4155560 con 0x7f8bb4159fb0 2023-12-19T16:16:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.830+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8bb4155560 con 0x7f8bb4159fb0 2023-12-19T16:16:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.830+0000 7f8bb0ff9640 1 -- 172.21.15.119:0/2016666008 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8bb4155560 con 0x7f8bb4159fb0 2023-12-19T16:16:06.838 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ba0065a60 msgr2=0x7f8ba0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ba0065a60 0x7f8ba0067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40ad000 tx=0x7f8ba40a6000 comp rx=0 tx=0).stop 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 msgr2=0x7f8bb41562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 0x7f8bb41562f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c7c0 tx=0x7f8bac00cc80 comp rx=0 tx=0).stop 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 shutdown_connections 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ba0065a60 0x7f8ba0067f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bb4159fb0 0x7f8bb41562f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bb40cbff0 0x7f8bb4155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 --2- 172.21.15.119:0/2016666008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bb40ca410 0x7f8bb41541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 >> 172.21.15.119:0/2016666008 conn(0x7f8bb406a2a0 msgr2=0x7f8bb40cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 shutdown_connections 2023-12-19T16:16:06.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.834+0000 7f8bba5bc640 1 -- 172.21.15.119:0/2016666008 wait complete. 2023-12-19T16:16:06.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:06.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 Processor -- start 2023-12-19T16:16:07.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 -- start start 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2ff0069ca0 0x7f2ff006a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 0x7f2ff00717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff00ccde0 con 0x7f2ff015caf0 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff00cc600 con 0x7f2ff0069ca0 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2ff5e55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff006a5c0 con 0x7f2ff00cdc20 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2feeffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2ff015caf0 0x7f2ff00cbef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55302/0 (socket says 172.21.15.119:55302) 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2feeffd640 1 -- 172.21.15.119:0/216468748 learned_addr learned my addr 172.21.15.119:0/216468748 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/216468748 >> v2:172.21.15.143:3300/0 conn(0x7f2ff0069ca0 0x7f2ff006a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2feffff640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 0x7f2ff00717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307064631 0 0) 0x7f2ff00ccde0 con 0x7f2ff015caf0 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd8003530 con 0x7f2ff015caf0 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001804831 0 0) 0x7f2fd8003530 con 0x7f2ff015caf0 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 msgr2=0x7f2ff00717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 0x7f2ff00717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 >> v2:172.21.15.143:3300/0 conn(0x7f2ff0069ca0 msgr2=0x7f2ff006a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 --2- 172.21.15.119:0/216468748 >> v2:172.21.15.143:3300/0 conn(0x7f2ff0069ca0 0x7f2ff006a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00cc820 con 0x7f2ff015caf0 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f2fe4001680 con 0x7f2ff015caf0 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 >> v1:172.21.15.119:6789/0 conn(0x7f2ff015caf0 legacy=0x7f2ff00cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fd8003980 0x7f2fd8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fd80047d0 0x7f2fd8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 0x7f2fd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00cc600 con 0x7f2fd8003980 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff006a5c0 con 0x7f2fd80047d0 2023-12-19T16:16:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd800b990 con 0x7f2ff00cdc20 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/216468748 >> v2:172.21.15.143:3300/0 conn(0x7f2ff0069ca0 0x7f2ff006a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fd8003980 0x7f2fd8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2feeffd640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fd80047d0 0x7f2fd8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2feffff640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 0x7f2fd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 -- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 msgr2=0x7f2fd8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ff00cdc20 0x7f2fd8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 -- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fd80047d0 msgr2=0x7f2fd8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fd80047d0 0x7f2fd8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.990+0000 7f2fef7fe640 1 -- 172.21.15.119:0/216468748 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8003530 con 0x7f2fd8003980 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fd8003980 0x7f2fd8003da0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009c90 tx=0x7f2fe001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176dfd648e76063c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0004020 con 0x7f2fd8003980 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe0004180 con 0x7f2fd8003980 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2fee7fc640 1 -- 172.21.15.119:0/216468748 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00a57e0 con 0x7f2fd8003980 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2ff5e55640 1 -- 172.21.15.119:0/216468748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fd8003980 msgr2=0x7f2fd8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/216468748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fd8003980 0x7f2fd8003da0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009c90 tx=0x7f2fe001cc20 comp rx=0 tx=0).stop 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2feffff640 1 -- 172.21.15.119:0/216468748 reap_dead start 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2ff5e55640 1 -- 172.21.15.119:0/216468748 shutdown_connections 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2ff5e55640 1 -- 172.21.15.119:0/216468748 >> 172.21.15.119:0/216468748 conn(0x7f2ff006cf80 msgr2=0x7f2ff006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2ff5e55640 1 -- 172.21.15.119:0/216468748 shutdown_connections 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.994+0000 7f2ff5e55640 1 -- 172.21.15.119:0/216468748 wait complete. 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 Processor -- start 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 -- start start 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fd8003980 0x7f2ff00c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 0x7f2ff0155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ff0155e80 0x7f2ff0158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00c48f0 con 0x7f2ff0156540 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00c4460 con 0x7f2ff0155e80 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0156dc0 con 0x7f2fd8003980 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 0x7f2ff0155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 0x7f2ff0155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60402/0 (socket says 172.21.15.119:60402) 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 -- 172.21.15.119:0/595384592 learned_addr learned my addr 172.21.15.119:0/595384592 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 -- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fd8003980 msgr2=0x7f2ff00c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fd8003980 0x7f2ff00c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 -- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ff0155e80 msgr2=0x7f2ff0158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feffff640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ff0155e80 0x7f2ff0158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ff0155e80 0x7f2ff0158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 -- 172.21.15.119:0/595384592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00ae7e0 con 0x7f2ff0156540 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feffff640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ff0155e80 0x7f2ff0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2feeffd640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 0x7f2ff0155940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4007370 tx=0x7f2fe4007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400f960 con 0x7f2ff0156540 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe400fac0 con 0x7f2ff0156540 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400fe50 con 0x7f2ff0156540 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff00c3b70 con 0x7f2ff0156540 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:06.998+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff00c3e10 con 0x7f2ff0156540 2023-12-19T16:16:07.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.002+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff004e000 con 0x7f2ff0156540 2023-12-19T16:16:07.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.002+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fe401d460 con 0x7f2ff0156540 2023-12-19T16:16:07.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.002+0000 7f2fd7fff640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2fdc065a60 0x7f2fdc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.002+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2fe40836b0 con 0x7f2ff0156540 2023-12-19T16:16:07.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.002+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2fdc065a60 0x7f2fdc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.002+0000 7f2fef7fe640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2fdc065a60 0x7f2fdc067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00ae000 tx=0x7f2fe0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.006+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fe4050c50 con 0x7f2ff0156540 2023-12-19T16:16:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.158+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff00b10e0 con 0x7f2ff0156540 2023-12-19T16:16:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2fd7fff640 1 -- 172.21.15.119:0/595384592 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f2fe4054270 con 0x7f2ff0156540 2023-12-19T16:16:07.165 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:07.165 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2fdc065a60 msgr2=0x7f2fdc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2fdc065a60 0x7f2fdc067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00ae000 tx=0x7f2fe0004740 comp rx=0 tx=0).stop 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 msgr2=0x7f2ff0155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 0x7f2ff0155940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4007370 tx=0x7f2fe4007830 comp rx=0 tx=0).stop 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 shutdown_connections 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2fdc065a60 0x7f2fdc067f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ff0155e80 0x7f2ff0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff0156540 0x7f2ff0155940 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 --2- 172.21.15.119:0/595384592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fd8003980 0x7f2ff00c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 >> 172.21.15.119:0/595384592 conn(0x7f2ff006cf80 msgr2=0x7f2ff015b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 shutdown_connections 2023-12-19T16:16:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.162+0000 7f2ff5e55640 1 -- 172.21.15.119:0/595384592 wait complete. 2023-12-19T16:16:07.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:07.187 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:07.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.322+0000 7fa949090640 1 Processor -- start 2023-12-19T16:16:07.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.322+0000 7fa949090640 1 -- start start 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa949090640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa94415cb30 0x7fa94406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa949090640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa94415d2d0 0x7fa94415d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa949090640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94406c140 con 0x7fa9440cefe0 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa949090640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94415cf10 con 0x7fa94415d2d0 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa949090640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94415e000 con 0x7fa94415cb30 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa94415d2d0 0x7fa94415d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa94415d2d0 0x7fa94415d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60404/0 (socket says 172.21.15.119:60404) 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa9437fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa9440cefe0 0x7fa9440cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55314/0 (socket says 172.21.15.119:55314) 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 -- 172.21.15.119:0/4030289070 learned_addr learned my addr 172.21.15.119:0/4030289070 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa943fff640 1 --2- 172.21.15.119:0/4030289070 >> v2:172.21.15.143:3300/0 conn(0x7fa94415cb30 0x7fa94406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 -- 172.21.15.119:0/4030289070 >> v2:172.21.15.143:3300/0 conn(0x7fa94415cb30 msgr2=0x7fa94406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 --2- 172.21.15.119:0/4030289070 >> v2:172.21.15.143:3300/0 conn(0x7fa94415cb30 0x7fa94406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 -- 172.21.15.119:0/4030289070 >> v1:172.21.15.119:6789/0 conn(0x7fa9440cefe0 legacy=0x7fa9440cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.326+0000 7fa94888f640 1 -- 172.21.15.119:0/4030289070 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94406ae40 con 0x7fa94415d2d0 2023-12-19T16:16:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa94888f640 1 --2- 172.21.15.119:0/4030289070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94415d2d0 0x7fa94415d760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9440d3630 tx=0x7fa93c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a5fcd9a061b978 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa942ffd640 1 -- 172.21.15.119:0/4030289070 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0a5860 con 0x7fa94415d2d0 2023-12-19T16:16:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa942ffd640 1 -- 172.21.15.119:0/4030289070 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c0a59c0 con 0x7fa94415d2d0 2023-12-19T16:16:07.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa942ffd640 1 -- 172.21.15.119:0/4030289070 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0a5d50 con 0x7fa94415d2d0 2023-12-19T16:16:07.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 -- 172.21.15.119:0/4030289070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94415d2d0 msgr2=0x7fa94415d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 --2- 172.21.15.119:0/4030289070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94415d2d0 0x7fa94415d760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9440d3630 tx=0x7fa93c01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 -- 172.21.15.119:0/4030289070 shutdown_connections 2023-12-19T16:16:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 --2- 172.21.15.119:0/4030289070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94415d2d0 0x7fa94415d760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 --2- 172.21.15.119:0/4030289070 >> v2:172.21.15.143:3300/0 conn(0x7fa94415cb30 0x7fa94406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 -- 172.21.15.119:0/4030289070 >> 172.21.15.119:0/4030289070 conn(0x7fa944089fb0 msgr2=0x7fa94409b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 -- 172.21.15.119:0/4030289070 shutdown_connections 2023-12-19T16:16:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 -- 172.21.15.119:0/4030289070 wait complete. 2023-12-19T16:16:07.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 Processor -- start 2023-12-19T16:16:07.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.330+0000 7fa949090640 1 -- start start 2023-12-19T16:16:07.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 0x7fa94409d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94415cb30 0x7fa944153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa94415d2d0 0x7fa9440af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409efe0 con 0x7fa9440cefe0 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409f2c0 con 0x7fa94415cb30 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409f5a0 con 0x7fa94415d2d0 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 0x7fa94409d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 0x7fa94409d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60416/0 (socket says 172.21.15.119:60416) 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 -- 172.21.15.119:0/497417886 learned_addr learned my addr 172.21.15.119:0/497417886 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa9437fe640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94415cb30 0x7fa944153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa94888f640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa94415d2d0 0x7fa9440af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 -- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa94415d2d0 msgr2=0x7fa9440af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa94415d2d0 0x7fa9440af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 -- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94415cb30 msgr2=0x7fa944153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94415cb30 0x7fa944153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 -- 172.21.15.119:0/497417886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c009b30 con 0x7fa9440cefe0 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa943fff640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 0x7fa94409d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa93400d800 tx=0x7fa93400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934018070 con 0x7fa9440cefe0 2023-12-19T16:16:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94409f880 con 0x7fa9440cefe0 2023-12-19T16:16:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340059a0 con 0x7fa9440cefe0 2023-12-19T16:16:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934005b50 con 0x7fa9440cefe0 2023-12-19T16:16:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94409ecb0 con 0x7fa9440cefe0 2023-12-19T16:16:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.334+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94406a7c0 con 0x7fa9440cefe0 2023-12-19T16:16:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.338+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa934005cb0 con 0x7fa9440cefe0 2023-12-19T16:16:07.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.338+0000 7fa940ff9640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa930065a60 0x7fa930067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.338+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa9340833a0 con 0x7fa9440cefe0 2023-12-19T16:16:07.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.338+0000 7fa9437fe640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa930065a60 0x7fa930067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.338+0000 7fa9437fe640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa930065a60 0x7fa930067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa94415b820 tx=0x7fa938007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.342+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa934050980 con 0x7fa9440cefe0 2023-12-19T16:16:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.490+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa94404e850 con 0x7fa9440cefe0 2023-12-19T16:16:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.490+0000 7fa940ff9640 1 -- 172.21.15.119:0/497417886 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa934053fa0 con 0x7fa9440cefe0 2023-12-19T16:16:07.495 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa930065a60 msgr2=0x7fa930067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa930065a60 0x7fa930067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa94415b820 tx=0x7fa938007e50 comp rx=0 tx=0).stop 2023-12-19T16:16:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 msgr2=0x7fa94409d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 0x7fa94409d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa93400d800 tx=0x7fa93400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 shutdown_connections 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa930065a60 0x7fa930067f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa94415cb30 0x7fa944153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa94415d2d0 0x7fa9440af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 --2- 172.21.15.119:0/497417886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9440cefe0 0x7fa94409d1a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 >> 172.21.15.119:0/497417886 conn(0x7fa944089fb0 msgr2=0x7fa9440b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 shutdown_connections 2023-12-19T16:16:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.494+0000 7fa949090640 1 -- 172.21.15.119:0/497417886 wait complete. 2023-12-19T16:16:07.516 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.650+0000 7f98e39e9640 1 Processor -- start 2023-12-19T16:16:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.650+0000 7f98e39e9640 1 -- start start 2023-12-19T16:16:07.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e39e9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc1582d0 0x7f98dc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e39e9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f98dc070820 0x7f98dc0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e39e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98dc0ce3b0 0x7f98dc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e39e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0ced80 con 0x7f98dc0ce3b0 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e39e9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0c9390 con 0x7f98dc070820 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e39e9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc15aee0 con 0x7f98dc1582d0 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98dc0ce3b0 0x7f98dc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98dc0ce3b0 0x7f98dc0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60432/0 (socket says 172.21.15.119:60432) 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 -- 172.21.15.119:0/2354835534 learned_addr learned my addr 172.21.15.119:0/2354835534 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e0f84640 1 --2- 172.21.15.119:0/2354835534 >> v2:172.21.15.143:3300/0 conn(0x7f98dc070820 0x7f98dc0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1785640 1 --2- 172.21.15.119:0/2354835534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc1582d0 0x7f98dc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 -- 172.21.15.119:0/2354835534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc1582d0 msgr2=0x7f98dc0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 --2- 172.21.15.119:0/2354835534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc1582d0 0x7f98dc0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 -- 172.21.15.119:0/2354835534 >> v2:172.21.15.143:3300/0 conn(0x7f98dc070820 msgr2=0x7f98dc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 --2- 172.21.15.119:0/2354835534 >> v2:172.21.15.143:3300/0 conn(0x7f98dc070820 0x7f98dc0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.654+0000 7f98e1f86640 1 -- 172.21.15.119:0/2354835534 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc15b1c0 con 0x7f98dc0ce3b0 2023-12-19T16:16:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e1f86640 1 --2- 172.21.15.119:0/2354835534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0ce3b0 0x7f98dc0ce840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0cbf40 tx=0x7f98d401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdde05d97f56099 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98d3fff640 1 -- 172.21.15.119:0/2354835534 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40a5820 con 0x7f98dc0ce3b0 2023-12-19T16:16:07.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98d3fff640 1 -- 172.21.15.119:0/2354835534 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40a5980 con 0x7f98dc0ce3b0 2023-12-19T16:16:07.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98d3fff640 1 -- 172.21.15.119:0/2354835534 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40a5d10 con 0x7f98dc0ce3b0 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 -- 172.21.15.119:0/2354835534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0ce3b0 msgr2=0x7f98dc0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 --2- 172.21.15.119:0/2354835534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0ce3b0 0x7f98dc0ce840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0cbf40 tx=0x7f98d401c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 -- 172.21.15.119:0/2354835534 shutdown_connections 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 --2- 172.21.15.119:0/2354835534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc0ce3b0 0x7f98dc0ce840 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 --2- 172.21.15.119:0/2354835534 >> v2:172.21.15.143:3300/0 conn(0x7f98dc070820 0x7f98dc0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 --2- 172.21.15.119:0/2354835534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc1582d0 0x7f98dc0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 -- 172.21.15.119:0/2354835534 >> 172.21.15.119:0/2354835534 conn(0x7f98dc06a2a0 msgr2=0x7f98dc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 -- 172.21.15.119:0/2354835534 shutdown_connections 2023-12-19T16:16:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 -- 172.21.15.119:0/2354835534 wait complete. 2023-12-19T16:16:07.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 Processor -- start 2023-12-19T16:16:07.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.658+0000 7f98e39e9640 1 -- start start 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc070820 0x7f98dc0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0ce3b0 0x7f98dc0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 0x7f98dc15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c54f0 con 0x7f98dc1582d0 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c8300 con 0x7f98dc070820 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c5740 con 0x7f98dc0ce3b0 2023-12-19T16:16:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 0x7f98dc15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 0x7f98dc15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60444/0 (socket says 172.21.15.119:60444) 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 -- 172.21.15.119:0/3974457919 learned_addr learned my addr 172.21.15.119:0/3974457919 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1785640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc070820 0x7f98dc0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e0f84640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0ce3b0 0x7f98dc0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 -- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0ce3b0 msgr2=0x7f98dc0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0ce3b0 0x7f98dc0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 -- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc070820 msgr2=0x7f98dc0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc070820 0x7f98dc0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 -- 172.21.15.119:0/3974457919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009b30 con 0x7f98dc1582d0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1785640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc070820 0x7f98dc0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e1f86640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 0x7f98dc15d350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98d401b050 tx=0x7f98d4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40b8670 con 0x7f98dc1582d0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40b87d0 con 0x7f98dc1582d0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40b8b80 con 0x7f98dc1582d0 2023-12-19T16:16:07.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc0c5a20 con 0x7f98dc1582d0 2023-12-19T16:16:07.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc0c5fe0 con 0x7f98dc1582d0 2023-12-19T16:16:07.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc04e000 con 0x7f98dc1582d0 2023-12-19T16:16:07.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.662+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98d40b8ce0 con 0x7f98dc1582d0 2023-12-19T16:16:07.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.666+0000 7f98d1ffb640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.666+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f98d411ed30 con 0x7f98dc1582d0 2023-12-19T16:16:07.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.666+0000 7f98e1785640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.666+0000 7f98e1785640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009a90 tx=0x7f98d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.670+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98d40ec360 con 0x7f98dc1582d0 2023-12-19T16:16:07.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.818+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98dc0b0c00 con 0x7f98dc1582d0 2023-12-19T16:16:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98d1ffb640 1 -- 172.21.15.119:0/3974457919 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98d40ef980 con 0x7f98dc1582d0 2023-12-19T16:16:07.825 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:07.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 msgr2=0x7f98c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009a90 tx=0x7f98d8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:07.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 msgr2=0x7f98dc15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 0x7f98dc15d350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98d401b050 tx=0x7f98d4019740 comp rx=0 tx=0).stop 2023-12-19T16:16:07.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 shutdown_connections 2023-12-19T16:16:07.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f98c0065a60 0x7f98c0067f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98dc1582d0 0x7f98dc15d350 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98dc0ce3b0 0x7f98dc0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 --2- 172.21.15.119:0/3974457919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98dc070820 0x7f98dc0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 >> 172.21.15.119:0/3974457919 conn(0x7f98dc06a2a0 msgr2=0x7f98dc157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 shutdown_connections 2023-12-19T16:16:07.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.822+0000 7f98e39e9640 1 -- 172.21.15.119:0/3974457919 wait complete. 2023-12-19T16:16:07.846 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 Processor -- start 2023-12-19T16:16:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 -- start start 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91c0071870 0x7f91c0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00cc930 con 0x7f91c00ca410 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c015aab0 con 0x7f91c0071870 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91c6152640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0070df0 con 0x7f91c00cbff0 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bf7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f91c00ca410 0x7f91c0159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55322/0 (socket says 172.21.15.119:55322) 2023-12-19T16:16:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bf7fe640 1 -- 172.21.15.119:0/3476871193 learned_addr learned my addr 172.21.15.119:0/3476871193 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bffff640 1 --2- 172.21.15.119:0/3476871193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91b7fff640 1 --2- 172.21.15.119:0/3476871193 >> v2:172.21.15.143:3300/0 conn(0x7f91c0071870 0x7f91c0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91beffd640 1 -- 172.21.15.119:0/3476871193 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491004723 0 0) 0x7f91c00cc930 con 0x7f91c00ca410 2023-12-19T16:16:07.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91beffd640 1 -- 172.21.15.119:0/3476871193 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ac003530 con 0x7f91c00ca410 2023-12-19T16:16:07.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bffff640 1 -- 172.21.15.119:0/3476871193 >> v2:172.21.15.143:3300/0 conn(0x7f91c0071870 msgr2=0x7f91c0071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bffff640 1 --2- 172.21.15.119:0/3476871193 >> v2:172.21.15.143:3300/0 conn(0x7f91c0071870 0x7f91c0071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bffff640 1 -- 172.21.15.119:0/3476871193 >> v1:172.21.15.119:6789/0 conn(0x7f91c00ca410 legacy=0x7f91c0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91bffff640 1 -- 172.21.15.119:0/3476871193 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c015a4f0 con 0x7f91c00cbff0 2023-12-19T16:16:07.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.982+0000 7f91b7fff640 1 --2- 172.21.15.119:0/3476871193 >> v2:172.21.15.143:3300/0 conn(0x7f91c0071870 0x7f91c0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:07.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91bffff640 1 --2- 172.21.15.119:0/3476871193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00cc3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009d90 tx=0x7f91b801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a6a6df0b909dd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91beffd640 1 -- 172.21.15.119:0/3476871193 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a59e0 con 0x7f91c00cbff0 2023-12-19T16:16:07.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91beffd640 1 -- 172.21.15.119:0/3476871193 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80a5b40 con 0x7f91c00cbff0 2023-12-19T16:16:07.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91beffd640 1 -- 172.21.15.119:0/3476871193 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80ad440 con 0x7f91c00cbff0 2023-12-19T16:16:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 -- 172.21.15.119:0/3476871193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 msgr2=0x7f91c00cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 --2- 172.21.15.119:0/3476871193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00cc3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009d90 tx=0x7f91b801c920 comp rx=0 tx=0).stop 2023-12-19T16:16:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 -- 172.21.15.119:0/3476871193 shutdown_connections 2023-12-19T16:16:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 --2- 172.21.15.119:0/3476871193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00cc3f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 --2- 172.21.15.119:0/3476871193 >> v2:172.21.15.143:3300/0 conn(0x7f91c0071870 0x7f91c0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 -- 172.21.15.119:0/3476871193 >> 172.21.15.119:0/3476871193 conn(0x7f91c006a2a0 msgr2=0x7f91c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 -- 172.21.15.119:0/3476871193 shutdown_connections 2023-12-19T16:16:07.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.986+0000 7f91c6152640 1 -- 172.21.15.119:0/3476871193 wait complete. 2023-12-19T16:16:07.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 Processor -- start 2023-12-19T16:16:07.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 -- start start 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91c0071870 0x7f91c00c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 0x7f91c0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0151b10 con 0x7f91c00ca410 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c01660b0 con 0x7f91c0071870 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00c47c0 con 0x7f91c00cbff0 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 0x7f91c0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 0x7f91c0155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60446/0 (socket says 172.21.15.119:60446) 2023-12-19T16:16:07.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 -- 172.21.15.119:0/4139724429 learned_addr learned my addr 172.21.15.119:0/4139724429 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:07.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91bffff640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91bf7fe640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91c0071870 0x7f91c00c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 -- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 msgr2=0x7f91c00b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 -- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91c0071870 msgr2=0x7f91c00c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91c0071870 0x7f91c00c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 -- 172.21.15.119:0/4139724429 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009420 con 0x7f91c00ca410 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91bf7fe640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91c0071870 0x7f91c00c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91b7fff640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 0x7f91c0155d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91a800e980 tx=0x7f91a800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800ca00 con 0x7f91c00ca410 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a800cb60 con 0x7f91c00ca410 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b8009a70 con 0x7f91c00ca410 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8013470 con 0x7f91c00ca410 2023-12-19T16:16:07.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.990+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c00c4d80 con 0x7f91c00ca410 2023-12-19T16:16:07.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.994+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c0072af0 con 0x7f91c00ca410 2023-12-19T16:16:07.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.994+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f91a80135d0 con 0x7f91c00ca410 2023-12-19T16:16:07.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.994+0000 7f91bcff9640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91a0065a60 0x7f91a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.994+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f91a8083760 con 0x7f91c00ca410 2023-12-19T16:16:07.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.994+0000 7f91bf7fe640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91a0065a60 0x7f91a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.994+0000 7f91bf7fe640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91a0065a60 0x7f91a0067f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005890 tx=0x7f91b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:07.998+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f91a8050db0 con 0x7f91c00ca410 2023-12-19T16:16:08.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.146+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91c004e000 con 0x7f91c00ca410 2023-12-19T16:16:08.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91bcff9640 1 -- 172.21.15.119:0/4139724429 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91a80543d0 con 0x7f91c00ca410 2023-12-19T16:16:08.153 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91a0065a60 msgr2=0x7f91a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91a0065a60 0x7f91a0067f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005890 tx=0x7f91b0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 msgr2=0x7f91c0155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 0x7f91c0155d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91a800e980 tx=0x7f91a800ee40 comp rx=0 tx=0).stop 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 shutdown_connections 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91a0065a60 0x7f91a0067f20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91c00cbff0 0x7f91c00b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c00ca410 0x7f91c0155d70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 --2- 172.21.15.119:0/4139724429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91c0071870 0x7f91c00c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 >> 172.21.15.119:0/4139724429 conn(0x7f91c006a2a0 msgr2=0x7f91c0158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 shutdown_connections 2023-12-19T16:16:08.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.150+0000 7f91c6152640 1 -- 172.21.15.119:0/4139724429 wait complete. 2023-12-19T16:16:08.174 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 Processor -- start 2023-12-19T16:16:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 -- start start 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4781582d0 0x7fa4780c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa478070820 0x7fa4780ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4780c9390 con 0x7fa4780ce3b0 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47815aee0 con 0x7fa478070820 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa47ea12640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47815b1c0 con 0x7fa4781582d0 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.310+0000 7fa4777fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa478070820 0x7fa4780ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa47cfaf640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa4780ce3b0 0x7fa4780cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55338/0 (socket says 172.21.15.119:55338) 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa4777fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa478070820 0x7fa4780ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60450/0 (socket says 172.21.15.119:60450) 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa47cfaf640 1 -- 172.21.15.119:0/1397758608 learned_addr learned my addr 172.21.15.119:0/1397758608 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa477fff640 1 --2- 172.21.15.119:0/1397758608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4781582d0 0x7fa4780c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa4777fe640 1 -- 172.21.15.119:0/1397758608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4781582d0 msgr2=0x7fa4780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa4777fe640 1 --2- 172.21.15.119:0/1397758608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4781582d0 0x7fa4780c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa4777fe640 1 -- 172.21.15.119:0/1397758608 >> v1:172.21.15.119:6789/0 conn(0x7fa4780ce3b0 legacy=0x7fa4780cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa4777fe640 1 -- 172.21.15.119:0/1397758608 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47815b4a0 con 0x7fa478070820 2023-12-19T16:16:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa476ffd640 1 -- 172.21.15.119:0/1397758608 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788823295 0 0) 0x7fa4780c9390 con 0x7fa4780ce3b0 2023-12-19T16:16:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa4777fe640 1 --2- 172.21.15.119:0/1397758608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa478070820 0x7fa4780ca5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0097c0 tx=0x7fa46c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca7c80763dd70c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa476ffd640 1 -- 172.21.15.119:0/1397758608 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0ab670 con 0x7fa478070820 2023-12-19T16:16:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa476ffd640 1 -- 172.21.15.119:0/1397758608 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c0ab7d0 con 0x7fa478070820 2023-12-19T16:16:08.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.314+0000 7fa476ffd640 1 -- 172.21.15.119:0/1397758608 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0abb60 con 0x7fa478070820 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- 172.21.15.119:0/1397758608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa478070820 msgr2=0x7fa4780ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 --2- 172.21.15.119:0/1397758608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa478070820 0x7fa4780ca5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0097c0 tx=0x7fa46c01c450 comp rx=0 tx=0).stop 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- 172.21.15.119:0/1397758608 shutdown_connections 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 --2- 172.21.15.119:0/1397758608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa478070820 0x7fa4780ca5f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 --2- 172.21.15.119:0/1397758608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4781582d0 0x7fa4780c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- 172.21.15.119:0/1397758608 >> 172.21.15.119:0/1397758608 conn(0x7fa47806a2a0 msgr2=0x7fa4780aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- 172.21.15.119:0/1397758608 shutdown_connections 2023-12-19T16:16:08.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- 172.21.15.119:0/1397758608 wait complete. 2023-12-19T16:16:08.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 Processor -- start 2023-12-19T16:16:08.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- start start 2023-12-19T16:16:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa478070820 0x7fa478150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4780ce3b0 0x7fa4780b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 0x7fa4780b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478150790 con 0x7fa4781582d0 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4780c4ed0 con 0x7fa4780ce3b0 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47ea12640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4780b3c30 con 0x7fa478070820 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 0x7fa4780b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 0x7fa4780b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60456/0 (socket says 172.21.15.119:60456) 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 -- 172.21.15.119:0/3801575720 learned_addr learned my addr 172.21.15.119:0/3801575720 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa477fff640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa478070820 0x7fa478150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa4777fe640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4780ce3b0 0x7fa4780b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 -- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa478070820 msgr2=0x7fa478150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa478070820 0x7fa478150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 -- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4780ce3b0 msgr2=0x7fa4780b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4780ce3b0 0x7fa4780b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa47cfaf640 1 -- 172.21.15.119:0/3801575720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009420 con 0x7fa4781582d0 2023-12-19T16:16:08.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.318+0000 7fa4777fe640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4780ce3b0 0x7fa4780b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa47cfaf640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 0x7fa4780b3140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa470001570 tx=0x7fa47000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000a640 con 0x7fa4781582d0 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000a7c0 con 0x7fa4781582d0 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa478154140 con 0x7fa4781582d0 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000ab70 con 0x7fa4781582d0 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4780c43f0 con 0x7fa4781582d0 2023-12-19T16:16:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47804e000 con 0x7fa4781582d0 2023-12-19T16:16:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa47000acd0 con 0x7fa4781582d0 2023-12-19T16:16:08.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa474ff9640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa464065a60 0x7fa464067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa470082d60 con 0x7fa4781582d0 2023-12-19T16:16:08.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.322+0000 7fa477fff640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa464065a60 0x7fa464067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.326+0000 7fa477fff640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa464065a60 0x7fa464067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4680079c0 tx=0x7fa468008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.326+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa4700503c0 con 0x7fa4781582d0 2023-12-19T16:16:08.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.478+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4780adfa0 con 0x7fa4781582d0 2023-12-19T16:16:08.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.478+0000 7fa474ff9640 1 -- 172.21.15.119:0/3801575720 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4700180a0 con 0x7fa4781582d0 2023-12-19T16:16:08.484 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa464065a60 msgr2=0x7fa464067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa464065a60 0x7fa464067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4680079c0 tx=0x7fa468008040 comp rx=0 tx=0).stop 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 msgr2=0x7fa4780b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 0x7fa4780b3140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa470001570 tx=0x7fa47000cca0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 shutdown_connections 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa464065a60 0x7fa464067f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4780ce3b0 0x7fa4780b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4781582d0 0x7fa4780b3140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 --2- 172.21.15.119:0/3801575720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa478070820 0x7fa478150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 >> 172.21.15.119:0/3801575720 conn(0x7fa47806a2a0 msgr2=0x7fa4781543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 shutdown_connections 2023-12-19T16:16:08.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.482+0000 7fa47ea12640 1 -- 172.21.15.119:0/3801575720 wait complete. 2023-12-19T16:16:08.506 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.642+0000 7f8f665f3640 1 Processor -- start 2023-12-19T16:16:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.642+0000 7f8f665f3640 1 -- start start 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f665f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f600cb180 0x7f8f60070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f665f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f6015c800 0x7f8f600ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f665f3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f60070b80 con 0x7f8f60158c20 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f665f3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f60070e60 con 0x7f8f6015c800 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f665f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60071140 con 0x7f8f600cb180 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f6015c800 0x7f8f600ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f6015c800 0x7f8f600ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60462/0 (socket says 172.21.15.119:60462) 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 -- 172.21.15.119:0/2079147257 learned_addr learned my addr 172.21.15.119:0/2079147257 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f5f7fe640 1 --2- 172.21.15.119:0/2079147257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f600cb180 0x7f8f60070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 -- 172.21.15.119:0/2079147257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f600cb180 msgr2=0x7f8f60070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 --2- 172.21.15.119:0/2079147257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f600cb180 0x7f8f60070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 -- 172.21.15.119:0/2079147257 >> v1:172.21.15.119:6789/0 conn(0x7f8f60158c20 legacy=0x7f8f600caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 -- 172.21.15.119:0/2079147257 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60071420 con 0x7f8f6015c800 2023-12-19T16:16:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f5effd640 1 -- 172.21.15.119:0/2079147257 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209651108 0 0) 0x7f8f60070b80 con 0x7f8f60158c20 2023-12-19T16:16:08.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.646+0000 7f8f64b90640 1 --2- 172.21.15.119:0/2079147257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f600ccc10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009e50 tx=0x7f8f5801d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad379b7786a72b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f5effd640 1 -- 172.21.15.119:0/2079147257 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580a5830 con 0x7f8f6015c800 2023-12-19T16:16:08.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f5effd640 1 -- 172.21.15.119:0/2079147257 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f580a5990 con 0x7f8f6015c800 2023-12-19T16:16:08.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f5effd640 1 -- 172.21.15.119:0/2079147257 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580a5d20 con 0x7f8f6015c800 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- 172.21.15.119:0/2079147257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 msgr2=0x7f8f600ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 --2- 172.21.15.119:0/2079147257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f600ccc10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009e50 tx=0x7f8f5801d3b0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- 172.21.15.119:0/2079147257 shutdown_connections 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 --2- 172.21.15.119:0/2079147257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f600ccc10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 --2- 172.21.15.119:0/2079147257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f600cb180 0x7f8f60070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- 172.21.15.119:0/2079147257 >> 172.21.15.119:0/2079147257 conn(0x7f8f6006a3e0 msgr2=0x7f8f600afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- 172.21.15.119:0/2079147257 shutdown_connections 2023-12-19T16:16:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- 172.21.15.119:0/2079147257 wait complete. 2023-12-19T16:16:08.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 Processor -- start 2023-12-19T16:16:08.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- start start 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f600cb180 0x7f8f600c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f60158c20 0x7f8f600c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f60162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600c64f0 con 0x7f8f6015c800 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600c73a0 con 0x7f8f600cb180 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f665f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60152aa0 con 0x7f8f60158c20 2023-12-19T16:16:08.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.650+0000 7f8f64b90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f60162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f60162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60464/0 (socket says 172.21.15.119:60464) 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 -- 172.21.15.119:0/1474629149 learned_addr learned my addr 172.21.15.119:0/1474629149 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5f7fe640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f60158c20 0x7f8f600c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5ffff640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f600cb180 0x7f8f600c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 -- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f60158c20 msgr2=0x7f8f600c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f60158c20 0x7f8f600c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 -- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f600cb180 msgr2=0x7f8f600c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f600cb180 0x7f8f600c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 -- 172.21.15.119:0/1474629149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58009b30 con 0x7f8f6015c800 2023-12-19T16:16:08.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f64b90640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f60162310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f5801a580 tx=0x7f8f580196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580b8670 con 0x7f8f6015c800 2023-12-19T16:16:08.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f580b87d0 con 0x7f8f6015c800 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580b8b60 con 0x7f8f6015c800 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f600c8800 con 0x7f8f6015c800 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f60153060 con 0x7f8f6015c800 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f600735b0 con 0x7f8f6015c800 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8f580b8cc0 con 0x7f8f6015c800 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5cff9640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f4c065a60 0x7f8f4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.654+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8f5811eb30 con 0x7f8f6015c800 2023-12-19T16:16:08.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.658+0000 7f8f5ffff640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f4c065a60 0x7f8f4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.658+0000 7f8f5ffff640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f4c065a60 0x7f8f4c067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f50000f70 tx=0x7f8f50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.658+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8f580ec200 con 0x7f8f6015c800 2023-12-19T16:16:08.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.810+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f600adee0 con 0x7f8f6015c800 2023-12-19T16:16:08.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f5cff9640 1 -- 172.21.15.119:0/1474629149 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f8f600adee0 con 0x7f8f6015c800 2023-12-19T16:16:08.817 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:08.817 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f4c065a60 msgr2=0x7f8f4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f4c065a60 0x7f8f4c067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f50000f70 tx=0x7f8f50009040 comp rx=0 tx=0).stop 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 msgr2=0x7f8f60162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f60162310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f5801a580 tx=0x7f8f580196f0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 shutdown_connections 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f4c065a60 0x7f8f4c067f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f6015c800 0x7f8f60162310 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f60158c20 0x7f8f600c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 --2- 172.21.15.119:0/1474629149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f600cb180 0x7f8f600c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 >> 172.21.15.119:0/1474629149 conn(0x7f8f6006a3e0 msgr2=0x7f8f60154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 shutdown_connections 2023-12-19T16:16:08.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.814+0000 7f8f665f3640 1 -- 172.21.15.119:0/1474629149 wait complete. 2023-12-19T16:16:08.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:08.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:08.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fd0bf3640 1 Processor -- start 2023-12-19T16:16:08.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fd0bf3640 1 -- start start 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fd0bf3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8fcc153020 0x7f8fcc0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fd0bf3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0c9730 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fd0bf3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0c8e00 con 0x7f8fcc1598d0 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fd0bf3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc0c90e0 con 0x7f8fcc153020 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fcad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8fcc0ceaa0 0x7f8fcc070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55362/0 (socket says 172.21.15.119:55362) 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fcad9d640 1 -- 172.21.15.119:0/1247496583 learned_addr learned my addr 172.21.15.119:0/1247496583 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fca59c640 1 --2- 172.21.15.119:0/1247496583 >> v2:172.21.15.143:3300/0 conn(0x7f8fcc153020 0x7f8fcc0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354727453 0 0) 0x7f8fcc0c9730 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.974+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb4003530 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158445216 0 0) 0x7f8fcc0c8e00 con 0x7f8fcc1598d0 2023-12-19T16:16:08.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fcc0c9730 con 0x7f8fcc1598d0 2023-12-19T16:16:08.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620347346 0 0) 0x7f8fb4003530 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fca59c640 1 -- 172.21.15.119:0/1247496583 >> v1:172.21.15.143:6789/0 conn(0x7f8fcc1598d0 legacy=0x7f8fcc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fca59c640 1 -- 172.21.15.119:0/1247496583 >> v1:172.21.15.119:6789/0 conn(0x7f8fcc0ceaa0 legacy=0x7f8fcc070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fca59c640 1 -- 172.21.15.119:0/1247496583 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0c93c0 con 0x7f8fcc153020 2023-12-19T16:16:08.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fca59c640 1 --2- 172.21.15.119:0/1247496583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc0c9bc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0097c0 tx=0x7f8fbc01c220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30673a2ed09d9389 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4001a00 con 0x7f8fcc153020 2023-12-19T16:16:08.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0a7050 con 0x7f8fcc153020 2023-12-19T16:16:08.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fc959a640 1 -- 172.21.15.119:0/1247496583 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0ab600 con 0x7f8fcc153020 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/1247496583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 msgr2=0x7f8fcc0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.978+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/1247496583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc0c9bc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0097c0 tx=0x7f8fbc01c220 comp rx=0 tx=0).stop 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/1247496583 shutdown_connections 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/1247496583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc0c9bc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/1247496583 >> 172.21.15.119:0/1247496583 conn(0x7f8fcc06a2a0 msgr2=0x7f8fcc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/1247496583 shutdown_connections 2023-12-19T16:16:08.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/1247496583 wait complete. 2023-12-19T16:16:08.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 Processor -- start 2023-12-19T16:16:08.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- start start 2023-12-19T16:16:08.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 0x7f8fcc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc14e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fcc1598d0 0x7f8fcc0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0c8880 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc14dde0 con 0x7f8fcc153020 2023-12-19T16:16:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fd0bf3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b2680 con 0x7f8fcc1598d0 2023-12-19T16:16:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 0x7f8fcc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 0x7f8fcc0b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60466/0 (socket says 172.21.15.119:60466) 2023-12-19T16:16:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 -- 172.21.15.119:0/2449197354 learned_addr learned my addr 172.21.15.119:0/2449197354 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 -- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fcc1598d0 msgr2=0x7f8fcc0c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fcc1598d0 0x7f8fcc0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 -- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 msgr2=0x7f8fcc14e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fc9d9b640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc14e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc14e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 -- 172.21.15.119:0/2449197354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc009420 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fc9d9b640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.982+0000 7f8fca59c640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 0x7f8fcc0b20a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc019eb0 tx=0x7f8fbc019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc003ab0 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc003c10 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0b5410 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc0b2960 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc0b2f20 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc0add70 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8fbc0b2050 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fbaffd640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8fac065a60 0x7f8fac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8fbc11d8a0 con 0x7f8fcc0ceaa0 2023-12-19T16:16:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fc9d9b640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8fac065a60 0x7f8fac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.986+0000 7f8fc9d9b640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8fac065a60 0x7f8fac067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc1f6370 tx=0x7f8fc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:08.990+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8fbc0eae40 con 0x7f8fcc0ceaa0 2023-12-19T16:16:09.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.138+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fcc04e000 con 0x7f8fcc0ceaa0 2023-12-19T16:16:09.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.138+0000 7f8fbaffd640 1 -- 172.21.15.119:0/2449197354 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fbc0ee460 con 0x7f8fcc0ceaa0 2023-12-19T16:16:09.144 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8fac065a60 msgr2=0x7f8fac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8fac065a60 0x7f8fac067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc1f6370 tx=0x7f8fc0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 msgr2=0x7f8fcc0b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 0x7f8fcc0b20a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc019eb0 tx=0x7f8fbc019020 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 shutdown_connections 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8fac065a60 0x7f8fac067f20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc153020 0x7f8fcc14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fcc1598d0 0x7f8fcc0c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 --2- 172.21.15.119:0/2449197354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fcc0ceaa0 0x7f8fcc0b20a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 >> 172.21.15.119:0/2449197354 conn(0x7f8fcc06a2a0 msgr2=0x7f8fcc0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 shutdown_connections 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.142+0000 7f8fd0bf3640 1 -- 172.21.15.119:0/2449197354 wait complete. 2023-12-19T16:16:09.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:09.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 Processor -- start 2023-12-19T16:16:09.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 -- start start 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c90071870 0x7f8c90071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8c900cbff0 0x7f8c900cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c900cc930 con 0x7f8c900ca410 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9015aab0 con 0x7f8c90071870 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c97ab6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c90070df0 con 0x7f8c900cbff0 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c90071870 0x7f8c90071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c90071870 0x7f8c90071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60470/0 (socket says 172.21.15.119:60470) 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 -- 172.21.15.119:0/1931496467 learned_addr learned my addr 172.21.15.119:0/1931496467 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c96053640 1 --2- 172.21.15.119:0/1931496467 >> v2:172.21.15.143:3300/0 conn(0x7f8c900cbff0 0x7f8c900cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 -- 172.21.15.119:0/1931496467 >> v2:172.21.15.143:3300/0 conn(0x7f8c900cbff0 msgr2=0x7f8c900cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 --2- 172.21.15.119:0/1931496467 >> v2:172.21.15.143:3300/0 conn(0x7f8c900cbff0 0x7f8c900cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 -- 172.21.15.119:0/1931496467 >> v1:172.21.15.143:6789/0 conn(0x7f8c900ca410 legacy=0x7f8c90159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.302+0000 7f8c95051640 1 -- 172.21.15.119:0/1931496467 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9015a4f0 con 0x7f8c90071870 2023-12-19T16:16:09.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c95051640 1 --2- 172.21.15.119:0/1931496467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90071d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8c900c1ef0 tx=0x7f8c8001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4279d5820f7a885d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c94850640 1 -- 172.21.15.119:0/1931496467 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800a7c70 con 0x7f8c90071870 2023-12-19T16:16:09.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c94850640 1 -- 172.21.15.119:0/1931496467 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c800a7dd0 con 0x7f8c90071870 2023-12-19T16:16:09.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c94850640 1 -- 172.21.15.119:0/1931496467 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800af660 con 0x7f8c90071870 2023-12-19T16:16:09.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 -- 172.21.15.119:0/1931496467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 msgr2=0x7f8c90071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/1931496467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90071d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8c900c1ef0 tx=0x7f8c8001eba0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 -- 172.21.15.119:0/1931496467 shutdown_connections 2023-12-19T16:16:09.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/1931496467 >> v2:172.21.15.143:3300/0 conn(0x7f8c900cbff0 0x7f8c900cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/1931496467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90071d00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 -- 172.21.15.119:0/1931496467 >> 172.21.15.119:0/1931496467 conn(0x7f8c9006a2a0 msgr2=0x7f8c900aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 -- 172.21.15.119:0/1931496467 shutdown_connections 2023-12-19T16:16:09.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.306+0000 7f8c97ab6640 1 -- 172.21.15.119:0/1931496467 wait complete. 2023-12-19T16:16:09.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 Processor -- start 2023-12-19T16:16:09.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 -- start start 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c900ca410 0x7f8c90158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c900cbff0 0x7f8c90158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9014e1e0 con 0x7f8c90071870 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9014d9d0 con 0x7f8c900cbff0 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9014ba20 con 0x7f8c900ca410 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60478/0 (socket says 172.21.15.119:60478) 2023-12-19T16:16:09.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 -- 172.21.15.119:0/2288325098 learned_addr learned my addr 172.21.15.119:0/2288325098 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95051640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c900ca410 0x7f8c90158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c96053640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c900cbff0 0x7f8c90158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 -- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c900ca410 msgr2=0x7f8c90158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c900ca410 0x7f8c90158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 -- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c900cbff0 msgr2=0x7f8c90158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c900cbff0 0x7f8c90158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 -- 172.21.15.119:0/2288325098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8000b770 con 0x7f8c90071870 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c95852640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90148850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c450 tx=0x7f8c8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0052d0 con 0x7f8c90071870 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c005450 con 0x7f8c90071870 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9014bcc0 con 0x7f8c90071870 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c012870 con 0x7f8c90071870 2023-12-19T16:16:09.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.310+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9014c280 con 0x7f8c90071870 2023-12-19T16:16:09.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.314+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9004e000 con 0x7f8c90071870 2023-12-19T16:16:09.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.314+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c8c0129d0 con 0x7f8c90071870 2023-12-19T16:16:09.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.314+0000 7f8c867fc640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c74065a60 0x7f8c74067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.314+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8c8c0831c0 con 0x7f8c90071870 2023-12-19T16:16:09.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.314+0000 7f8c95051640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c74065a60 0x7f8c74067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.314+0000 7f8c95051640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c74065a60 0x7f8c74067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b1000 tx=0x7f8c800a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.318+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8c8c0506d0 con 0x7f8c90071870 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.470+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c9014c440 con 0x7f8c90071870 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.470+0000 7f8c867fc640 1 -- 172.21.15.119:0/2288325098 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c8c053cf0 con 0x7f8c90071870 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c74065a60 msgr2=0x7f8c74067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c74065a60 0x7f8c74067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b1000 tx=0x7f8c800a9070 comp rx=0 tx=0).stop 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 msgr2=0x7f8c90148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90148850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c450 tx=0x7f8c8c00c910 comp rx=0 tx=0).stop 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 shutdown_connections 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c74065a60 0x7f8c74067f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c900cbff0 0x7f8c90158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c900ca410 0x7f8c90158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 --2- 172.21.15.119:0/2288325098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c90071870 0x7f8c90148850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 >> 172.21.15.119:0/2288325098 conn(0x7f8c9006a2a0 msgr2=0x7f8c900c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 shutdown_connections 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.474+0000 7f8c97ab6640 1 -- 172.21.15.119:0/2288325098 wait complete. 2023-12-19T16:16:09.497 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 Processor -- start 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 -- start start 2023-12-19T16:16:09.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 0x7f6b880c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b880ceaa0 0x7f6b88070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880c9730 con 0x7f6b881598d0 2023-12-19T16:16:09.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880c8e00 con 0x7f6b880ceaa0 2023-12-19T16:16:09.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b905f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c90e0 con 0x7f6b88153020 2023-12-19T16:16:09.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 0x7f6b880c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 0x7f6b880c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:57124/0 (socket says 172.21.15.119:57124) 2023-12-19T16:16:09.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 -- 172.21.15.119:0/3049067001 learned_addr learned my addr 172.21.15.119:0/3049067001 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:09.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8eb8d640 1 --2- 172.21.15.119:0/3049067001 >> v2:172.21.15.143:3300/0 conn(0x7f6b880ceaa0 0x7f6b88070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 -- 172.21.15.119:0/3049067001 >> v2:172.21.15.143:3300/0 conn(0x7f6b880ceaa0 msgr2=0x7f6b88070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 --2- 172.21.15.119:0/3049067001 >> v2:172.21.15.143:3300/0 conn(0x7f6b880ceaa0 0x7f6b88070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 -- 172.21.15.119:0/3049067001 >> v1:172.21.15.143:6789/0 conn(0x7f6b881598d0 legacy=0x7f6b880ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8e38c640 1 -- 172.21.15.119:0/3049067001 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880c93c0 con 0x7f6b88153020 2023-12-19T16:16:09.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.634+0000 7f6b8d38a640 1 -- 172.21.15.119:0/3049067001 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104980789 0 0) 0x7f6b880c9730 con 0x7f6b881598d0 2023-12-19T16:16:09.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b8e38c640 1 --2- 172.21.15.119:0/3049067001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 0x7f6b880c9bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009870 tx=0x7f6b8401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525cc4d5c78bc2f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b8d38a640 1 -- 172.21.15.119:0/3049067001 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840ad660 con 0x7f6b88153020 2023-12-19T16:16:09.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b8d38a640 1 -- 172.21.15.119:0/3049067001 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b840ad7c0 con 0x7f6b88153020 2023-12-19T16:16:09.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b8d38a640 1 -- 172.21.15.119:0/3049067001 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840adb50 con 0x7f6b88153020 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 -- 172.21.15.119:0/3049067001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 msgr2=0x7f6b880c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 --2- 172.21.15.119:0/3049067001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 0x7f6b880c9bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009870 tx=0x7f6b8401c3c0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 -- 172.21.15.119:0/3049067001 shutdown_connections 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 --2- 172.21.15.119:0/3049067001 >> v2:172.21.15.143:3300/0 conn(0x7f6b880ceaa0 0x7f6b88070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 --2- 172.21.15.119:0/3049067001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b88153020 0x7f6b880c9bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 -- 172.21.15.119:0/3049067001 >> 172.21.15.119:0/3049067001 conn(0x7f6b8806a2a0 msgr2=0x7f6b880aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 -- 172.21.15.119:0/3049067001 shutdown_connections 2023-12-19T16:16:09.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.638+0000 7f6b905f0640 1 -- 172.21.15.119:0/3049067001 wait complete. 2023-12-19T16:16:09.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 Processor -- start 2023-12-19T16:16:09.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 -- start start 2023-12-19T16:16:09.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 0x7f6b880b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b88153020 0x7f6b881489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b881598d0 0x7f6b880c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c6540 con 0x7f6b880ceaa0 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c6820 con 0x7f6b88153020 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c6b00 con 0x7f6b881598d0 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 0x7f6b880b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 0x7f6b880b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60482/0 (socket says 172.21.15.119:60482) 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 -- 172.21.15.119:0/324735542 learned_addr learned my addr 172.21.15.119:0/324735542 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8db8b640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b88153020 0x7f6b881489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8eb8d640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b881598d0 0x7f6b880c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 -- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b881598d0 msgr2=0x7f6b880c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b881598d0 0x7f6b880c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 -- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b88153020 msgr2=0x7f6b881489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b88153020 0x7f6b881489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 -- 172.21.15.119:0/324735542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840094d0 con 0x7f6b880ceaa0 2023-12-19T16:16:09.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b8e38c640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 0x7f6b880b1060 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b840b0040 tx=0x7f6b8401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b8620 con 0x7f6b880ceaa0 2023-12-19T16:16:09.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b840b87a0 con 0x7f6b880ceaa0 2023-12-19T16:16:09.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b880c6de0 con 0x7f6b880ceaa0 2023-12-19T16:16:09.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b8b50 con 0x7f6b880ceaa0 2023-12-19T16:16:09.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.642+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b880c73a0 con 0x7f6b880ceaa0 2023-12-19T16:16:09.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.646+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b880c8bf0 con 0x7f6b880ceaa0 2023-12-19T16:16:09.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.646+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b840b4040 con 0x7f6b880ceaa0 2023-12-19T16:16:09.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.646+0000 7f6b7effd640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b6c065a60 0x7f6b6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.646+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6b8411dc80 con 0x7f6b880ceaa0 2023-12-19T16:16:09.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.646+0000 7f6b8db8b640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b6c065a60 0x7f6b6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.646+0000 7f6b8db8b640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b6c065a60 0x7f6b6c067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b88152ff0 tx=0x7f6b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.650+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b840eb2f0 con 0x7f6b880ceaa0 2023-12-19T16:16:09.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b880c7590 con 0x7f6b880ceaa0 2023-12-19T16:16:09.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b7effd640 1 -- 172.21.15.119:0/324735542 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b840ee910 con 0x7f6b880ceaa0 2023-12-19T16:16:09.806 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b6c065a60 msgr2=0x7f6b6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b6c065a60 0x7f6b6c067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b88152ff0 tx=0x7f6b78009040 comp rx=0 tx=0).stop 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 msgr2=0x7f6b880b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 0x7f6b880b1060 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b840b0040 tx=0x7f6b8401ac60 comp rx=0 tx=0).stop 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 shutdown_connections 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6b6c065a60 0x7f6b6c067f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b88153020 0x7f6b881489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b881598d0 0x7f6b880c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 --2- 172.21.15.119:0/324735542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b880ceaa0 0x7f6b880b1060 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 >> 172.21.15.119:0/324735542 conn(0x7f6b8806a2a0 msgr2=0x7f6b8806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 shutdown_connections 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.802+0000 7f6b905f0640 1 -- 172.21.15.119:0/324735542 wait complete. 2023-12-19T16:16:09.826 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:09.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 Processor -- start 2023-12-19T16:16:09.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 -- start start 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f69801582d0 0x7f69800c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6980070820 0x7f69800ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69800c9390 con 0x7f69800ce3b0 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698015aee0 con 0x7f69801582d0 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f6985afc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698015b1c0 con 0x7f6980070820 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f69801582d0 0x7f69800c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f69801582d0 0x7f69800c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60494/0 (socket says 172.21.15.119:60494) 2023-12-19T16:16:09.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 -- 172.21.15.119:0/2388808802 learned_addr learned my addr 172.21.15.119:0/2388808802 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:09.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697effd640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6980070820 0x7f69800ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 -- 172.21.15.119:0/2388808802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6980070820 msgr2=0x7f69800ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6980070820 0x7f69800ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 -- 172.21.15.119:0/2388808802 >> v1:172.21.15.143:6789/0 conn(0x7f69800ce3b0 legacy=0x7f69800cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697f7fe640 1 -- 172.21.15.119:0/2388808802 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698015b4a0 con 0x7f69801582d0 2023-12-19T16:16:09.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.962+0000 7f697effd640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6980070820 0x7f69800ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:09.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f697f7fe640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f69800c8e50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6970009870 tx=0x7f697001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16aa5a59b9af9a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f697e7fc640 1 -- 172.21.15.119:0/2388808802 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700aa610 con 0x7f69801582d0 2023-12-19T16:16:09.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f697e7fc640 1 -- 172.21.15.119:0/2388808802 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700a6040 con 0x7f69801582d0 2023-12-19T16:16:09.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f697e7fc640 1 -- 172.21.15.119:0/2388808802 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700aa990 con 0x7f69801582d0 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 -- 172.21.15.119:0/2388808802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 msgr2=0x7f69800c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f69800c8e50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6970009870 tx=0x7f697001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 -- 172.21.15.119:0/2388808802 shutdown_connections 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6980070820 0x7f69800ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 --2- 172.21.15.119:0/2388808802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f69800c8e50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 -- 172.21.15.119:0/2388808802 >> 172.21.15.119:0/2388808802 conn(0x7f698006a2a0 msgr2=0x7f69800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 -- 172.21.15.119:0/2388808802 shutdown_connections 2023-12-19T16:16:09.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.966+0000 7f6985afc640 1 -- 172.21.15.119:0/2388808802 wait complete. 2023-12-19T16:16:09.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 Processor -- start 2023-12-19T16:16:09.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 -- start start 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6980070820 0x7f69800c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69800ce3b0 0x7f698015df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f6980143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800c5ae0 con 0x7f69801582d0 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698015e630 con 0x7f6980070820 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698015e910 con 0x7f69800ce3b0 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f6980143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f6980143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60506/0 (socket says 172.21.15.119:60506) 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 -- 172.21.15.119:0/1204138853 learned_addr learned my addr 172.21.15.119:0/1204138853 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:09.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697effd640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69800ce3b0 0x7f698015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697f7fe640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6980070820 0x7f69800c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 -- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69800ce3b0 msgr2=0x7f698015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69800ce3b0 0x7f698015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 -- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6980070820 msgr2=0x7f69800c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6980070820 0x7f69800c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 -- 172.21.15.119:0/1204138853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700094d0 con 0x7f69801582d0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f697ffff640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f6980143b50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f697800c780 tx=0x7f697800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978004b70 con 0x7f69801582d0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800ce90 con 0x7f69801582d0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698015ebf0 con 0x7f69801582d0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800a850 con 0x7f69801582d0 2023-12-19T16:16:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.970+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6980144090 con 0x7f69801582d0 2023-12-19T16:16:09.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.974+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69800c5c20 con 0x7f69801582d0 2023-12-19T16:16:09.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.974+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f697800a9b0 con 0x7f69801582d0 2023-12-19T16:16:09.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.974+0000 7f6967fff640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f696c065a60 0x7f696c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.974+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6978083540 con 0x7f69801582d0 2023-12-19T16:16:09.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.974+0000 7f697f7fe640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f696c065a60 0x7f696c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.974+0000 7f697f7fe640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f696c065a60 0x7f696c067f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69700ae000 tx=0x7f69700b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:09.978+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f69800c5c20 con 0x7f69801582d0 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f69800c5c20 con 0x7f69801582d0 2023-12-19T16:16:10.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6967fff640 1 -- 172.21.15.119:0/1204138853 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f69800c5c20 con 0x7f69801582d0 2023-12-19T16:16:10.134 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f696c065a60 msgr2=0x7f696c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f696c065a60 0x7f696c067f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69700ae000 tx=0x7f69700b5040 comp rx=0 tx=0).stop 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 msgr2=0x7f6980143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f6980143b50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f697800c780 tx=0x7f697800cc40 comp rx=0 tx=0).stop 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 shutdown_connections 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f696c065a60 0x7f696c067f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69801582d0 0x7f6980143b50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69800ce3b0 0x7f698015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 --2- 172.21.15.119:0/1204138853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6980070820 0x7f69800c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 >> 172.21.15.119:0/1204138853 conn(0x7f698006a2a0 msgr2=0x7f69800ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 shutdown_connections 2023-12-19T16:16:10.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.130+0000 7f6985afc640 1 -- 172.21.15.119:0/1204138853 wait complete. 2023-12-19T16:16:10.161 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-12-19T16:16:10.161 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-19T16:16:10.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-12-19T16:16:10.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.294+0000 7ff95d152640 1 Processor -- start 2023-12-19T16:16:10.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.294+0000 7ff95d152640 1 -- start start 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95d152640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff95815a680 0x7ff95815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95d152640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9580cac10 0x7ff95815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95d152640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815afa0 0x7ff95806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95d152640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95815f100 con 0x7ff9580cac10 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95d152640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580ca7d0 con 0x7ff95815a680 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95d152640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95815e860 con 0x7ff95815afa0 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9580cac10 0x7ff95815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9580cac10 0x7ff95815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60514/0 (socket says 172.21.15.119:60514) 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 -- 172.21.15.119:0/1661180368 learned_addr learned my addr 172.21.15.119:0/1661180368 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95759e640 1 --2- 172.21.15.119:0/1661180368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815afa0 0x7ff95806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff956d9d640 1 --2- 172.21.15.119:0/1661180368 >> v2:172.21.15.143:3300/0 conn(0x7ff95815a680 0x7ff95815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 -- 172.21.15.119:0/1661180368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815afa0 msgr2=0x7ff95806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 --2- 172.21.15.119:0/1661180368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815afa0 0x7ff95806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 -- 172.21.15.119:0/1661180368 >> v2:172.21.15.143:3300/0 conn(0x7ff95815a680 msgr2=0x7ff95815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 --2- 172.21.15.119:0/1661180368 >> v2:172.21.15.143:3300/0 conn(0x7ff95815a680 0x7ff95815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 -- 172.21.15.119:0/1661180368 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95815eb40 con 0x7ff9580cac10 2023-12-19T16:16:10.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff94e59c640 1 --2- 172.21.15.119:0/1661180368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9580cac10 0x7ff95815aa60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff940009870 tx=0x7ff94001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69faa1a9e361763 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95659c640 1 -- 172.21.15.119:0/1661180368 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400ab600 con 0x7ff9580cac10 2023-12-19T16:16:10.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95659c640 1 -- 172.21.15.119:0/1661180368 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9400a7050 con 0x7ff9580cac10 2023-12-19T16:16:10.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.298+0000 7ff95659c640 1 -- 172.21.15.119:0/1661180368 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400ab980 con 0x7ff9580cac10 2023-12-19T16:16:10.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- 172.21.15.119:0/1661180368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9580cac10 msgr2=0x7ff95815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- 172.21.15.119:0/1661180368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9580cac10 0x7ff95815aa60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff940009870 tx=0x7ff94001c470 comp rx=0 tx=0).stop 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- 172.21.15.119:0/1661180368 shutdown_connections 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- 172.21.15.119:0/1661180368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815afa0 0x7ff95806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- 172.21.15.119:0/1661180368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9580cac10 0x7ff95815aa60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- 172.21.15.119:0/1661180368 >> v2:172.21.15.143:3300/0 conn(0x7ff95815a680 0x7ff95815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- 172.21.15.119:0/1661180368 >> 172.21.15.119:0/1661180368 conn(0x7ff95806a3e0 msgr2=0x7ff9580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- 172.21.15.119:0/1661180368 shutdown_connections 2023-12-19T16:16:10.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- 172.21.15.119:0/1661180368 wait complete. 2023-12-19T16:16:10.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 Processor -- start 2023-12-19T16:16:10.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- start start 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580cac10 0x7ff95814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815a680 0x7ff958151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 0x7ff9580cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958151b70 con 0x7ff95815afa0 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958151260 con 0x7ff9580cac10 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95d152640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95814b940 con 0x7ff95815a680 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 0x7ff9580cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff956d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580cac10 0x7ff95814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 0x7ff9580cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60518/0 (socket says 172.21.15.119:60518) 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.302+0000 7ff95759e640 1 -- 172.21.15.119:0/3501795590 learned_addr learned my addr 172.21.15.119:0/3501795590 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94e59c640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815a680 0x7ff958151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95759e640 1 -- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815a680 msgr2=0x7ff958151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95759e640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815a680 0x7ff958151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95759e640 1 -- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580cac10 msgr2=0x7ff95814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95759e640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580cac10 0x7ff95814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95759e640 1 -- 172.21.15.119:0/3501795590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400094d0 con 0x7ff95815afa0 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff956d9d640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580cac10 0x7ff95814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95759e640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 0x7ff9580cbf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff950007e90 tx=0x7ff95000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950014420 con 0x7ff95815afa0 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950014580 con 0x7ff95815afa0 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9581524d0 con 0x7ff95815afa0 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950014930 con 0x7ff95815afa0 2023-12-19T16:16:10.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9581514b0 con 0x7ff95815afa0 2023-12-19T16:16:10.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9580735b0 con 0x7ff95815afa0 2023-12-19T16:16:10.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff950014a90 con 0x7ff95815afa0 2023-12-19T16:16:10.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94ffff640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff938065a60 0x7ff938067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff950083d90 con 0x7ff95815afa0 2023-12-19T16:16:10.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.306+0000 7ff956d9d640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff938065a60 0x7ff938067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.310+0000 7ff956d9d640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff938065a60 0x7ff938067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9580c10f0 tx=0x7ff948008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.310+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff950051360 con 0x7ff95815afa0 2023-12-19T16:16:10.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:10.522+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7ff958151cb0 con 0x7ff95815afa0 2023-12-19T16:16:11.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.354+0000 7ff94ffff640 1 -- 172.21.15.119:0/3501795590 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v67) v1 ==== 150+0+0 (secure 0 0 0) 0x7ff958151cb0 con 0x7ff95815afa0 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff938065a60 msgr2=0x7ff938067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff938065a60 0x7ff938067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9580c10f0 tx=0x7ff948008040 comp rx=0 tx=0).stop 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 msgr2=0x7ff9580cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 0x7ff9580cbf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff950007e90 tx=0x7ff95000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 shutdown_connections 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff938065a60 0x7ff938067f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff95815afa0 0x7ff9580cbf30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff95815a680 0x7ff958151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 --2- 172.21.15.119:0/3501795590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580cac10 0x7ff95814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 >> 172.21.15.119:0/3501795590 conn(0x7ff95806a3e0 msgr2=0x7ff958150730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 shutdown_connections 2023-12-19T16:16:11.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.358+0000 7ff95d152640 1 -- 172.21.15.119:0/3501795590 wait complete. 2023-12-19T16:16:11.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T16:16:11.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 Processor -- start 2023-12-19T16:16:11.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 -- start start 2023-12-19T16:16:11.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3d4c071870 0x7f3d4c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c0cbff0 0x7f3d4c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0cc930 con 0x7f3d4c0ca410 2023-12-19T16:16:11.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c15aab0 con 0x7f3d4c071870 2023-12-19T16:16:11.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d52739640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c070df0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d4bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3d4c0ca410 0x7f3d4c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55372/0 (socket says 172.21.15.119:55372) 2023-12-19T16:16:11.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d4bfff640 1 -- 172.21.15.119:0/346412334 learned_addr learned my addr 172.21.15.119:0/346412334 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:11.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d50cd6640 1 --2- 172.21.15.119:0/346412334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c0cbff0 0x7f3d4c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d4b7fe640 1 --2- 172.21.15.119:0/346412334 >> v2:172.21.15.143:3300/0 conn(0x7f3d4c071870 0x7f3d4c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d4affd640 1 -- 172.21.15.119:0/346412334 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509627346 0 0) 0x7f3d4c0cc930 con 0x7f3d4c0ca410 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d4affd640 1 -- 172.21.15.119:0/346412334 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d34003530 con 0x7f3d4c0ca410 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d50cd6640 1 -- 172.21.15.119:0/346412334 >> v2:172.21.15.143:3300/0 conn(0x7f3d4c071870 msgr2=0x7f3d4c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d50cd6640 1 --2- 172.21.15.119:0/346412334 >> v2:172.21.15.143:3300/0 conn(0x7f3d4c071870 0x7f3d4c071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d50cd6640 1 -- 172.21.15.119:0/346412334 >> v1:172.21.15.119:6789/0 conn(0x7f3d4c0ca410 legacy=0x7f3d4c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d50cd6640 1 -- 172.21.15.119:0/346412334 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c15a4f0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.522+0000 7f3d4b7fe640 1 --2- 172.21.15.119:0/346412334 >> v2:172.21.15.143:3300/0 conn(0x7f3d4c071870 0x7f3d4c071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:11.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d50cd6640 1 --2- 172.21.15.119:0/346412334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c0cbff0 0x7f3d4c0cc3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009d90 tx=0x7f3d4401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c8e716725372a8d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d4affd640 1 -- 172.21.15.119:0/346412334 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440a59e0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d4affd640 1 -- 172.21.15.119:0/346412334 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d440a5b40 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d4affd640 1 -- 172.21.15.119:0/346412334 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440ad440 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 -- 172.21.15.119:0/346412334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c0cbff0 msgr2=0x7f3d4c0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 --2- 172.21.15.119:0/346412334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c0cbff0 0x7f3d4c0cc3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009d90 tx=0x7f3d4401c920 comp rx=0 tx=0).stop 2023-12-19T16:16:11.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 -- 172.21.15.119:0/346412334 shutdown_connections 2023-12-19T16:16:11.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 --2- 172.21.15.119:0/346412334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c0cbff0 0x7f3d4c0cc3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 --2- 172.21.15.119:0/346412334 >> v2:172.21.15.143:3300/0 conn(0x7f3d4c071870 0x7f3d4c071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 -- 172.21.15.119:0/346412334 >> 172.21.15.119:0/346412334 conn(0x7f3d4c06a2a0 msgr2=0x7f3d4c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 -- 172.21.15.119:0/346412334 shutdown_connections 2023-12-19T16:16:11.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.526+0000 7f3d52739640 1 -- 172.21.15.119:0/346412334 wait complete. 2023-12-19T16:16:11.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 Processor -- start 2023-12-19T16:16:11.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 -- start start 2023-12-19T16:16:11.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c071870 0x7f3d4c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d4c0ca410 0x7f3d4c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 0x7f3d4c0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c20b0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2390 con 0x7f3d4c0ca410 2023-12-19T16:16:11.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2670 con 0x7f3d4c071870 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 0x7f3d4c0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 0x7f3d4c0aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60524/0 (socket says 172.21.15.119:60524) 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 -- 172.21.15.119:0/3100870975 learned_addr learned my addr 172.21.15.119:0/3100870975 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d4bfff640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c071870 0x7f3d4c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d4b7fe640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d4c0ca410 0x7f3d4c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 -- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c071870 msgr2=0x7f3d4c0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c071870 0x7f3d4c0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 -- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d4c0ca410 msgr2=0x7f3d4c0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d4c0ca410 0x7f3d4c0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 -- 172.21.15.119:0/3100870975 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009420 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d50cd6640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 0x7f3d4c0aff70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3d440b0040 tx=0x7f3d440196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440adce0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d440ade40 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d44009a70 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.530+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440b9690 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c0c2c30 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c072af0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d440b97f0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d48ff9640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d38065a60 0x7f3d38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3d4411ec70 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d4bfff640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d38065a60 0x7f3d38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.534+0000 7f3d4bfff640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d38065a60 0x7f3d38067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c005890 tx=0x7f3d3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.538+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3d440ec230 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.686+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d4c0c2e20 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.694+0000 7f3d48ff9640 1 -- 172.21.15.119:0/3100870975 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d440b20c0 con 0x7f3d4c0cbff0 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.694+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d38065a60 msgr2=0x7f3d38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.694+0000 7f3d52739640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d38065a60 0x7f3d38067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c005890 tx=0x7f3d3c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.694+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 msgr2=0x7f3d4c0aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.694+0000 7f3d52739640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 0x7f3d4c0aff70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3d440b0040 tx=0x7f3d440196c0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 shutdown_connections 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d38065a60 0x7f3d38067f20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d4c0ca410 0x7f3d4c0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d4c0cbff0 0x7f3d4c0aff70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 --2- 172.21.15.119:0/3100870975 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d4c071870 0x7f3d4c0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 >> 172.21.15.119:0/3100870975 conn(0x7f3d4c06a2a0 msgr2=0x7f3d4c158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 shutdown_connections 2023-12-19T16:16:11.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:11.698+0000 7f3d52739640 1 -- 172.21.15.119:0/3100870975 wait complete. 2023-12-19T16:16:11.720 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:16:11.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:16:11.776 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:16:11.873 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:16:11.873 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:11.873 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:11.882 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:11.882 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:11.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:12.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 Processor -- start 2023-12-19T16:16:12.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 -- start start 2023-12-19T16:16:12.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 0x7f14980cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f149806fdb0 0x7f1498070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498160690 con 0x7f149815c9d0 2023-12-19T16:16:12.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14981603f0 con 0x7f149806fdb0 2023-12-19T16:16:12.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149e2b6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980b0d80 con 0x7f14980cdd40 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f14977fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 0x7f14980cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f14977fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 0x7f14980cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:57208/0 (socket says 172.21.15.119:57208) 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f14977fe640 1 -- 172.21.15.119:0/1379619789 learned_addr learned my addr 172.21.15.119:0/1379619789 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.110+0000 7f149c853640 1 --2- 172.21.15.119:0/1379619789 >> v2:172.21.15.143:3300/0 conn(0x7f149806fdb0 0x7f1498070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f14977fe640 1 -- 172.21.15.119:0/1379619789 >> v2:172.21.15.143:3300/0 conn(0x7f149806fdb0 msgr2=0x7f1498070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f14977fe640 1 --2- 172.21.15.119:0/1379619789 >> v2:172.21.15.143:3300/0 conn(0x7f149806fdb0 0x7f1498070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f14977fe640 1 -- 172.21.15.119:0/1379619789 >> v1:172.21.15.143:6789/0 conn(0x7f149815c9d0 legacy=0x7f1498160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f14977fe640 1 -- 172.21.15.119:0/1379619789 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980ccb00 con 0x7f14980cdd40 2023-12-19T16:16:12.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f1496ffd640 1 -- 172.21.15.119:0/1379619789 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71924620 0 0) 0x7f1498160690 con 0x7f149815c9d0 2023-12-19T16:16:12.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f14977fe640 1 --2- 172.21.15.119:0/1379619789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 0x7f14980cc400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f148c009870 tx=0x7f148c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdcbef6cb87acc62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f1496ffd640 1 -- 172.21.15.119:0/1379619789 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0a9620 con 0x7f14980cdd40 2023-12-19T16:16:12.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f1496ffd640 1 -- 172.21.15.119:0/1379619789 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0a9780 con 0x7f14980cdd40 2023-12-19T16:16:12.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f1496ffd640 1 -- 172.21.15.119:0/1379619789 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0a9b10 con 0x7f14980cdd40 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.114+0000 7f149e2b6640 1 -- 172.21.15.119:0/1379619789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 msgr2=0x7f14980cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 --2- 172.21.15.119:0/1379619789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 0x7f14980cc400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f148c009870 tx=0x7f148c01c540 comp rx=0 tx=0).stop 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- 172.21.15.119:0/1379619789 shutdown_connections 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 --2- 172.21.15.119:0/1379619789 >> v2:172.21.15.143:3300/0 conn(0x7f149806fdb0 0x7f1498070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 --2- 172.21.15.119:0/1379619789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14980cdd40 0x7f14980cc400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- 172.21.15.119:0/1379619789 >> 172.21.15.119:0/1379619789 conn(0x7f149806a3e0 msgr2=0x7f14980afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- 172.21.15.119:0/1379619789 shutdown_connections 2023-12-19T16:16:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- 172.21.15.119:0/1379619789 wait complete. 2023-12-19T16:16:12.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 Processor -- start 2023-12-19T16:16:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- start start 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149806fdb0 0x7f14980c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14980cdd40 0x7f1498153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f149815c9d0 0x7f1498154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14980c6850 con 0x7f149815c9d0 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14980c6c80 con 0x7f14980cdd40 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149e2b6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980c6f60 con 0x7f149806fdb0 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149c853640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f149815c9d0 0x7f1498154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f1497fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149806fdb0 0x7f14980c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f14977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14980cdd40 0x7f1498153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f1497fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149806fdb0 0x7f14980c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:57220/0 (socket says 172.21.15.119:57220) 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f149c853640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f149815c9d0 0x7f1498154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60540/0 (socket says 172.21.15.119:60540) 2023-12-19T16:16:12.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f1497fff640 1 -- 172.21.15.119:0/3045955236 learned_addr learned my addr 172.21.15.119:0/3045955236 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f14977fe640 1 -- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149806fdb0 msgr2=0x7f14980c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f14977fe640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149806fdb0 0x7f14980c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f14977fe640 1 -- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f149815c9d0 msgr2=0x7f1498154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f14977fe640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f149815c9d0 0x7f1498154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.118+0000 7f14977fe640 1 -- 172.21.15.119:0/3045955236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0094d0 con 0x7f14980cdd40 2023-12-19T16:16:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f14977fe640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14980cdd40 0x7f1498153be0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f148c0aa000 tx=0x7f148c01ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0bc450 con 0x7f14980cdd40 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0bc5f0 con 0x7f14980cdd40 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0bc9a0 con 0x7f14980cdd40 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14981613b0 con 0x7f14980cdd40 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14980c7520 con 0x7f14980cdd40 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14980735b0 con 0x7f14980cdd40 2023-12-19T16:16:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f148c0b13f0 con 0x7f14980cdd40 2023-12-19T16:16:12.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1494ff9640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1484065a60 0x7f1484067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f148c11d970 con 0x7f14980cdd40 2023-12-19T16:16:12.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.122+0000 7f1497fff640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1484065a60 0x7f1484067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.126+0000 7f1497fff640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1484065a60 0x7f1484067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1488000f70 tx=0x7f1488009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.130+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f148c0eb050 con 0x7f14980cdd40 2023-12-19T16:16:12.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.278+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f149804e000 con 0x7f14980cdd40 2023-12-19T16:16:12.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f1494ff9640 1 -- 172.21.15.119:0/3045955236 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f148c0ee670 con 0x7f14980cdd40 2023-12-19T16:16:12.285 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:12.285 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1484065a60 msgr2=0x7f1484067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1484065a60 0x7f1484067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1488000f70 tx=0x7f1488009040 comp rx=0 tx=0).stop 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14980cdd40 msgr2=0x7f1498153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14980cdd40 0x7f1498153be0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f148c0aa000 tx=0x7f148c01ad80 comp rx=0 tx=0).stop 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 shutdown_connections 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1484065a60 0x7f1484067f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14980cdd40 0x7f1498153be0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f149815c9d0 0x7f1498154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 --2- 172.21.15.119:0/3045955236 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149806fdb0 0x7f14980c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 >> 172.21.15.119:0/3045955236 conn(0x7f149806a3e0 msgr2=0x7f14980af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 shutdown_connections 2023-12-19T16:16:12.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.282+0000 7f149e2b6640 1 -- 172.21.15.119:0/3045955236 wait complete. 2023-12-19T16:16:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:12.307 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:12.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 Processor -- start 2023-12-19T16:16:12.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 -- start start 2023-12-19T16:16:12.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 0x7f05e80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05e80ce8f0 0x7f05e8164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e80ced50 con 0x7f05e8164e60 2023-12-19T16:16:12.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80cc980 con 0x7f05e80ce8f0 2023-12-19T16:16:12.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.442+0000 7f05f0073640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80cc090 con 0x7f05e8160a60 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 0x7f05e80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 0x7f05e80ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:57236/0 (socket says 172.21.15.119:57236) 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ee610640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f05e8164e60 0x7f05e80cad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:42530/0 (socket says 172.21.15.119:42530) 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 -- 172.21.15.119:0/4193001399 learned_addr learned my addr 172.21.15.119:0/4193001399 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ed60e640 1 --2- 172.21.15.119:0/4193001399 >> v2:172.21.15.143:3300/0 conn(0x7f05e80ce8f0 0x7f05e8164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ece0d640 1 -- 172.21.15.119:0/4193001399 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165082678 0 0) 0x7f05e80ced50 con 0x7f05e8164e60 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ece0d640 1 -- 172.21.15.119:0/4193001399 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d4003530 con 0x7f05e8164e60 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 -- 172.21.15.119:0/4193001399 >> v2:172.21.15.143:3300/0 conn(0x7f05e80ce8f0 msgr2=0x7f05e8164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 --2- 172.21.15.119:0/4193001399 >> v2:172.21.15.143:3300/0 conn(0x7f05e80ce8f0 0x7f05e8164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 -- 172.21.15.119:0/4193001399 >> v1:172.21.15.143:6789/0 conn(0x7f05e8164e60 legacy=0x7f05e80cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 -- 172.21.15.119:0/4193001399 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e80cc330 con 0x7f05e8160a60 2023-12-19T16:16:12.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.446+0000 7f05ede0f640 1 --2- 172.21.15.119:0/4193001399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 0x7f05e80ce3b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009870 tx=0x7f05e401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a036f0ab6d0bc3f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05ece0d640 1 -- 172.21.15.119:0/4193001399 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40a95f0 con 0x7f05e8160a60 2023-12-19T16:16:12.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05ece0d640 1 -- 172.21.15.119:0/4193001399 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e40a9750 con 0x7f05e8160a60 2023-12-19T16:16:12.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05ece0d640 1 -- 172.21.15.119:0/4193001399 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40a9ae0 con 0x7f05e8160a60 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- 172.21.15.119:0/4193001399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 msgr2=0x7f05e80ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 --2- 172.21.15.119:0/4193001399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 0x7f05e80ce3b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009870 tx=0x7f05e401c510 comp rx=0 tx=0).stop 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- 172.21.15.119:0/4193001399 shutdown_connections 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 --2- 172.21.15.119:0/4193001399 >> v2:172.21.15.143:3300/0 conn(0x7f05e80ce8f0 0x7f05e8164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 --2- 172.21.15.119:0/4193001399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8160a60 0x7f05e80ce3b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- 172.21.15.119:0/4193001399 >> 172.21.15.119:0/4193001399 conn(0x7f05e806a2a0 msgr2=0x7f05e80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- 172.21.15.119:0/4193001399 shutdown_connections 2023-12-19T16:16:12.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- 172.21.15.119:0/4193001399 wait complete. 2023-12-19T16:16:12.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 Processor -- start 2023-12-19T16:16:12.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- start start 2023-12-19T16:16:12.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 0x7f05e815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e8160a60 0x7f05e80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8164e60 0x7f05e80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8158300 con 0x7f05e80ce8f0 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8164070 con 0x7f05e8160a60 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.450+0000 7f05f0073640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8164350 con 0x7f05e8164e60 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 0x7f05e815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 0x7f05e815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60548/0 (socket says 172.21.15.119:60548) 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 -- 172.21.15.119:0/4221813090 learned_addr learned my addr 172.21.15.119:0/4221813090 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ee610640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8164e60 0x7f05e80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ed60e640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e8160a60 0x7f05e80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 -- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8164e60 msgr2=0x7f05e80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8164e60 0x7f05e80b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 -- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e8160a60 msgr2=0x7f05e80b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e8160a60 0x7f05e80b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 -- 172.21.15.119:0/4221813090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40094d0 con 0x7f05e80ce8f0 2023-12-19T16:16:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05ede0f640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 0x7f05e815e970 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f05e40ab040 tx=0x7f05e401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40bc650 con 0x7f05e80ce8f0 2023-12-19T16:16:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e40bc7d0 con 0x7f05e80ce8f0 2023-12-19T16:16:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8157cb0 con 0x7f05e80ce8f0 2023-12-19T16:16:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40bcb80 con 0x7f05e80ce8f0 2023-12-19T16:16:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e8149e30 con 0x7f05e80ce8f0 2023-12-19T16:16:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e804e000 con 0x7f05e80ce8f0 2023-12-19T16:16:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.454+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f05e40bcce0 con 0x7f05e80ce8f0 2023-12-19T16:16:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.458+0000 7f05de7fc640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05cc065a60 0x7f05cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.458+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f05e411dff0 con 0x7f05e80ce8f0 2023-12-19T16:16:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.458+0000 7f05ed60e640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05cc065a60 0x7f05cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.458+0000 7f05ed60e640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05cc065a60 0x7f05cc067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05e814a210 tx=0x7f05d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.462+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f05e40eb620 con 0x7f05e80ce8f0 2023-12-19T16:16:12.619 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.614+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05e80b0c00 con 0x7f05e80ce8f0 2023-12-19T16:16:12.619 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.614+0000 7f05de7fc640 1 -- 172.21.15.119:0/4221813090 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05e40eec40 con 0x7f05e80ce8f0 2023-12-19T16:16:12.620 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05cc065a60 msgr2=0x7f05cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05cc065a60 0x7f05cc067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05e814a210 tx=0x7f05d8009190 comp rx=0 tx=0).stop 2023-12-19T16:16:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 msgr2=0x7f05e815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 0x7f05e815e970 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f05e40ab040 tx=0x7f05e401ad50 comp rx=0 tx=0).stop 2023-12-19T16:16:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 shutdown_connections 2023-12-19T16:16:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05cc065a60 0x7f05cc067f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e8160a60 0x7f05e80b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e8164e60 0x7f05e80b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 --2- 172.21.15.119:0/4221813090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e80ce8f0 0x7f05e815e970 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 >> 172.21.15.119:0/4221813090 conn(0x7f05e806a2a0 msgr2=0x7f05e8164590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 shutdown_connections 2023-12-19T16:16:12.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.618+0000 7f05f0073640 1 -- 172.21.15.119:0/4221813090 wait complete. 2023-12-19T16:16:12.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:12.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 Processor -- start 2023-12-19T16:16:12.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 -- start start 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58181582d0 0x7f58180c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5818070820 0x7f58180ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58180c9390 con 0x7f58180ce3b0 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581815aee0 con 0x7f58181582d0 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581e2f2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581815b1c0 con 0x7f5818070820 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58181582d0 0x7f58180c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58181582d0 0x7f58180c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48164/0 (socket says 172.21.15.119:48164) 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f581c88f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f58180ce3b0 0x7f58180cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33278/0 (socket says 172.21.15.119:33278) 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 -- 172.21.15.119:0/1282869285 learned_addr learned my addr 172.21.15.119:0/1282869285 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f58177fe640 1 --2- 172.21.15.119:0/1282869285 >> v2:172.21.15.143:3300/0 conn(0x7f5818070820 0x7f58180ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 -- 172.21.15.119:0/1282869285 >> v2:172.21.15.143:3300/0 conn(0x7f5818070820 msgr2=0x7f58180ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 --2- 172.21.15.119:0/1282869285 >> v2:172.21.15.143:3300/0 conn(0x7f5818070820 0x7f58180ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 -- 172.21.15.119:0/1282869285 >> v1:172.21.15.119:6789/0 conn(0x7f58180ce3b0 legacy=0x7f58180cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.778+0000 7f5817fff640 1 -- 172.21.15.119:0/1282869285 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581815b4a0 con 0x7f58181582d0 2023-12-19T16:16:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f5817fff640 1 --2- 172.21.15.119:0/1282869285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58181582d0 0x7f58180c8e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f581806dfa0 tx=0x7f580801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b69dade77d1549 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f5816ffd640 1 -- 172.21.15.119:0/1282869285 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080aa650 con 0x7f58181582d0 2023-12-19T16:16:12.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f5816ffd640 1 -- 172.21.15.119:0/1282869285 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58080aa7b0 con 0x7f58181582d0 2023-12-19T16:16:12.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f5816ffd640 1 -- 172.21.15.119:0/1282869285 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080aab40 con 0x7f58181582d0 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 -- 172.21.15.119:0/1282869285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58181582d0 msgr2=0x7f58180c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 --2- 172.21.15.119:0/1282869285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58181582d0 0x7f58180c8e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f581806dfa0 tx=0x7f580801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 -- 172.21.15.119:0/1282869285 shutdown_connections 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 --2- 172.21.15.119:0/1282869285 >> v2:172.21.15.143:3300/0 conn(0x7f5818070820 0x7f58180ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 --2- 172.21.15.119:0/1282869285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58181582d0 0x7f58180c8e50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 -- 172.21.15.119:0/1282869285 >> 172.21.15.119:0/1282869285 conn(0x7f581806a2a0 msgr2=0x7f58180aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 -- 172.21.15.119:0/1282869285 shutdown_connections 2023-12-19T16:16:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 -- 172.21.15.119:0/1282869285 wait complete. 2023-12-19T16:16:12.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 Processor -- start 2023-12-19T16:16:12.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.782+0000 7f581e2f2640 1 -- start start 2023-12-19T16:16:12.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 0x7f58181545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58180ce3b0 0x7f581815d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58181582d0 0x7f58180c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818153ba0 con 0x7f5818070820 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818154160 con 0x7f58180ce3b0 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5818154b30 con 0x7f58181582d0 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 0x7f58181545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 0x7f58181545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48180/0 (socket says 172.21.15.119:48180) 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 -- 172.21.15.119:0/150184637 learned_addr learned my addr 172.21.15.119:0/150184637 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 -- 172.21.15.119:0/150184637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58181582d0 msgr2=0x7f58180c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58181582d0 0x7f58180c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 -- 172.21.15.119:0/150184637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58180ce3b0 msgr2=0x7f581815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58180ce3b0 0x7f581815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 -- 172.21.15.119:0/150184637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080094d0 con 0x7f5818070820 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5817fff640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 0x7f58181545f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58080190e0 tx=0x7f580801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080b3800 con 0x7f5818070820 2023-12-19T16:16:12.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58080b3960 con 0x7f5818070820 2023-12-19T16:16:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080b3d10 con 0x7f5818070820 2023-12-19T16:16:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5818151720 con 0x7f5818070820 2023-12-19T16:16:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581815c080 con 0x7f5818070820 2023-12-19T16:16:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581804e000 con 0x7f5818070820 2023-12-19T16:16:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.786+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f58080c73a0 con 0x7f5818070820 2023-12-19T16:16:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.790+0000 7f5814ff9640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5804065a60 0x7f5804067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.790+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f580811e160 con 0x7f5818070820 2023-12-19T16:16:12.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.790+0000 7f58177fe640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5804065a60 0x7f5804067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.790+0000 7f58177fe640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5804065a60 0x7f5804067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f58181f6cc0 tx=0x7f580c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.794+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f58080eb7b0 con 0x7f5818070820 2023-12-19T16:16:12.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.942+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58181652f0 con 0x7f5818070820 2023-12-19T16:16:12.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.942+0000 7f5814ff9640 1 -- 172.21.15.119:0/150184637 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58080eedd0 con 0x7f5818070820 2023-12-19T16:16:12.948 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5804065a60 msgr2=0x7f5804067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5804065a60 0x7f5804067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f58181f6cc0 tx=0x7f580c008040 comp rx=0 tx=0).stop 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 msgr2=0x7f58181545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 0x7f58181545f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58080190e0 tx=0x7f580801ad10 comp rx=0 tx=0).stop 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 shutdown_connections 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5804065a60 0x7f5804067f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58180ce3b0 0x7f581815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58181582d0 0x7f58180c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 --2- 172.21.15.119:0/150184637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5818070820 0x7f58181545f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 >> 172.21.15.119:0/150184637 conn(0x7f581806a2a0 msgr2=0x7f58180c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 shutdown_connections 2023-12-19T16:16:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:12.946+0000 7f581e2f2640 1 -- 172.21.15.119:0/150184637 wait complete. 2023-12-19T16:16:12.969 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:13.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 Processor -- start 2023-12-19T16:16:13.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 -- start start 2023-12-19T16:16:13.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbabc1582d0 0x7fbabc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbabc070820 0x7fbabc0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc0c9390 con 0x7fbabc0ce3b0 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc15aee0 con 0x7fbabc1582d0 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbac1441640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc15b1c0 con 0x7fbabc070820 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabaffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbabc1582d0 0x7fbabc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabb7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbabc0ce3b0 0x7fbabc0cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33282/0 (socket says 172.21.15.119:33282) 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabb7fe640 1 -- 172.21.15.119:0/2121308876 learned_addr learned my addr 172.21.15.119:0/2121308876 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbab3fff640 1 --2- 172.21.15.119:0/2121308876 >> v2:172.21.15.143:3300/0 conn(0x7fbabc070820 0x7fbabc0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabaffd640 1 -- 172.21.15.119:0/2121308876 >> v2:172.21.15.143:3300/0 conn(0x7fbabc070820 msgr2=0x7fbabc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabaffd640 1 --2- 172.21.15.119:0/2121308876 >> v2:172.21.15.143:3300/0 conn(0x7fbabc070820 0x7fbabc0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabaffd640 1 -- 172.21.15.119:0/2121308876 >> v1:172.21.15.119:6789/0 conn(0x7fbabc0ce3b0 legacy=0x7fbabc0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbabaffd640 1 -- 172.21.15.119:0/2121308876 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc15b4a0 con 0x7fbabc1582d0 2023-12-19T16:16:13.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.106+0000 7fbaba7fc640 1 -- 172.21.15.119:0/2121308876 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023650073 0 0) 0x7fbabc0c9390 con 0x7fbabc0ce3b0 2023-12-19T16:16:13.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbabaffd640 1 --2- 172.21.15.119:0/2121308876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc0c8e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbabc06dfa0 tx=0x7fbaac01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa0b7b7827bc97a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbaba7fc640 1 -- 172.21.15.119:0/2121308876 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0ab650 con 0x7fbabc1582d0 2023-12-19T16:16:13.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbaba7fc640 1 -- 172.21.15.119:0/2121308876 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac0ab7b0 con 0x7fbabc1582d0 2023-12-19T16:16:13.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbaba7fc640 1 -- 172.21.15.119:0/2121308876 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0abb40 con 0x7fbabc1582d0 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 -- 172.21.15.119:0/2121308876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 msgr2=0x7fbabc0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 --2- 172.21.15.119:0/2121308876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc0c8e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbabc06dfa0 tx=0x7fbaac01c430 comp rx=0 tx=0).stop 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 -- 172.21.15.119:0/2121308876 shutdown_connections 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 --2- 172.21.15.119:0/2121308876 >> v2:172.21.15.143:3300/0 conn(0x7fbabc070820 0x7fbabc0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 --2- 172.21.15.119:0/2121308876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc0c8e50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 -- 172.21.15.119:0/2121308876 >> 172.21.15.119:0/2121308876 conn(0x7fbabc06a2a0 msgr2=0x7fbabc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 -- 172.21.15.119:0/2121308876 shutdown_connections 2023-12-19T16:16:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.110+0000 7fbac1441640 1 -- 172.21.15.119:0/2121308876 wait complete. 2023-12-19T16:16:13.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 Processor -- start 2023-12-19T16:16:13.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- start start 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbabc070820 0x7fbabc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbabc0ce3b0 0x7fbabc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc15e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0b1a10 con 0x7fbabc1582d0 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0b0e20 con 0x7fbabc0ce3b0 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0b1070 con 0x7fbabc070820 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc15e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc15e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48184/0 (socket says 172.21.15.119:48184) 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 -- 172.21.15.119:0/936145110 learned_addr learned my addr 172.21.15.119:0/936145110 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:13.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabaffd640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbabc070820 0x7fbabc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbab3fff640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbabc0ce3b0 0x7fbabc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 -- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbabc070820 msgr2=0x7fbabc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbabc070820 0x7fbabc15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 -- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbabc0ce3b0 msgr2=0x7fbabc154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbabc0ce3b0 0x7fbabc154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 -- 172.21.15.119:0/936145110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac009420 con 0x7fbabc1582d0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbab3fff640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbabc0ce3b0 0x7fbabc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbabb7fe640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc15e890 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c810 tx=0x7fbab400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400a640 con 0x7fbabc1582d0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400a7c0 con 0x7fbabc1582d0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc0b1350 con 0x7fbabc1582d0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400ab70 con 0x7fbabc1582d0 2023-12-19T16:16:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc15edd0 con 0x7fbabc1582d0 2023-12-19T16:16:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.114+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc0b1b50 con 0x7fbabc1582d0 2023-12-19T16:16:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.118+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbab400acd0 con 0x7fbabc1582d0 2023-12-19T16:16:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.118+0000 7fbab37fe640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba9c065a60 0x7fba9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.118+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fbab4082ab0 con 0x7fbabc1582d0 2023-12-19T16:16:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.118+0000 7fbabaffd640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba9c065a60 0x7fba9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.118+0000 7fbabaffd640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba9c065a60 0x7fba9c067f20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0af000 tx=0x7fbaac0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.122+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbabc0b1b50 con 0x7fbabc1582d0 2023-12-19T16:16:13.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.270+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbabc0b1b50 con 0x7fbabc1582d0 2023-12-19T16:16:13.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbab37fe640 1 -- 172.21.15.119:0/936145110 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbabc0b1b50 con 0x7fbabc1582d0 2023-12-19T16:16:13.277 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba9c065a60 msgr2=0x7fba9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba9c065a60 0x7fba9c067f20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0af000 tx=0x7fbaac0a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 msgr2=0x7fbabc15e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc15e890 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c810 tx=0x7fbab400ccd0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 shutdown_connections 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba9c065a60 0x7fba9c067f20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbabc0ce3b0 0x7fbabc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbabc1582d0 0x7fbabc15e890 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 --2- 172.21.15.119:0/936145110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbabc070820 0x7fbabc15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 >> 172.21.15.119:0/936145110 conn(0x7fbabc06a2a0 msgr2=0x7fbabc0ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 shutdown_connections 2023-12-19T16:16:13.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.274+0000 7fbac1441640 1 -- 172.21.15.119:0/936145110 wait complete. 2023-12-19T16:16:13.298 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.434+0000 7f6ead8df640 1 Processor -- start 2023-12-19T16:16:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.434+0000 7f6ead8df640 1 -- start start 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6ead8df640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ea80cde90 0x7f6ea80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6ead8df640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6ead8df640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea815cec0 con 0x7f6ea815cae0 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6ead8df640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80cfb40 con 0x7f6ea80cde90 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6ead8df640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80d0530 con 0x7f6ea80cf170 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ea80cde90 0x7f6ea80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ea80cde90 0x7f6ea80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48190/0 (socket says 172.21.15.119:48190) 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 -- 172.21.15.119:0/1582406104 learned_addr learned my addr 172.21.15.119:0/1582406104 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6ea77fe640 1 --2- 172.21.15.119:0/1582406104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 -- 172.21.15.119:0/1582406104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 msgr2=0x7f6ea80cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 --2- 172.21.15.119:0/1582406104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 -- 172.21.15.119:0/1582406104 >> v1:172.21.15.143:6789/0 conn(0x7f6ea815cae0 legacy=0x7f6ea80d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.438+0000 7f6e9e7fc640 1 -- 172.21.15.119:0/1582406104 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80d0810 con 0x7f6ea80cde90 2023-12-19T16:16:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6e9e7fc640 1 --2- 172.21.15.119:0/1582406104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea80ce2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009870 tx=0x7f6e9001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11b6413b623aafe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ea67fc640 1 -- 172.21.15.119:0/1582406104 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900aa670 con 0x7f6ea80cde90 2023-12-19T16:16:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ea67fc640 1 -- 172.21.15.119:0/1582406104 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900aa7d0 con 0x7f6ea80cde90 2023-12-19T16:16:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ea67fc640 1 -- 172.21.15.119:0/1582406104 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900aab60 con 0x7f6ea80cde90 2023-12-19T16:16:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 -- 172.21.15.119:0/1582406104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 msgr2=0x7f6ea80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1582406104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea80ce2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009870 tx=0x7f6e9001c510 comp rx=0 tx=0).stop 2023-12-19T16:16:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 -- 172.21.15.119:0/1582406104 shutdown_connections 2023-12-19T16:16:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1582406104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1582406104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea80ce2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 -- 172.21.15.119:0/1582406104 >> 172.21.15.119:0/1582406104 conn(0x7f6ea8089fb0 msgr2=0x7f6ea80d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 -- 172.21.15.119:0/1582406104 shutdown_connections 2023-12-19T16:16:13.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 -- 172.21.15.119:0/1582406104 wait complete. 2023-12-19T16:16:13.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 Processor -- start 2023-12-19T16:16:13.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.442+0000 7f6ead8df640 1 -- start start 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea8154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea815cae0 0x7f6ea80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8155730 con 0x7f6ea80cde90 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80c9150 con 0x7f6ea815cae0 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8154b20 con 0x7f6ea80cf170 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea8154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea8154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48200/0 (socket says 172.21.15.119:48200) 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 -- 172.21.15.119:0/1599120949 learned_addr learned my addr 172.21.15.119:0/1599120949 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6e9e7fc640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea77fe640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea815cae0 0x7f6ea80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 -- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 msgr2=0x7f6ea80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 -- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea815cae0 msgr2=0x7f6ea80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea815cae0 0x7f6ea80c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 -- 172.21.15.119:0/1599120949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900094d0 con 0x7f6ea80cde90 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea6ffd640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea8154140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c730 tx=0x7f6e9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98003bd0 con 0x7f6ea80cde90 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e98003d50 con 0x7f6ea80cde90 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800aa90 con 0x7f6ea80cde90 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea8154e00 con 0x7f6ea80cde90 2023-12-19T16:16:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea81553c0 con 0x7f6ea80cde90 2023-12-19T16:16:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea804e000 con 0x7f6ea80cde90 2023-12-19T16:16:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.446+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e9800abf0 con 0x7f6ea80cde90 2023-12-19T16:16:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.450+0000 7f6ea4ff9640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6e88065a90 0x7f6e88067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.450+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6e980832a0 con 0x7f6ea80cde90 2023-12-19T16:16:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.450+0000 7f6e9e7fc640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6e88065a90 0x7f6e88067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.450+0000 7f6e9e7fc640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6e88065a90 0x7f6e88067f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e900ae000 tx=0x7f6e900b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.454+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e98050900 con 0x7f6ea80cde90 2023-12-19T16:16:13.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.602+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ea80cccc0 con 0x7f6ea80cde90 2023-12-19T16:16:13.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.602+0000 7f6ea4ff9640 1 -- 172.21.15.119:0/1599120949 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6e98053f20 con 0x7f6ea80cde90 2023-12-19T16:16:13.608 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:13.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6e88065a90 msgr2=0x7f6e88067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6e88065a90 0x7f6e88067f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e900ae000 tx=0x7f6e900b5040 comp rx=0 tx=0).stop 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 msgr2=0x7f6ea8154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea8154140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c730 tx=0x7f6e9800cbf0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 shutdown_connections 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6e88065a90 0x7f6e88067f50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea815cae0 0x7f6ea80c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea80cf170 0x7f6ea80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 --2- 172.21.15.119:0/1599120949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea80cde90 0x7f6ea8154140 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 >> 172.21.15.119:0/1599120949 conn(0x7f6ea8089fb0 msgr2=0x7f6ea815f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 shutdown_connections 2023-12-19T16:16:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.606+0000 7f6ead8df640 1 -- 172.21.15.119:0/1599120949 wait complete. 2023-12-19T16:16:13.629 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 Processor -- start 2023-12-19T16:16:13.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 -- start start 2023-12-19T16:16:13.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815a680 0x7f882815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88280cac10 0x7f882815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882815f100 con 0x7f882815afa0 2023-12-19T16:16:13.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280ca7d0 con 0x7f88280cac10 2023-12-19T16:16:13.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f882e095640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882815e860 con 0x7f882815a680 2023-12-19T16:16:13.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88280cac10 0x7f882815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88280cac10 0x7f882815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48204/0 (socket says 172.21.15.119:48204) 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 -- 172.21.15.119:0/3932346161 learned_addr learned my addr 172.21.15.119:0/3932346161 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f88277fe640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815a680 0x7f882815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 -- 172.21.15.119:0/3932346161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815a680 msgr2=0x7f882815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815a680 0x7f882815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 -- 172.21.15.119:0/3932346161 >> v1:172.21.15.143:6789/0 conn(0x7f882815afa0 legacy=0x7f882806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f881ffff640 1 -- 172.21.15.119:0/3932346161 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882815eb40 con 0x7f88280cac10 2023-12-19T16:16:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.766+0000 7f88277fe640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815a680 0x7f882815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:13.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f881ffff640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f882815aa60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8810009870 tx=0x7f881001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc4e1d0e67afd64 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f8826ffd640 1 -- 172.21.15.119:0/3932346161 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100ac620 con 0x7f88280cac10 2023-12-19T16:16:13.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f8826ffd640 1 -- 172.21.15.119:0/3932346161 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88100ac780 con 0x7f88280cac10 2023-12-19T16:16:13.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f8826ffd640 1 -- 172.21.15.119:0/3932346161 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100acb10 con 0x7f88280cac10 2023-12-19T16:16:13.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 -- 172.21.15.119:0/3932346161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 msgr2=0x7f882815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f882815aa60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8810009870 tx=0x7f881001c4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 -- 172.21.15.119:0/3932346161 shutdown_connections 2023-12-19T16:16:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f882815aa60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 --2- 172.21.15.119:0/3932346161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815a680 0x7f882815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 -- 172.21.15.119:0/3932346161 >> 172.21.15.119:0/3932346161 conn(0x7f882806a3e0 msgr2=0x7f88280afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 -- 172.21.15.119:0/3932346161 shutdown_connections 2023-12-19T16:16:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.770+0000 7f882e095640 1 -- 172.21.15.119:0/3932346161 wait complete. 2023-12-19T16:16:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 Processor -- start 2023-12-19T16:16:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 -- start start 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f88281f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882815a680 0x7f88281f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815afa0 0x7f88280b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882814f370 con 0x7f88280cac10 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c1e90 con 0x7f882815a680 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c2130 con 0x7f882815afa0 2023-12-19T16:16:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f88281f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f88281f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48220/0 (socket says 172.21.15.119:48220) 2023-12-19T16:16:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 -- 172.21.15.119:0/1450775002 learned_addr learned my addr 172.21.15.119:0/1450775002 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f881ffff640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882815a680 0x7f88281f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f8827fff640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815afa0 0x7f88280b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 -- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815afa0 msgr2=0x7f88280b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815afa0 0x7f88280b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 -- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882815a680 msgr2=0x7f88281f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882815a680 0x7f88281f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 -- 172.21.15.119:0/1450775002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100094d0 con 0x7f88280cac10 2023-12-19T16:16:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f88277fe640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f88281f8650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f881800e810 tx=0x7f881800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881800c8d0 con 0x7f88280cac10 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881800ca30 con 0x7f88280cac10 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881800cde0 con 0x7f88280cac10 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88281f8b90 con 0x7f88280cac10 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.774+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88281f9110 con 0x7f88280cac10 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.778+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88280735b0 con 0x7f88280cac10 2023-12-19T16:16:13.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.778+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8818013410 con 0x7f88280cac10 2023-12-19T16:16:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.778+0000 7f8824ff9640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8808065a60 0x7f8808067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.778+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8818083330 con 0x7f88280cac10 2023-12-19T16:16:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.778+0000 7f881ffff640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8808065a60 0x7f8808067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.778+0000 7f881ffff640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8808065a60 0x7f8808067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f88100ae000 tx=0x7f8810008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.782+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88180508f0 con 0x7f88280cac10 2023-12-19T16:16:13.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.942+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f882804e000 con 0x7f88280cac10 2023-12-19T16:16:13.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.942+0000 7f8824ff9640 1 -- 172.21.15.119:0/1450775002 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8818053f10 con 0x7f88280cac10 2023-12-19T16:16:13.948 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8808065a60 msgr2=0x7f8808067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8808065a60 0x7f8808067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f88100ae000 tx=0x7f8810008040 comp rx=0 tx=0).stop 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 msgr2=0x7f88281f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f88281f8650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f881800e810 tx=0x7f881800ecd0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 shutdown_connections 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8808065a60 0x7f8808067f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882815a680 0x7f88281f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882815afa0 0x7f88280b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 --2- 172.21.15.119:0/1450775002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88280cac10 0x7f88281f8650 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 >> 172.21.15.119:0/1450775002 conn(0x7f882806a3e0 msgr2=0x7f88280ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 shutdown_connections 2023-12-19T16:16:13.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:13.946+0000 7f882e095640 1 -- 172.21.15.119:0/1450775002 wait complete. 2023-12-19T16:16:13.969 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:13.969 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:13.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.150+0000 7f7c4f0fc640 1 Processor -- start 2023-12-19T16:16:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.150+0000 7f7c4f0fc640 1 -- start start 2023-12-19T16:16:14.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4f0fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c4815a680 0x7f7c4815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4f0fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4f0fc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4815f100 con 0x7f7c4815afa0 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4f0fc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480ca7d0 con 0x7f7c4815a680 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4f0fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4815e860 con 0x7f7c480cac10 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4d699640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7c4815afa0 0x7f7c4806fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33296/0 (socket says 172.21.15.119:33296) 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4d699640 1 -- 172.21.15.119:0/537687943 learned_addr learned my addr 172.21.15.119:0/537687943 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4ce98640 1 --2- 172.21.15.119:0/537687943 >> v2:172.21.15.143:3300/0 conn(0x7f7c4815a680 0x7f7c4815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c3ffff640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c3f7fe640 1 -- 172.21.15.119:0/537687943 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577157768 0 0) 0x7f7c4815f100 con 0x7f7c4815afa0 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c3f7fe640 1 -- 172.21.15.119:0/537687943 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c30003530 con 0x7f7c4815afa0 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4ce98640 1 -- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 msgr2=0x7f7c4815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4ce98640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4ce98640 1 -- 172.21.15.119:0/537687943 >> v1:172.21.15.119:6789/0 conn(0x7f7c4815afa0 legacy=0x7f7c4806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c4ce98640 1 -- 172.21.15.119:0/537687943 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4815eb40 con 0x7f7c4815a680 2023-12-19T16:16:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.154+0000 7f7c3ffff640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:14.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4ce98640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815a680 0x7f7c4815e160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c440097c0 tx=0x7f7c4401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4c7e4204b87fda5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c3f7fe640 1 -- 172.21.15.119:0/537687943 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440ab600 con 0x7f7c4815a680 2023-12-19T16:16:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c3f7fe640 1 -- 172.21.15.119:0/537687943 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440a7050 con 0x7f7c4815a680 2023-12-19T16:16:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c3f7fe640 1 -- 172.21.15.119:0/537687943 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440ab960 con 0x7f7c4815a680 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815a680 msgr2=0x7f7c4815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815a680 0x7f7c4815e160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c440097c0 tx=0x7f7c4401c3f0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/537687943 shutdown_connections 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/537687943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815a680 0x7f7c4815e160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/537687943 >> 172.21.15.119:0/537687943 conn(0x7f7c4806a3e0 msgr2=0x7f7c480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/537687943 shutdown_connections 2023-12-19T16:16:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/537687943 wait complete. 2023-12-19T16:16:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 Processor -- start 2023-12-19T16:16:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.158+0000 7f7c4f0fc640 1 -- start start 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 0x7f7c48158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815afa0 0x7f7c480af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48159990 con 0x7f7c4815a680 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4815e120 con 0x7f7c4815afa0 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48158a70 con 0x7f7c480cac10 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 0x7f7c48158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 0x7f7c48158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48222/0 (socket says 172.21.15.119:48222) 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 -- 172.21.15.119:0/3935103059 learned_addr learned my addr 172.21.15.119:0/3935103059 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4ce98640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4d699640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815afa0 0x7f7c480af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 -- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 msgr2=0x7f7c4815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 -- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815afa0 msgr2=0x7f7c480af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815afa0 0x7f7c480af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 -- 172.21.15.119:0/3935103059 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009420 con 0x7f7c4815a680 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4d699640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815afa0 0x7f7c480af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3ffff640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 0x7f7c48158530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800ec10 tx=0x7f7c3800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800cc30 con 0x7f7c4815a680 2023-12-19T16:16:14.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800cd90 con 0x7f7c4815a680 2023-12-19T16:16:14.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38013690 con 0x7f7c4815a680 2023-12-19T16:16:14.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c44009420 con 0x7f7c4815a680 2023-12-19T16:16:14.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c48158ff0 con 0x7f7c4815a680 2023-12-19T16:16:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c480735b0 con 0x7f7c4815a680 2023-12-19T16:16:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.162+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c380137f0 con 0x7f7c4815a680 2023-12-19T16:16:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.166+0000 7f7c3d7fa640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c34065a60 0x7f7c34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.166+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7c38083820 con 0x7f7c4815a680 2023-12-19T16:16:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.166+0000 7f7c4ce98640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c34065a60 0x7f7c34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.166+0000 7f7c4ce98640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c34065a60 0x7f7c34067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ad000 tx=0x7f7c440a4f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.170+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c38050e70 con 0x7f7c4815a680 2023-12-19T16:16:14.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.318+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c480c2d60 con 0x7f7c4815a680 2023-12-19T16:16:14.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c3d7fa640 1 -- 172.21.15.119:0/3935103059 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f7c38054490 con 0x7f7c4815a680 2023-12-19T16:16:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c34065a60 msgr2=0x7f7c34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c34065a60 0x7f7c34067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ad000 tx=0x7f7c440a4f90 comp rx=0 tx=0).stop 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 msgr2=0x7f7c48158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 0x7f7c48158530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800ec10 tx=0x7f7c3800c520 comp rx=0 tx=0).stop 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 shutdown_connections 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c34065a60 0x7f7c34067f20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4815afa0 0x7f7c480af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4815a680 0x7f7c48158530 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 --2- 172.21.15.119:0/3935103059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c480cac10 0x7f7c4815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 >> 172.21.15.119:0/3935103059 conn(0x7f7c4806a3e0 msgr2=0x7f7c480ae470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 shutdown_connections 2023-12-19T16:16:14.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.322+0000 7f7c4f0fc640 1 -- 172.21.15.119:0/3935103059 wait complete. 2023-12-19T16:16:14.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:14.348 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:14.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.482+0000 7f1fd9cdf640 1 Processor -- start 2023-12-19T16:16:14.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd9cdf640 1 -- start start 2023-12-19T16:16:14.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd9cdf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1fd40cc700 0x7f1fd4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd9cdf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd4070df0 con 0x7f1fd40ca410 2023-12-19T16:16:14.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd9cdf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd415a4f0 con 0x7f1fd4071870 2023-12-19T16:16:14.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd9cdf640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd415aab0 con 0x7f1fd40cc700 2023-12-19T16:16:14.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1fd40ca410 0x7f1fd4159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33304/0 (socket says 172.21.15.119:33304) 2023-12-19T16:16:14.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd37fe640 1 -- 172.21.15.119:0/1742246890 learned_addr learned my addr 172.21.15.119:0/1742246890 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd3fff640 1 --2- 172.21.15.119:0/1742246890 >> v2:172.21.15.119:3300/0 conn(0x7f1fd40cc700 0x7f1fd4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd27fc640 1 -- 172.21.15.119:0/1742246890 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546080367 0 0) 0x7f1fd4070df0 con 0x7f1fd40ca410 2023-12-19T16:16:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd3fff640 1 -- 172.21.15.119:0/1742246890 >> v1:172.21.15.143:6789/0 conn(0x7f1fd4071870 legacy=0x7f1fd40cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd3fff640 1 -- 172.21.15.119:0/1742246890 >> v1:172.21.15.119:6789/0 conn(0x7f1fd40ca410 legacy=0x7f1fd4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.486+0000 7f1fd3fff640 1 -- 172.21.15.119:0/1742246890 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd415a7d0 con 0x7f1fd40cc700 2023-12-19T16:16:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd3fff640 1 --2- 172.21.15.119:0/1742246890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40cc700 0x7f1fd4071d00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009d90 tx=0x7f1fcc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57af134a6f7c1393 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd27fc640 1 -- 172.21.15.119:0/1742246890 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a59e0 con 0x7f1fd40cc700 2023-12-19T16:16:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd27fc640 1 -- 172.21.15.119:0/1742246890 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0a5b40 con 0x7f1fd40cc700 2023-12-19T16:16:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd27fc640 1 -- 172.21.15.119:0/1742246890 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0ad440 con 0x7f1fd40cc700 2023-12-19T16:16:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/1742246890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40cc700 msgr2=0x7f1fd4071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/1742246890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40cc700 0x7f1fd4071d00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009d90 tx=0x7f1fcc01c920 comp rx=0 tx=0).stop 2023-12-19T16:16:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/1742246890 shutdown_connections 2023-12-19T16:16:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/1742246890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40cc700 0x7f1fd4071d00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/1742246890 >> 172.21.15.119:0/1742246890 conn(0x7f1fd406a2a0 msgr2=0x7f1fd40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/1742246890 shutdown_connections 2023-12-19T16:16:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/1742246890 wait complete. 2023-12-19T16:16:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 Processor -- start 2023-12-19T16:16:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.490+0000 7f1fd9cdf640 1 -- start start 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fd4071870 0x7f1fd4154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 0x7f1fd4154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fd4150420 0x7f1fd40c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd41523d0 con 0x7f1fd40ca410 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4152990 con 0x7f1fd4150420 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4155da0 con 0x7f1fd4071870 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 0x7f1fd4154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 0x7f1fd4154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48246/0 (socket says 172.21.15.119:48246) 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 -- 172.21.15.119:0/703654772 learned_addr learned my addr 172.21.15.119:0/703654772 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd37fe640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fd4071870 0x7f1fd4154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd3fff640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fd4150420 0x7f1fd40c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 -- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fd4071870 msgr2=0x7f1fd4154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fd4071870 0x7f1fd4154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 -- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fd4150420 msgr2=0x7f1fd40c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fd4150420 0x7f1fd40c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 -- 172.21.15.119:0/703654772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009a70 con 0x7f1fd40ca410 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd3fff640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fd4150420 0x7f1fd40c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd2ffd640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 0x7f1fd4154330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800c3c0 tx=0x7f1fc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80052d0 con 0x7f1fd40ca410 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8005430 con 0x7f1fd40ca410 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd4156080 con 0x7f1fd40ca410 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8003840 con 0x7f1fd40ca410 2023-12-19T16:16:14.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd41552b0 con 0x7f1fd40ca410 2023-12-19T16:16:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd4156210 con 0x7f1fd40ca410 2023-12-19T16:16:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.494+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1fc80039a0 con 0x7f1fd40ca410 2023-12-19T16:16:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.498+0000 7f1fbbfff640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1fc0065a60 0x7f1fc0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.498+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1fc8082ae0 con 0x7f1fd40ca410 2023-12-19T16:16:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.498+0000 7f1fd37fe640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1fc0065a60 0x7f1fc0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.498+0000 7f1fd37fe640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1fc0065a60 0x7f1fc0067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4000f70 tx=0x7f1fc4007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.502+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1fc80500a0 con 0x7f1fd40ca410 2023-12-19T16:16:14.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.650+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fd404e000 con 0x7f1fd40ca410 2023-12-19T16:16:14.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.650+0000 7f1fbbfff640 1 -- 172.21.15.119:0/703654772 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fc8017020 con 0x7f1fd40ca410 2023-12-19T16:16:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:14.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1fc0065a60 msgr2=0x7f1fc0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1fc0065a60 0x7f1fc0067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4000f70 tx=0x7f1fc4007240 comp rx=0 tx=0).stop 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 msgr2=0x7f1fd4154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 0x7f1fd4154330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800c3c0 tx=0x7f1fc800c880 comp rx=0 tx=0).stop 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 shutdown_connections 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1fc0065a60 0x7f1fc0067f20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fd4150420 0x7f1fd40c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fd40ca410 0x7f1fd4154330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 --2- 172.21.15.119:0/703654772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fd4071870 0x7f1fd4154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 >> 172.21.15.119:0/703654772 conn(0x7f1fd406a2a0 msgr2=0x7f1fd4157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 shutdown_connections 2023-12-19T16:16:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.654+0000 7f1fd9cdf640 1 -- 172.21.15.119:0/703654772 wait complete. 2023-12-19T16:16:14.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:14.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 Processor -- start 2023-12-19T16:16:14.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 -- start start 2023-12-19T16:16:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97c00ca410 0x7f97c0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00cbff0 0x7f97c00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c00cc930 con 0x7f97c0159fb0 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c015aab0 con 0x7f97c00ca410 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c6e95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0070df0 con 0x7f97c00cbff0 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c4c31640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97c00ca410 0x7f97c0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97bffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f97c0159fb0 0x7f97c0071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33312/0 (socket says 172.21.15.119:33312) 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97bffff640 1 -- 172.21.15.119:0/4179573616 learned_addr learned my addr 172.21.15.119:0/4179573616 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c5432640 1 --2- 172.21.15.119:0/4179573616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00cbff0 0x7f97c00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c4c31640 1 -- 172.21.15.119:0/4179573616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00cbff0 msgr2=0x7f97c00cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:14.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c4c31640 1 --2- 172.21.15.119:0/4179573616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00cbff0 0x7f97c00cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c4c31640 1 -- 172.21.15.119:0/4179573616 >> v1:172.21.15.119:6789/0 conn(0x7f97c0159fb0 legacy=0x7f97c0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97c4c31640 1 -- 172.21.15.119:0/4179573616 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c015a4f0 con 0x7f97c00ca410 2023-12-19T16:16:14.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.814+0000 7f97bf7fe640 1 -- 172.21.15.119:0/4179573616 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045261257 0 0) 0x7f97c00cc930 con 0x7f97c0159fb0 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c4c31640 1 --2- 172.21.15.119:0/4179573616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c00ca410 0x7f97c0159a70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097c0 tx=0x7f97b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb4fa071c449b6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97bf7fe640 1 -- 172.21.15.119:0/4179573616 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b40ab650 con 0x7f97c00ca410 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97bf7fe640 1 -- 172.21.15.119:0/4179573616 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b40ab7b0 con 0x7f97c00ca410 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97bf7fe640 1 -- 172.21.15.119:0/4179573616 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b40abb40 con 0x7f97c00ca410 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 -- 172.21.15.119:0/4179573616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c00ca410 msgr2=0x7f97c0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 --2- 172.21.15.119:0/4179573616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c00ca410 0x7f97c0159a70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097c0 tx=0x7f97b401c450 comp rx=0 tx=0).stop 2023-12-19T16:16:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 -- 172.21.15.119:0/4179573616 shutdown_connections 2023-12-19T16:16:14.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 --2- 172.21.15.119:0/4179573616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00cbff0 0x7f97c00cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 --2- 172.21.15.119:0/4179573616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c00ca410 0x7f97c0159a70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 -- 172.21.15.119:0/4179573616 >> 172.21.15.119:0/4179573616 conn(0x7f97c006a2a0 msgr2=0x7f97c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 -- 172.21.15.119:0/4179573616 shutdown_connections 2023-12-19T16:16:14.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 -- 172.21.15.119:0/4179573616 wait complete. 2023-12-19T16:16:14.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.818+0000 7f97c6e95640 1 Processor -- start 2023-12-19T16:16:14.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- start start 2023-12-19T16:16:14.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00ca410 0x7f97c00c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c00cbff0 0x7f97c01f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 0x7f97c01f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00c4de0 con 0x7f97c0159fb0 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0150bb0 con 0x7f97c00cbff0 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0158840 con 0x7f97c00ca410 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 0x7f97c01f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 0x7f97c01f80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48268/0 (socket says 172.21.15.119:48268) 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 -- 172.21.15.119:0/770536215 learned_addr learned my addr 172.21.15.119:0/770536215 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c4c31640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00ca410 0x7f97c00c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97bffff640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c00cbff0 0x7f97c01f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 -- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00ca410 msgr2=0x7f97c00c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00ca410 0x7f97c00c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 -- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c00cbff0 msgr2=0x7f97c01f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c00cbff0 0x7f97c01f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 -- 172.21.15.119:0/770536215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4009420 con 0x7f97c0159fb0 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c5432640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 0x7f97c01f80e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009dd0 tx=0x7f97b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014480 con 0x7f97c0159fb0 2023-12-19T16:16:14.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800f040 con 0x7f97c0159fb0 2023-12-19T16:16:14.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014840 con 0x7f97c0159fb0 2023-12-19T16:16:14.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c0158b20 con 0x7f97c0159fb0 2023-12-19T16:16:14.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c01590e0 con 0x7f97c0159fb0 2023-12-19T16:16:14.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.822+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c004e000 con 0x7f97c0159fb0 2023-12-19T16:16:14.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.826+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f97b80149a0 con 0x7f97c0159fb0 2023-12-19T16:16:14.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.826+0000 7f97bd7fa640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a4065a60 0x7f97a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.826+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f97b8083fe0 con 0x7f97c0159fb0 2023-12-19T16:16:14.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.826+0000 7f97c4c31640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a4065a60 0x7f97a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.826+0000 7f97c4c31640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a4065a60 0x7f97a4067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97b40af000 tx=0x7f97b40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.830+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f97b80515e0 con 0x7f97c0159fb0 2023-12-19T16:16:14.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.978+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97c0150cf0 con 0x7f97c0159fb0 2023-12-19T16:16:14.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.978+0000 7f97bd7fa640 1 -- 172.21.15.119:0/770536215 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97b8054c00 con 0x7f97c0159fb0 2023-12-19T16:16:14.984 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:14.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a4065a60 msgr2=0x7f97a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a4065a60 0x7f97a4067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97b40af000 tx=0x7f97b40a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:14.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 msgr2=0x7f97c01f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 0x7f97c01f80e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009dd0 tx=0x7f97b800c490 comp rx=0 tx=0).stop 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 shutdown_connections 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a4065a60 0x7f97a4067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c00cbff0 0x7f97c01f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c0159fb0 0x7f97c01f80e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 --2- 172.21.15.119:0/770536215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c00ca410 0x7f97c00c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 >> 172.21.15.119:0/770536215 conn(0x7f97c006a2a0 msgr2=0x7f97c00ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 shutdown_connections 2023-12-19T16:16:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:14.982+0000 7f97c6e95640 1 -- 172.21.15.119:0/770536215 wait complete. 2023-12-19T16:16:15.004 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:15.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.138+0000 7efc81760640 1 Processor -- start 2023-12-19T16:16:15.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.138+0000 7efc81760640 1 -- start start 2023-12-19T16:16:15.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.138+0000 7efc81760640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.138+0000 7efc81760640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efc7c159fb0 0x7efc7c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc81760640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c070df0 con 0x7efc7c071db0 2023-12-19T16:16:15.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc81760640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c15aab0 con 0x7efc7c159fb0 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc81760640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c15a4f0 con 0x7efc7c0ca410 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7efc7c071db0 0x7efc7c0cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33328/0 (socket says 172.21.15.119:33328) 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7b7fe640 1 -- 172.21.15.119:0/724637907 learned_addr learned my addr 172.21.15.119:0/724637907 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc727fc640 1 --2- 172.21.15.119:0/724637907 >> v2:172.21.15.143:3300/0 conn(0x7efc7c159fb0 0x7efc7c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7affd640 1 --2- 172.21.15.119:0/724637907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7a7fc640 1 -- 172.21.15.119:0/724637907 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153585921 0 0) 0x7efc7c070df0 con 0x7efc7c071db0 2023-12-19T16:16:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7a7fc640 1 -- 172.21.15.119:0/724637907 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc68005740 con 0x7efc7c071db0 2023-12-19T16:16:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7affd640 1 -- 172.21.15.119:0/724637907 >> v2:172.21.15.143:3300/0 conn(0x7efc7c159fb0 msgr2=0x7efc7c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7affd640 1 --2- 172.21.15.119:0/724637907 >> v2:172.21.15.143:3300/0 conn(0x7efc7c159fb0 0x7efc7c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7affd640 1 -- 172.21.15.119:0/724637907 >> v1:172.21.15.119:6789/0 conn(0x7efc7c071db0 legacy=0x7efc7c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7affd640 1 -- 172.21.15.119:0/724637907 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c15a7d0 con 0x7efc7c0ca410 2023-12-19T16:16:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.142+0000 7efc7affd640 1 --2- 172.21.15.119:0/724637907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c159a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc640097c0 tx=0x7efc6401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1702b60689ee4aa2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc7a7fc640 1 -- 172.21.15.119:0/724637907 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640ab650 con 0x7efc7c0ca410 2023-12-19T16:16:15.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc7a7fc640 1 -- 172.21.15.119:0/724637907 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640ab7b0 con 0x7efc7c0ca410 2023-12-19T16:16:15.149 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc7a7fc640 1 -- 172.21.15.119:0/724637907 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640abb40 con 0x7efc7c0ca410 2023-12-19T16:16:15.150 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 -- 172.21.15.119:0/724637907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 msgr2=0x7efc7c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 --2- 172.21.15.119:0/724637907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c159a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc640097c0 tx=0x7efc6401c450 comp rx=0 tx=0).stop 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 -- 172.21.15.119:0/724637907 shutdown_connections 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 --2- 172.21.15.119:0/724637907 >> v2:172.21.15.143:3300/0 conn(0x7efc7c159fb0 0x7efc7c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 --2- 172.21.15.119:0/724637907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c159a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 -- 172.21.15.119:0/724637907 >> 172.21.15.119:0/724637907 conn(0x7efc7c06a2a0 msgr2=0x7efc7c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 -- 172.21.15.119:0/724637907 shutdown_connections 2023-12-19T16:16:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 -- 172.21.15.119:0/724637907 wait complete. 2023-12-19T16:16:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 Processor -- start 2023-12-19T16:16:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.146+0000 7efc81760640 1 -- start start 2023-12-19T16:16:15.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 0x7efc7c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc7c159fb0 0x7efc7c15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c3ff0 con 0x7efc7c071db0 2023-12-19T16:16:15.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c13a0 con 0x7efc7c159fb0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c4220 con 0x7efc7c0ca410 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 0x7efc7c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 0x7efc7c0c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48282/0 (socket says 172.21.15.119:48282) 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 -- 172.21.15.119:0/1368841094 learned_addr learned my addr 172.21.15.119:0/1368841094 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 -- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 msgr2=0x7efc7c155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7b7fe640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc7c159fb0 0x7efc7c15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc727fc640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 -- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc7c159fb0 msgr2=0x7efc7c15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc7c159fb0 0x7efc7c15c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 -- 172.21.15.119:0/1368841094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009420 con 0x7efc7c071db0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc727fc640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc7affd640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 0x7efc7c0c27a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc640ad040 tx=0x7efc6401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640bf610 con 0x7efc7c071db0 2023-12-19T16:16:15.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640bf770 con 0x7efc7c071db0 2023-12-19T16:16:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c0c4500 con 0x7efc7c071db0 2023-12-19T16:16:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640bfb20 con 0x7efc7c071db0 2023-12-19T16:16:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c0c4ac0 con 0x7efc7c071db0 2023-12-19T16:16:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c04e000 con 0x7efc7c071db0 2023-12-19T16:16:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.150+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efc640bfc80 con 0x7efc7c071db0 2023-12-19T16:16:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.154+0000 7efc73fff640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7efc5c065a60 0x7efc5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.154+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7efc6411e470 con 0x7efc7c071db0 2023-12-19T16:16:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.154+0000 7efc727fc640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7efc5c065a60 0x7efc5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.154+0000 7efc727fc640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7efc5c065a60 0x7efc5c067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efc7c15b360 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.158+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efc640eba10 con 0x7efc7c071db0 2023-12-19T16:16:15.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc7c0cb6e0 con 0x7efc7c071db0 2023-12-19T16:16:15.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc73fff640 1 -- 172.21.15.119:0/1368841094 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc640ef030 con 0x7efc7c071db0 2023-12-19T16:16:15.311 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7efc5c065a60 msgr2=0x7efc5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7efc5c065a60 0x7efc5c067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efc7c15b360 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 msgr2=0x7efc7c0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 0x7efc7c0c27a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc640ad040 tx=0x7efc6401ac90 comp rx=0 tx=0).stop 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 shutdown_connections 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7efc5c065a60 0x7efc5c067f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.306+0000 7efc81760640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc7c159fb0 0x7efc7c15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.310+0000 7efc81760640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc7c0ca410 0x7efc7c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.310+0000 7efc81760640 1 --2- 172.21.15.119:0/1368841094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc7c071db0 0x7efc7c0c27a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.310+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 >> 172.21.15.119:0/1368841094 conn(0x7efc7c06a2a0 msgr2=0x7efc7c1569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.310+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 shutdown_connections 2023-12-19T16:16:15.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.310+0000 7efc81760640 1 -- 172.21.15.119:0/1368841094 wait complete. 2023-12-19T16:16:15.332 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:15.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.470+0000 7fec9d404640 1 Processor -- start 2023-12-19T16:16:15.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.470+0000 7fec9d404640 1 -- start start 2023-12-19T16:16:15.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.470+0000 7fec9d404640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec980ce590 0x7fec980b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.470+0000 7fec9d404640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980b17e0 con 0x7fec980706e0 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.470+0000 7fec9d404640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec98071b50 con 0x7fec981593f0 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.470+0000 7fec9d404640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec98071e30 con 0x7fec980ce590 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec980ce590 0x7fec980b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec980ce590 0x7fec980b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48288/0 (socket says 172.21.15.119:48288) 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 -- 172.21.15.119:0/3309748428 learned_addr learned my addr 172.21.15.119:0/3309748428 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec977fe640 1 --1- 172.21.15.119:0/3309748428 >> v1:172.21.15.119:6789/0 conn(0x7fec980706e0 0x7fec980b24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33338/0 (socket says 172.21.15.119:33338) 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 -- 172.21.15.119:0/3309748428 >> v1:172.21.15.143:6789/0 conn(0x7fec981593f0 legacy=0x7fec980cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 -- 172.21.15.119:0/3309748428 >> v1:172.21.15.119:6789/0 conn(0x7fec980706e0 legacy=0x7fec980b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 -- 172.21.15.119:0/3309748428 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980b1190 con 0x7fec980ce590 2023-12-19T16:16:15.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec967fc640 1 -- 172.21.15.119:0/3309748428 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914032145 0 0) 0x7fec980b17e0 con 0x7fec980706e0 2023-12-19T16:16:15.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec8e7fc640 1 --2- 172.21.15.119:0/3309748428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec980ce590 0x7fec980b1c70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fec80009870 tx=0x7fec8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8f636cb75496f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec967fc640 1 -- 172.21.15.119:0/3309748428 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800a6040 con 0x7fec980ce590 2023-12-19T16:16:15.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec967fc640 1 -- 172.21.15.119:0/3309748428 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800aa600 con 0x7fec980ce590 2023-12-19T16:16:15.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.474+0000 7fec967fc640 1 -- 172.21.15.119:0/3309748428 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800aa990 con 0x7fec980ce590 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- 172.21.15.119:0/3309748428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec980ce590 msgr2=0x7fec980b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 --2- 172.21.15.119:0/3309748428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec980ce590 0x7fec980b1c70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fec80009870 tx=0x7fec8001c480 comp rx=0 tx=0).stop 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- 172.21.15.119:0/3309748428 shutdown_connections 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 --2- 172.21.15.119:0/3309748428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec980ce590 0x7fec980b1c70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- 172.21.15.119:0/3309748428 >> 172.21.15.119:0/3309748428 conn(0x7fec9806d8d0 msgr2=0x7fec98069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- 172.21.15.119:0/3309748428 shutdown_connections 2023-12-19T16:16:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- 172.21.15.119:0/3309748428 wait complete. 2023-12-19T16:16:15.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 Processor -- start 2023-12-19T16:16:15.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- start start 2023-12-19T16:16:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec980706e0 0x7fec98141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec980ce590 0x7fec9813dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 0x7fec980aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98141030 con 0x7fec981593f0 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980ad340 con 0x7fec980706e0 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec9d404640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec98140690 con 0x7fec980ce590 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 0x7fec980aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 0x7fec980aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48292/0 (socket says 172.21.15.119:48292) 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 -- 172.21.15.119:0/2793926578 learned_addr learned my addr 172.21.15.119:0/2793926578 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec96ffd640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec980706e0 0x7fec98141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec8e7fc640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec980ce590 0x7fec9813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 -- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec980ce590 msgr2=0x7fec9813dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec980ce590 0x7fec9813dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 -- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec980706e0 msgr2=0x7fec98141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec980706e0 0x7fec98141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.478+0000 7fec977fe640 1 -- 172.21.15.119:0/2793926578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800094d0 con 0x7fec981593f0 2023-12-19T16:16:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec977fe640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 0x7fec980aca40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec90001570 tx=0x7fec9000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9000a640 con 0x7fec981593f0 2023-12-19T16:16:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9000a7c0 con 0x7fec981593f0 2023-12-19T16:16:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec98140970 con 0x7fec981593f0 2023-12-19T16:16:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9000ab70 con 0x7fec981593f0 2023-12-19T16:16:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec980acf80 con 0x7fec981593f0 2023-12-19T16:16:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98141170 con 0x7fec981593f0 2023-12-19T16:16:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fec9000acd0 con 0x7fec981593f0 2023-12-19T16:16:15.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec8ffff640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fec78065a60 0x7fec78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fec90082e90 con 0x7fec981593f0 2023-12-19T16:16:15.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.482+0000 7fec96ffd640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fec78065a60 0x7fec78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.486+0000 7fec96ffd640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fec78065a60 0x7fec78067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec88007fd0 tx=0x7fec88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.486+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fec98141170 con 0x7fec981593f0 2023-12-19T16:16:15.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec98141170 con 0x7fec981593f0 2023-12-19T16:16:15.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec8ffff640 1 -- 172.21.15.119:0/2793926578 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec98141170 con 0x7fec981593f0 2023-12-19T16:16:15.642 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:15.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fec78065a60 msgr2=0x7fec78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fec78065a60 0x7fec78067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec88007fd0 tx=0x7fec88009040 comp rx=0 tx=0).stop 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 msgr2=0x7fec980aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 0x7fec980aca40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec90001570 tx=0x7fec9000cca0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 shutdown_connections 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fec78065a60 0x7fec78067f20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec981593f0 0x7fec980aca40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec980ce590 0x7fec9813dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 --2- 172.21.15.119:0/2793926578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec980706e0 0x7fec98141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 >> 172.21.15.119:0/2793926578 conn(0x7fec9806d8d0 msgr2=0x7fec980b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 shutdown_connections 2023-12-19T16:16:15.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.638+0000 7fec9d404640 1 -- 172.21.15.119:0/2793926578 wait complete. 2023-12-19T16:16:15.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:15.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 Processor -- start 2023-12-19T16:16:15.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 -- start start 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcba40c1280 0x7fcba40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcba40cb340 0x7fcba40cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba406fdb0 con 0x7fcba4160cc0 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba41654a0 con 0x7fcba40cb340 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbabfce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba41610a0 con 0x7fcba40c1280 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcba40cb340 0x7fcba40cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcba40cb340 0x7fcba40cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48298/0 (socket says 172.21.15.119:48298) 2023-12-19T16:16:15.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 -- 172.21.15.119:0/3189312981 learned_addr learned my addr 172.21.15.119:0/3189312981 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:15.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcba9569640 1 --2- 172.21.15.119:0/3189312981 >> v2:172.21.15.143:3300/0 conn(0x7fcba40c1280 0x7fcba40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 -- 172.21.15.119:0/3189312981 >> v2:172.21.15.143:3300/0 conn(0x7fcba40c1280 msgr2=0x7fcba40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:15.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 --2- 172.21.15.119:0/3189312981 >> v2:172.21.15.143:3300/0 conn(0x7fcba40c1280 0x7fcba40cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 -- 172.21.15.119:0/3189312981 >> v1:172.21.15.143:6789/0 conn(0x7fcba4160cc0 legacy=0x7fcba40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.798+0000 7fcbaa56b640 1 -- 172.21.15.119:0/3189312981 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4164820 con 0x7fcba40cb340 2023-12-19T16:16:15.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbaa56b640 1 --2- 172.21.15.119:0/3189312981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40cb340 0x7fcba40cc940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcba40c8ad0 tx=0x7fcb9c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a635fa27adefcd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcba8d68640 1 -- 172.21.15.119:0/3189312981 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0a56e0 con 0x7fcba40cb340 2023-12-19T16:16:15.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcba8d68640 1 -- 172.21.15.119:0/3189312981 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0a5840 con 0x7fcba40cb340 2023-12-19T16:16:15.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcba8d68640 1 -- 172.21.15.119:0/3189312981 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0a5bd0 con 0x7fcba40cb340 2023-12-19T16:16:15.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 -- 172.21.15.119:0/3189312981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40cb340 msgr2=0x7fcba40cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 --2- 172.21.15.119:0/3189312981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40cb340 0x7fcba40cc940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcba40c8ad0 tx=0x7fcb9c01c910 comp rx=0 tx=0).stop 2023-12-19T16:16:15.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 -- 172.21.15.119:0/3189312981 shutdown_connections 2023-12-19T16:16:15.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 --2- 172.21.15.119:0/3189312981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40cb340 0x7fcba40cc940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 --2- 172.21.15.119:0/3189312981 >> v2:172.21.15.143:3300/0 conn(0x7fcba40c1280 0x7fcba40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 -- 172.21.15.119:0/3189312981 >> 172.21.15.119:0/3189312981 conn(0x7fcba406a3e0 msgr2=0x7fcba40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 -- 172.21.15.119:0/3189312981 shutdown_connections 2023-12-19T16:16:15.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 -- 172.21.15.119:0/3189312981 wait complete. 2023-12-19T16:16:15.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.802+0000 7fcbabfce640 1 Processor -- start 2023-12-19T16:16:15.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- start start 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 0x7fcba4155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcba40cb340 0x7fcba4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcba4160cc0 0x7fcba4153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba415a3c0 con 0x7fcba40c1280 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4159b00 con 0x7fcba40cb340 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4159d70 con 0x7fcba4160cc0 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 0x7fcba4155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 0x7fcba4155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48304/0 (socket says 172.21.15.119:48304) 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 -- 172.21.15.119:0/167710406 learned_addr learned my addr 172.21.15.119:0/167710406 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:15.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9569640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcba40cb340 0x7fcba4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbaa56b640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcba4160cc0 0x7fcba4153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 -- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcba4160cc0 msgr2=0x7fcba4153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcba4160cc0 0x7fcba4153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 -- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcba40cb340 msgr2=0x7fcba4157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcba40cb340 0x7fcba4157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 -- 172.21.15.119:0/167710406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009b30 con 0x7fcba40c1280 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcba9d6a640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 0x7fcba4155960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c3f0 tx=0x7fcba000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00052d0 con 0x7fcba40c1280 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0005430 con 0x7fcba40c1280 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba415a050 con 0x7fcba40c1280 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0003840 con 0x7fcba40c1280 2023-12-19T16:16:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba41585e0 con 0x7fcba40c1280 2023-12-19T16:16:15.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.806+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba40735b0 con 0x7fcba40c1280 2023-12-19T16:16:15.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.810+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcba00039a0 con 0x7fcba40c1280 2023-12-19T16:16:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.810+0000 7fcb9a7fc640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb88065a60 0x7fcb88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.810+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fcba0082a50 con 0x7fcba40c1280 2023-12-19T16:16:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.810+0000 7fcba9569640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb88065a60 0x7fcb88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.810+0000 7fcba9569640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb88065a60 0x7fcb88067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcba40adc40 tx=0x7fcb94009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.814+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcba00500b0 con 0x7fcba40c1280 2023-12-19T16:16:15.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcba40adc70 con 0x7fcba40c1280 2023-12-19T16:16:15.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcb9a7fc640 1 -- 172.21.15.119:0/167710406 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcba00536d0 con 0x7fcba40c1280 2023-12-19T16:16:15.979 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb88065a60 msgr2=0x7fcb88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb88065a60 0x7fcb88067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcba40adc40 tx=0x7fcb94009190 comp rx=0 tx=0).stop 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 msgr2=0x7fcba4155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 0x7fcba4155960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c3f0 tx=0x7fcba000c8b0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 shutdown_connections 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcb88065a60 0x7fcb88067f20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcba40cb340 0x7fcba4157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcba4160cc0 0x7fcba4153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 --2- 172.21.15.119:0/167710406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba40c1280 0x7fcba4155960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.974+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 >> 172.21.15.119:0/167710406 conn(0x7fcba406a3e0 msgr2=0x7fcba40ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.978+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 shutdown_connections 2023-12-19T16:16:15.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:15.978+0000 7fcbabfce640 1 -- 172.21.15.119:0/167710406 wait complete. 2023-12-19T16:16:16.000 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:16:16.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:16.000 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:16.020 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:16.021 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:16:16.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:16.021 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:16:16.078 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:16:16.078 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:16.088 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:16:16.088 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:16.143 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:16.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 Processor -- start 2023-12-19T16:16:16.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 -- start start 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f73dc06c4f0 0x7f73dc0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f73dc0c9e30 0x7f73dc0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc0c9460 con 0x7f73dc1570c0 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc1574a0 con 0x7f73dc06c4f0 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e3f8f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0c8b30 con 0x7f73dc0c9e30 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e1d2b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f73dc1570c0 0x7f73dc06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33354/0 (socket says 172.21.15.119:33354) 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e1d2b640 1 -- 172.21.15.119:0/461492293 learned_addr learned my addr 172.21.15.119:0/461492293 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e152a640 1 --2- 172.21.15.119:0/461492293 >> v2:172.21.15.119:3300/0 conn(0x7f73dc06c4f0 0x7f73dc0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e252c640 1 --2- 172.21.15.119:0/461492293 >> v2:172.21.15.143:3300/0 conn(0x7f73dc0c9e30 0x7f73dc0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e0d29640 1 -- 172.21.15.119:0/461492293 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103315908 0 0) 0x7f73dc0c9460 con 0x7f73dc1570c0 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e0d29640 1 -- 172.21.15.119:0/461492293 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c8003530 con 0x7f73dc1570c0 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e152a640 1 -- 172.21.15.119:0/461492293 >> v2:172.21.15.143:3300/0 conn(0x7f73dc0c9e30 msgr2=0x7f73dc0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e152a640 1 --2- 172.21.15.119:0/461492293 >> v2:172.21.15.143:3300/0 conn(0x7f73dc0c9e30 0x7f73dc0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e152a640 1 -- 172.21.15.119:0/461492293 >> v1:172.21.15.119:6789/0 conn(0x7f73dc1570c0 legacy=0x7f73dc06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.278+0000 7f73e152a640 1 -- 172.21.15.119:0/461492293 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0c8e10 con 0x7f73dc06c4f0 2023-12-19T16:16:16.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e152a640 1 --2- 172.21.15.119:0/461492293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c98f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06fb70 tx=0x7f73cc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612b5e7b47e3ec78 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e0d29640 1 -- 172.21.15.119:0/461492293 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0ad660 con 0x7f73dc06c4f0 2023-12-19T16:16:16.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e0d29640 1 -- 172.21.15.119:0/461492293 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0ad7c0 con 0x7f73dc06c4f0 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e0d29640 1 -- 172.21.15.119:0/461492293 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0adb50 con 0x7f73dc06c4f0 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 -- 172.21.15.119:0/461492293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 msgr2=0x7f73dc0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/461492293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c98f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06fb70 tx=0x7f73cc01c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 -- 172.21.15.119:0/461492293 shutdown_connections 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/461492293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c98f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/461492293 >> v2:172.21.15.143:3300/0 conn(0x7f73dc0c9e30 0x7f73dc0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 -- 172.21.15.119:0/461492293 >> 172.21.15.119:0/461492293 conn(0x7f73dc06a3e0 msgr2=0x7f73dc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 -- 172.21.15.119:0/461492293 shutdown_connections 2023-12-19T16:16:16.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.282+0000 7f73e3f8f640 1 -- 172.21.15.119:0/461492293 wait complete. 2023-12-19T16:16:16.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 Processor -- start 2023-12-19T16:16:16.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- start start 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73dc0c9e30 0x7f73dc0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73dc1570c0 0x7f73dc1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc14a160 con 0x7f73dc06c4f0 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc158160 con 0x7f73dc1570c0 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0c41f0 con 0x7f73dc0c9e30 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48310/0 (socket says 172.21.15.119:48310) 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 -- 172.21.15.119:0/4171147215 learned_addr learned my addr 172.21.15.119:0/4171147215 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e152a640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73dc0c9e30 0x7f73dc0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e252c640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73dc1570c0 0x7f73dc1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 -- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73dc0c9e30 msgr2=0x7f73dc0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73dc0c9e30 0x7f73dc0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 -- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73dc1570c0 msgr2=0x7f73dc1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73dc1570c0 0x7f73dc1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 -- 172.21.15.119:0/4171147215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc009420 con 0x7f73dc06c4f0 2023-12-19T16:16:16.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e1d2b640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c5e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c420 tx=0x7f73d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8005cf0 con 0x7f73dc06c4f0 2023-12-19T16:16:16.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8005e50 con 0x7f73dc06c4f0 2023-12-19T16:16:16.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80072d0 con 0x7f73dc06c4f0 2023-12-19T16:16:16.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc14a340 con 0x7f73dc06c4f0 2023-12-19T16:16:16.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc0c33d0 con 0x7f73dc06c4f0 2023-12-19T16:16:16.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.286+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc0735b0 con 0x7f73dc06c4f0 2023-12-19T16:16:16.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.290+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73d8007430 con 0x7f73dc06c4f0 2023-12-19T16:16:16.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.290+0000 7f73d27fc640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73c0065a90 0x7f73c0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.290+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f73d8082a30 con 0x7f73dc06c4f0 2023-12-19T16:16:16.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.290+0000 7f73e152a640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73c0065a90 0x7f73c0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.290+0000 7f73e152a640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73c0065a90 0x7f73c0067f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0af000 tx=0x7f73cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.294+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f73d8050080 con 0x7f73dc06c4f0 2023-12-19T16:16:16.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.446+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73dc04e000 con 0x7f73dc06c4f0 2023-12-19T16:16:16.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.446+0000 7f73d27fc640 1 -- 172.21.15.119:0/4171147215 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f73d8017090 con 0x7f73dc06c4f0 2023-12-19T16:16:16.452 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:16.452 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73c0065a90 msgr2=0x7f73c0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73c0065a90 0x7f73c0067f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0af000 tx=0x7f73cc008040 comp rx=0 tx=0).stop 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 msgr2=0x7f73dc0c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c5e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c420 tx=0x7f73d800c8e0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 shutdown_connections 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73c0065a90 0x7f73c0067f50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73dc1570c0 0x7f73dc1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73dc0c9e30 0x7f73dc0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 --2- 172.21.15.119:0/4171147215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73dc06c4f0 0x7f73dc0c5e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.454 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 >> 172.21.15.119:0/4171147215 conn(0x7f73dc06a3e0 msgr2=0x7f73dc0c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 shutdown_connections 2023-12-19T16:16:16.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.450+0000 7f73e3f8f640 1 -- 172.21.15.119:0/4171147215 wait complete. 2023-12-19T16:16:16.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:16.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:16.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 Processor -- start 2023-12-19T16:16:16.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 -- start start 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feed8071870 0x7feed8071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feed80cbff0 0x7feed80cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed80cc930 con 0x7feed80ca410 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed815aab0 con 0x7feed80cbff0 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feedd16d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed8070df0 con 0x7feed8071870 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feed80cbff0 0x7feed80cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed6d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7feed80ca410 0x7feed8159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33368/0 (socket says 172.21.15.119:33368) 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed6d9d640 1 -- 172.21.15.119:0/59360533 learned_addr learned my addr 172.21.15.119:0/59360533 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:16.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feed80cbff0 0x7feed80cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48316/0 (socket says 172.21.15.119:48316) 2023-12-19T16:16:16.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed659c640 1 --2- 172.21.15.119:0/59360533 >> v2:172.21.15.143:3300/0 conn(0x7feed8071870 0x7feed8071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed759e640 1 -- 172.21.15.119:0/59360533 >> v2:172.21.15.143:3300/0 conn(0x7feed8071870 msgr2=0x7feed8071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed759e640 1 --2- 172.21.15.119:0/59360533 >> v2:172.21.15.143:3300/0 conn(0x7feed8071870 0x7feed8071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed5d9b640 1 -- 172.21.15.119:0/59360533 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936785197 0 0) 0x7feed80cc930 con 0x7feed80ca410 2023-12-19T16:16:16.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed759e640 1 -- 172.21.15.119:0/59360533 >> v1:172.21.15.119:6789/0 conn(0x7feed80ca410 legacy=0x7feed8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.614+0000 7feed759e640 1 -- 172.21.15.119:0/59360533 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed815a4f0 con 0x7feed80cbff0 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feed759e640 1 --2- 172.21.15.119:0/59360533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed80cc3f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feed80cbeb0 tx=0x7feed001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78948598db4dad28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feed5d9b640 1 -- 172.21.15.119:0/59360533 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00a59a0 con 0x7feed80cbff0 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feed5d9b640 1 -- 172.21.15.119:0/59360533 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed00a5b00 con 0x7feed80cbff0 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feed5d9b640 1 -- 172.21.15.119:0/59360533 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00a5e90 con 0x7feed80cbff0 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 -- 172.21.15.119:0/59360533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 msgr2=0x7feed80cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 --2- 172.21.15.119:0/59360533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed80cc3f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feed80cbeb0 tx=0x7feed001c8e0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 -- 172.21.15.119:0/59360533 shutdown_connections 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 --2- 172.21.15.119:0/59360533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed80cc3f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 --2- 172.21.15.119:0/59360533 >> v2:172.21.15.143:3300/0 conn(0x7feed8071870 0x7feed8071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 -- 172.21.15.119:0/59360533 >> 172.21.15.119:0/59360533 conn(0x7feed806a2a0 msgr2=0x7feed80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 -- 172.21.15.119:0/59360533 shutdown_connections 2023-12-19T16:16:16.625 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.618+0000 7feedd16d640 1 -- 172.21.15.119:0/59360533 wait complete. 2023-12-19T16:16:16.626 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 Processor -- start 2023-12-19T16:16:16.626 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 -- start start 2023-12-19T16:16:16.628 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feed8071870 0x7feed80c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.628 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feed80ca410 0x7feed8150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.628 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed8151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.628 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed814ea70 con 0x7feed80cbff0 2023-12-19T16:16:16.628 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80c1ad0 con 0x7feed80ca410 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed814def0 con 0x7feed8071870 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed8151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48322/0 (socket says 172.21.15.119:48322) 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 -- 172.21.15.119:0/1948902792 learned_addr learned my addr 172.21.15.119:0/1948902792 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed6d9d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feed8071870 0x7feed80c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed659c640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feed80ca410 0x7feed8150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 -- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feed8071870 msgr2=0x7feed80c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feed8071870 0x7feed80c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 -- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feed80ca410 msgr2=0x7feed8150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feed80ca410 0x7feed8150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 -- 172.21.15.119:0/1948902792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0009a70 con 0x7feed80cbff0 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed659c640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feed80ca410 0x7feed8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feed759e640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed8151300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feed00194f0 tx=0x7feed0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.629 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00add70 con 0x7feed80cbff0 2023-12-19T16:16:16.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0009450 con 0x7feed80cbff0 2023-12-19T16:16:16.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00b9690 con 0x7feed80cbff0 2023-12-19T16:16:16.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed814e1d0 con 0x7feed80cbff0 2023-12-19T16:16:16.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.622+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed814e790 con 0x7feed80cbff0 2023-12-19T16:16:16.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.626+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed804e000 con 0x7feed80cbff0 2023-12-19T16:16:16.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.626+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feed00b97f0 con 0x7feed80cbff0 2023-12-19T16:16:16.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.626+0000 7feebf7fe640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feec4065a60 0x7feec4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.626+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7feed011ed10 con 0x7feed80cbff0 2023-12-19T16:16:16.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.626+0000 7feed6d9d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feec4065a60 0x7feec4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.626+0000 7feed6d9d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feec4065a60 0x7feec4067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feec8007fd0 tx=0x7feec8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.630+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feed00ec2d0 con 0x7feed80cbff0 2023-12-19T16:16:16.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.778+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feed815c360 con 0x7feed80cbff0 2023-12-19T16:16:16.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.778+0000 7feebf7fe640 1 -- 172.21.15.119:0/1948902792 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7feed00ef8f0 con 0x7feed80cbff0 2023-12-19T16:16:16.784 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:16.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feec4065a60 msgr2=0x7feec4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feec4065a60 0x7feec4067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feec8007fd0 tx=0x7feec8009040 comp rx=0 tx=0).stop 2023-12-19T16:16:16.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 msgr2=0x7feed8151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed8151300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feed00194f0 tx=0x7feed0019680 comp rx=0 tx=0).stop 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 shutdown_connections 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feec4065a60 0x7feec4067f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feed80ca410 0x7feed8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feed80cbff0 0x7feed8151300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 --2- 172.21.15.119:0/1948902792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feed8071870 0x7feed80c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 >> 172.21.15.119:0/1948902792 conn(0x7feed806a2a0 msgr2=0x7feed81505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 shutdown_connections 2023-12-19T16:16:16.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.782+0000 7feedd16d640 1 -- 172.21.15.119:0/1948902792 wait complete. 2023-12-19T16:16:16.805 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:16.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f893da41640 1 Processor -- start 2023-12-19T16:16:16.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f893da41640 1 -- start start 2023-12-19T16:16:16.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f893da41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 0x7f89381610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f893da41640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89380ced90 con 0x7f89380cc7f0 2023-12-19T16:16:16.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f893da41640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89380cf220 con 0x7f89380b2780 2023-12-19T16:16:16.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f893da41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893815cfb0 con 0x7f893815cbd0 2023-12-19T16:16:16.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f89380cc7f0 0x7f89380b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33384/0 (socket says 172.21.15.119:33384) 2023-12-19T16:16:16.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 -- 172.21.15.119:0/3094522625 learned_addr learned my addr 172.21.15.119:0/3094522625 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f8936ffd640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 0x7f89381610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625216153 0 0) 0x7f89380ced90 con 0x7f89380cc7f0 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8924003530 con 0x7f89380cc7f0 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099701772 0 0) 0x7f8924003530 con 0x7f89380cc7f0 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 msgr2=0x7f89381610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 0x7f89381610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 >> v1:172.21.15.143:6789/0 conn(0x7f89380b2780 legacy=0x7f893806b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380ccc50 con 0x7f89380cc7f0 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f8920001680 con 0x7f89380cc7f0 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 >> v1:172.21.15.119:6789/0 conn(0x7f89380cc7f0 legacy=0x7f89380b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 0x7f89240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8924003f30 0x7f89240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8924004d10 0x7f8924005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815cfb0 con 0x7f8924003f30 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892400ba70 con 0x7f8924004d10 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892400bc30 con 0x7f893815cbd0 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8924003f30 0x7f89240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f8936ffd640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 0x7f89240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89377fe640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8924004d10 0x7f8924005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 -- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 msgr2=0x7f89240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f893815cbd0 0x7f89240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 -- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8924004d10 msgr2=0x7f8924005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8924004d10 0x7f8924005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f892e7fc640 1 -- 172.21.15.119:0/3094522625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924003530 con 0x7f8924003f30 2023-12-19T16:16:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.942+0000 7f89377fe640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8924004d10 0x7f8924005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f892e7fc640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8924003f30 0x7f89240047d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f892000c1c0 tx=0x7f892001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca17c53494cb799 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920005ae0 con 0x7f8924003f30 2023-12-19T16:16:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89200ab070 con 0x7f8924003f30 2023-12-19T16:16:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f89367fc640 1 -- 172.21.15.119:0/3094522625 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920007070 con 0x7f8924003f30 2023-12-19T16:16:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f893da41640 1 -- 172.21.15.119:0/3094522625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8924003f30 msgr2=0x7f89240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f893da41640 1 --2- 172.21.15.119:0/3094522625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8924003f30 0x7f89240047d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f892000c1c0 tx=0x7f892001f390 comp rx=0 tx=0).stop 2023-12-19T16:16:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f89377fe640 1 -- 172.21.15.119:0/3094522625 reap_dead start 2023-12-19T16:16:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f893da41640 1 -- 172.21.15.119:0/3094522625 shutdown_connections 2023-12-19T16:16:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f893da41640 1 -- 172.21.15.119:0/3094522625 >> 172.21.15.119:0/3094522625 conn(0x7f89380cd070 msgr2=0x7f89380cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f893da41640 1 -- 172.21.15.119:0/3094522625 shutdown_connections 2023-12-19T16:16:16.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.946+0000 7f893da41640 1 -- 172.21.15.119:0/3094522625 wait complete. 2023-12-19T16:16:16.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 Processor -- start 2023-12-19T16:16:16.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 -- start start 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8924003f30 0x7f89381f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f893815f890 0x7f8938156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 0x7f8938146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8938156330 con 0x7f8938156c90 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89381f1f60 con 0x7f893815f890 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89381556b0 con 0x7f8924003f30 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 0x7f8938146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 0x7f8938146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48342/0 (socket says 172.21.15.119:48342) 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 -- 172.21.15.119:0/3798609002 learned_addr learned my addr 172.21.15.119:0/3798609002 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f8936ffd640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8924003f30 0x7f89381f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f892e7fc640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f893815f890 0x7f8938156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 -- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8924003f30 msgr2=0x7f89381f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8924003f30 0x7f89381f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.956 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 -- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f893815f890 msgr2=0x7f8938156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f893815f890 0x7f8938156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 -- 172.21.15.119:0/3798609002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938155990 con 0x7f8938156c90 2023-12-19T16:16:16.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f89377fe640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 0x7f8938146230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8930000f90 tx=0x7f893000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930017070 con 0x7f8938156c90 2023-12-19T16:16:16.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930003b90 con 0x7f8938156c90 2023-12-19T16:16:16.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930003d40 con 0x7f8938156c90 2023-12-19T16:16:16.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8938155c70 con 0x7f8938156c90 2023-12-19T16:16:16.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.950+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8938146f30 con 0x7f8938156c90 2023-12-19T16:16:16.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.954+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8938156470 con 0x7f8938156c90 2023-12-19T16:16:16.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.954+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89300050d0 con 0x7f8938156c90 2023-12-19T16:16:16.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.954+0000 7f8934ff9640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8918065a60 0x7f8918067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.954+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8930082b40 con 0x7f8938156c90 2023-12-19T16:16:16.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.954+0000 7f8936ffd640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8918065a60 0x7f8918067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.954+0000 7f8936ffd640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8918065a60 0x7f8918067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8928009bc0 tx=0x7f8928006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:16.958+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8938156470 con 0x7f8938156c90 2023-12-19T16:16:17.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.106+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8938156470 con 0x7f8938156c90 2023-12-19T16:16:17.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.106+0000 7f8934ff9640 1 -- 172.21.15.119:0/3798609002 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8938156470 con 0x7f8938156c90 2023-12-19T16:16:17.112 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8918065a60 msgr2=0x7f8918067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8918065a60 0x7f8918067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8928009bc0 tx=0x7f8928006f90 comp rx=0 tx=0).stop 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 msgr2=0x7f8938146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 0x7f8938146230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8930000f90 tx=0x7f893000ead0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 shutdown_connections 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8918065a60 0x7f8918067f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f893815f890 0x7f8938156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8938156c90 0x7f8938146230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 --2- 172.21.15.119:0/3798609002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8924003f30 0x7f89381f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 >> 172.21.15.119:0/3798609002 conn(0x7f89380cd070 msgr2=0x7f89380b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 shutdown_connections 2023-12-19T16:16:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.110+0000 7f893da41640 1 -- 172.21.15.119:0/3798609002 wait complete. 2023-12-19T16:16:17.133 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.266+0000 7f67702fc640 1 Processor -- start 2023-12-19T16:16:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.266+0000 7f67702fc640 1 -- start start 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f67702fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6768071870 0x7f6768071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f67702fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f67680cbff0 0x7f67680cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f67702fc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680cc930 con 0x7f67680ca410 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f67702fc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676815aab0 con 0x7f6768071870 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f67702fc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6768070df0 con 0x7f67680cbff0 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6768071870 0x7f6768071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6768071870 0x7f6768071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48350/0 (socket says 172.21.15.119:48350) 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 -- 172.21.15.119:0/3781670264 learned_addr learned my addr 172.21.15.119:0/3781670264 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676e899640 1 --2- 172.21.15.119:0/3781670264 >> v2:172.21.15.143:3300/0 conn(0x7f67680cbff0 0x7f67680cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 -- 172.21.15.119:0/3781670264 >> v2:172.21.15.143:3300/0 conn(0x7f67680cbff0 msgr2=0x7f67680cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 --2- 172.21.15.119:0/3781670264 >> v2:172.21.15.143:3300/0 conn(0x7f67680cbff0 0x7f67680cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 -- 172.21.15.119:0/3781670264 >> v1:172.21.15.143:6789/0 conn(0x7f67680ca410 legacy=0x7f6768159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676d897640 1 -- 172.21.15.119:0/3781670264 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676815a4f0 con 0x7f6768071870 2023-12-19T16:16:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.270+0000 7f676e899640 1 --2- 172.21.15.119:0/3781670264 >> v2:172.21.15.143:3300/0 conn(0x7f67680cbff0 0x7f67680cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:17.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f676d897640 1 --2- 172.21.15.119:0/3781670264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768071870 0x7f6768071d00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67680cbeb0 tx=0x7f675801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a5d395f135a7bd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f676d096640 1 -- 172.21.15.119:0/3781670264 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580ab670 con 0x7f6768071870 2023-12-19T16:16:17.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f676d096640 1 -- 172.21.15.119:0/3781670264 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580ab7d0 con 0x7f6768071870 2023-12-19T16:16:17.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f676d096640 1 -- 172.21.15.119:0/3781670264 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580abb60 con 0x7f6768071870 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 -- 172.21.15.119:0/3781670264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768071870 msgr2=0x7f6768071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 --2- 172.21.15.119:0/3781670264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768071870 0x7f6768071d00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67680cbeb0 tx=0x7f675801c470 comp rx=0 tx=0).stop 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 -- 172.21.15.119:0/3781670264 shutdown_connections 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 --2- 172.21.15.119:0/3781670264 >> v2:172.21.15.143:3300/0 conn(0x7f67680cbff0 0x7f67680cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 --2- 172.21.15.119:0/3781670264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768071870 0x7f6768071d00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 -- 172.21.15.119:0/3781670264 >> 172.21.15.119:0/3781670264 conn(0x7f676806a2a0 msgr2=0x7f67680aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 -- 172.21.15.119:0/3781670264 shutdown_connections 2023-12-19T16:16:17.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 -- 172.21.15.119:0/3781670264 wait complete. 2023-12-19T16:16:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.274+0000 7f67702fc640 1 Processor -- start 2023-12-19T16:16:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- start start 2023-12-19T16:16:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6768071870 0x7f676814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 0x7f67680c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67680cbff0 0x7f67681586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768151110 con 0x7f67680ca410 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676814c750 con 0x7f67680cbff0 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67680c6e70 con 0x7f6768071870 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 0x7f67680c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 0x7f67680c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48362/0 (socket says 172.21.15.119:48362) 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 -- 172.21.15.119:0/2620475058 learned_addr learned my addr 172.21.15.119:0/2620475058 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676e098640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6768071870 0x7f676814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676e899640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67680cbff0 0x7f67681586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 -- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6768071870 msgr2=0x7f676814c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6768071870 0x7f676814c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 -- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67680cbff0 msgr2=0x7f67681586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67680cbff0 0x7f67681586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 -- 172.21.15.119:0/2620475058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580094d0 con 0x7f67680ca410 2023-12-19T16:16:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676e899640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67680cbff0 0x7f67681586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f676d897640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 0x7f67680c1f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f675801a0a0 tx=0x7f675801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580b48c0 con 0x7f67680ca410 2023-12-19T16:16:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580b4a20 con 0x7f67680ca410 2023-12-19T16:16:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67680c8500 con 0x7f67680ca410 2023-12-19T16:16:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580b4db0 con 0x7f67680ca410 2023-12-19T16:16:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6768150870 con 0x7f67680ca410 2023-12-19T16:16:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.278+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676804e000 con 0x7f67680ca410 2023-12-19T16:16:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.282+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f67580c7390 con 0x7f67680ca410 2023-12-19T16:16:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.282+0000 7f675effd640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f674c065a90 0x7f674c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.282+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f675811e100 con 0x7f67680ca410 2023-12-19T16:16:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.282+0000 7f676e098640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f674c065a90 0x7f674c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.282+0000 7f676e098640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f674c065a90 0x7f674c067f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6764004e30 tx=0x7f6764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.286+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f67580eb6a0 con 0x7f67680ca410 2023-12-19T16:16:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.434+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6768150b50 con 0x7f67680ca410 2023-12-19T16:16:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.434+0000 7f675effd640 1 -- 172.21.15.119:0/2620475058 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67580eecc0 con 0x7f67680ca410 2023-12-19T16:16:17.440 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f674c065a90 msgr2=0x7f674c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f674c065a90 0x7f674c067f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6764004e30 tx=0x7f6764009040 comp rx=0 tx=0).stop 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 msgr2=0x7f67680c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 0x7f67680c1f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f675801a0a0 tx=0x7f675801acb0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 shutdown_connections 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f674c065a90 0x7f674c067f50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67680cbff0 0x7f67681586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67680ca410 0x7f67680c1f50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 --2- 172.21.15.119:0/2620475058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6768071870 0x7f676814c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 >> 172.21.15.119:0/2620475058 conn(0x7f676806a2a0 msgr2=0x7f676815b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 shutdown_connections 2023-12-19T16:16:17.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.438+0000 7f67702fc640 1 -- 172.21.15.119:0/2620475058 wait complete. 2023-12-19T16:16:17.461 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:17.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.594+0000 7f248777b640 1 Processor -- start 2023-12-19T16:16:17.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f248777b640 1 -- start start 2023-12-19T16:16:17.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f248777b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24800ca410 0x7f2480159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f248777b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2480159fb0 0x7f2480071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f248777b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2480070df0 con 0x7f2480071db0 2023-12-19T16:16:17.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f248777b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248015aab0 con 0x7f2480159fb0 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f248777b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248015a4f0 con 0x7f24800ca410 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2480159fb0 0x7f2480071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2480159fb0 0x7f2480071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48364/0 (socket says 172.21.15.119:48364) 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 -- 172.21.15.119:0/2515031480 learned_addr learned my addr 172.21.15.119:0/2515031480 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2485517640 1 --2- 172.21.15.119:0/2515031480 >> v2:172.21.15.143:3300/0 conn(0x7f24800ca410 0x7f2480159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 -- 172.21.15.119:0/2515031480 >> v2:172.21.15.143:3300/0 conn(0x7f24800ca410 msgr2=0x7f2480159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 --2- 172.21.15.119:0/2515031480 >> v2:172.21.15.143:3300/0 conn(0x7f24800ca410 0x7f2480159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 -- 172.21.15.119:0/2515031480 >> v1:172.21.15.143:6789/0 conn(0x7f2480071db0 legacy=0x7f24800cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.598+0000 7f2484d16640 1 -- 172.21.15.119:0/2515031480 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248015a7d0 con 0x7f2480159fb0 2023-12-19T16:16:17.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f2484d16640 1 --2- 172.21.15.119:0/2515031480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480159fb0 0x7f2480071870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f24800cbfa0 tx=0x7f247001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4df1bfa53d2c12a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f2477fff640 1 -- 172.21.15.119:0/2515031480 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700ac640 con 0x7f2480159fb0 2023-12-19T16:16:17.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f2477fff640 1 -- 172.21.15.119:0/2515031480 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700ac7a0 con 0x7f2480159fb0 2023-12-19T16:16:17.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f2477fff640 1 -- 172.21.15.119:0/2515031480 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700acb30 con 0x7f2480159fb0 2023-12-19T16:16:17.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 -- 172.21.15.119:0/2515031480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480159fb0 msgr2=0x7f2480071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 --2- 172.21.15.119:0/2515031480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480159fb0 0x7f2480071870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f24800cbfa0 tx=0x7f247001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 -- 172.21.15.119:0/2515031480 shutdown_connections 2023-12-19T16:16:17.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 --2- 172.21.15.119:0/2515031480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480159fb0 0x7f2480071870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 --2- 172.21.15.119:0/2515031480 >> v2:172.21.15.143:3300/0 conn(0x7f24800ca410 0x7f2480159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 -- 172.21.15.119:0/2515031480 >> 172.21.15.119:0/2515031480 conn(0x7f248006a2a0 msgr2=0x7f24800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 -- 172.21.15.119:0/2515031480 shutdown_connections 2023-12-19T16:16:17.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 -- 172.21.15.119:0/2515031480 wait complete. 2023-12-19T16:16:17.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 Processor -- start 2023-12-19T16:16:17.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.602+0000 7f248777b640 1 -- start start 2023-12-19T16:16:17.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 0x7f2480151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24800ca410 0x7f24801545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2480159fb0 0x7f2480154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24801562b0 con 0x7f2480071db0 2023-12-19T16:16:17.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480155e20 con 0x7f2480159fb0 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2480155210 con 0x7f24800ca410 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 0x7f2480151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 0x7f2480151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48368/0 (socket says 172.21.15.119:48368) 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 -- 172.21.15.119:0/82209544 learned_addr learned my addr 172.21.15.119:0/82209544 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2484d16640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24800ca410 0x7f24801545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485d18640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2480159fb0 0x7f2480154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 -- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24800ca410 msgr2=0x7f24801545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24800ca410 0x7f24801545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 -- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2480159fb0 msgr2=0x7f2480154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2480159fb0 0x7f2480154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 -- 172.21.15.119:0/82209544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700094d0 con 0x7f2480071db0 2023-12-19T16:16:17.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2485517640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 0x7f2480151470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f247c00e930 tx=0x7f247c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c009690 con 0x7f2480071db0 2023-12-19T16:16:17.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c00ca00 con 0x7f2480071db0 2023-12-19T16:16:17.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c00cd70 con 0x7f2480071db0 2023-12-19T16:16:17.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24801554f0 con 0x7f2480071db0 2023-12-19T16:16:17.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2480155ab0 con 0x7f2480071db0 2023-12-19T16:16:17.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.606+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248004e000 con 0x7f2480071db0 2023-12-19T16:16:17.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.610+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f247c013470 con 0x7f2480071db0 2023-12-19T16:16:17.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.610+0000 7f2475ffb640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2464065a90 0x7f2464067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.610+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f247c0836e0 con 0x7f2480071db0 2023-12-19T16:16:17.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.610+0000 7f2484d16640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2464065a90 0x7f2464067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.610+0000 7f2484d16640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2464065a90 0x7f2464067f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24700ae000 tx=0x7f2470008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.614+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f247c050e00 con 0x7f2480071db0 2023-12-19T16:16:17.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.762+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24801668a0 con 0x7f2480071db0 2023-12-19T16:16:17.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.762+0000 7f2475ffb640 1 -- 172.21.15.119:0/82209544 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f247c054420 con 0x7f2480071db0 2023-12-19T16:16:17.769 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2464065a90 msgr2=0x7f2464067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2464065a90 0x7f2464067f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24700ae000 tx=0x7f2470008040 comp rx=0 tx=0).stop 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 msgr2=0x7f2480151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 0x7f2480151470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f247c00e930 tx=0x7f247c00edf0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 shutdown_connections 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2464065a90 0x7f2464067f50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2480159fb0 0x7f2480154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24800ca410 0x7f24801545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 --2- 172.21.15.119:0/82209544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2480071db0 0x7f2480151470 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 >> 172.21.15.119:0/82209544 conn(0x7f248006a2a0 msgr2=0x7f2480157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 shutdown_connections 2023-12-19T16:16:17.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.766+0000 7f248777b640 1 -- 172.21.15.119:0/82209544 wait complete. 2023-12-19T16:16:17.791 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:17.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 Processor -- start 2023-12-19T16:16:17.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 -- start start 2023-12-19T16:16:17.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb68415c9d0 0x7fb6840cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6840cdd40 0x7fb684160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb684161060 0x7fb68406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6841603f0 con 0x7fb6840cdd40 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684160690 con 0x7fb68415c9d0 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb6890f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840b0d80 con 0x7fb684161060 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6840cdd40 0x7fb684160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6840cdd40 0x7fb684160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48376/0 (socket says 172.21.15.119:48376) 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 -- 172.21.15.119:0/1328772144 learned_addr learned my addr 172.21.15.119:0/1328772144 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb68359e640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb684161060 0x7fb68406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb682d9d640 1 --2- 172.21.15.119:0/1328772144 >> v2:172.21.15.143:3300/0 conn(0x7fb68415c9d0 0x7fb6840cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 -- 172.21.15.119:0/1328772144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb684161060 msgr2=0x7fb68406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb684161060 0x7fb68406fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 -- 172.21.15.119:0/1328772144 >> v2:172.21.15.143:3300/0 conn(0x7fb68415c9d0 msgr2=0x7fb6840cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 --2- 172.21.15.119:0/1328772144 >> v2:172.21.15.143:3300/0 conn(0x7fb68415c9d0 0x7fb6840cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb67bfff640 1 -- 172.21.15.119:0/1328772144 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840ccb00 con 0x7fb6840cdd40 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb68359e640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb684161060 0x7fb68406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.926+0000 7fb682d9d640 1 --2- 172.21.15.119:0/1328772144 >> v2:172.21.15.143:3300/0 conn(0x7fb68415c9d0 0x7fb6840cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb67bfff640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6840cdd40 0x7fb684160b20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb68406cff0 tx=0x7fb66c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd60a7c6b3cf2a90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb68259c640 1 -- 172.21.15.119:0/1328772144 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0aa640 con 0x7fb6840cdd40 2023-12-19T16:16:17.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb68259c640 1 -- 172.21.15.119:0/1328772144 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c0aa7a0 con 0x7fb6840cdd40 2023-12-19T16:16:17.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb68259c640 1 -- 172.21.15.119:0/1328772144 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0aab30 con 0x7fb6840cdd40 2023-12-19T16:16:17.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 -- 172.21.15.119:0/1328772144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6840cdd40 msgr2=0x7fb684160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6840cdd40 0x7fb684160b20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb68406cff0 tx=0x7fb66c01c500 comp rx=0 tx=0).stop 2023-12-19T16:16:17.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 -- 172.21.15.119:0/1328772144 shutdown_connections 2023-12-19T16:16:17.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb684161060 0x7fb68406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 --2- 172.21.15.119:0/1328772144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6840cdd40 0x7fb684160b20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 --2- 172.21.15.119:0/1328772144 >> v2:172.21.15.143:3300/0 conn(0x7fb68415c9d0 0x7fb6840cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 -- 172.21.15.119:0/1328772144 >> 172.21.15.119:0/1328772144 conn(0x7fb68406a3e0 msgr2=0x7fb6840afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 -- 172.21.15.119:0/1328772144 shutdown_connections 2023-12-19T16:16:17.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.930+0000 7fb6890f9640 1 -- 172.21.15.119:0/1328772144 wait complete. 2023-12-19T16:16:17.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 Processor -- start 2023-12-19T16:16:17.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- start start 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6840cdd40 0x7fb68414b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 0x7fb68414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb684161060 0x7fb6840acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414bb90 con 0x7fb68415c9d0 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841587a0 con 0x7fb684161060 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841584c0 con 0x7fb6840cdd40 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 0x7fb68414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 0x7fb68414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48384/0 (socket says 172.21.15.119:48384) 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 -- 172.21.15.119:0/507700496 learned_addr learned my addr 172.21.15.119:0/507700496 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb68359e640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb684161060 0x7fb6840acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb682d9d640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6840cdd40 0x7fb68414b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 -- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6840cdd40 msgr2=0x7fb68414b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6840cdd40 0x7fb68414b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 -- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb684161060 msgr2=0x7fb6840acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb684161060 0x7fb6840acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 -- 172.21.15.119:0/507700496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0094d0 con 0x7fb68415c9d0 2023-12-19T16:16:17.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67bfff640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 0x7fb68414b650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb66c01abb0 tx=0x7fb66c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0bd5f0 con 0x7fb68415c9d0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c0bd750 con 0x7fb68415c9d0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840c7390 con 0x7fb68415c9d0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0bdb00 con 0x7fb68415c9d0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840c7950 con 0x7fb68415c9d0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.934+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6840735b0 con 0x7fb68415c9d0 2023-12-19T16:16:17.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.938+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb66c0a8050 con 0x7fb68415c9d0 2023-12-19T16:16:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.938+0000 7fb67b7fe640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.938+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb66c11e120 con 0x7fb68415c9d0 2023-12-19T16:16:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.938+0000 7fb682d9d640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.938+0000 7fb682d9d640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb684155410 tx=0x7fb674008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:17.942+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb66c0eb8a0 con 0x7fb68415c9d0 2023-12-19T16:16:18.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.102+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb68404e000 con 0x7fb68415c9d0 2023-12-19T16:16:18.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.102+0000 7fb67b7fe640 1 -- 172.21.15.119:0/507700496 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb66c0eeec0 con 0x7fb68415c9d0 2023-12-19T16:16:18.109 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:18.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 msgr2=0x7fb664067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb684155410 tx=0x7fb674008040 comp rx=0 tx=0).stop 2023-12-19T16:16:18.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 msgr2=0x7fb68414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 0x7fb68414b650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb66c01abb0 tx=0x7fb66c01ad40 comp rx=0 tx=0).stop 2023-12-19T16:16:18.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 shutdown_connections 2023-12-19T16:16:18.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb684161060 0x7fb6840acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68415c9d0 0x7fb68414b650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 --2- 172.21.15.119:0/507700496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6840cdd40 0x7fb68414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 >> 172.21.15.119:0/507700496 conn(0x7fb68406a3e0 msgr2=0x7fb6840ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 shutdown_connections 2023-12-19T16:16:18.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.106+0000 7fb6890f9640 1 -- 172.21.15.119:0/507700496 wait complete. 2023-12-19T16:16:18.130 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:16:18.130 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:18.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:18.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 Processor -- start 2023-12-19T16:16:18.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 -- start start 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51c00cf0d0 0x7f51c00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c01648d0 0x7f51c0166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c00cfa70 con 0x7f51c015ca40 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c00d11c0 con 0x7f51c00cf0d0 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c8509640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00d0310 con 0x7f51c01648d0 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51c00cf0d0 0x7f51c00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51c00cf0d0 0x7f51c00cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48398/0 (socket says 172.21.15.119:48398) 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 -- 172.21.15.119:0/608941235 learned_addr learned my addr 172.21.15.119:0/608941235 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c62a5640 1 --1- 172.21.15.119:0/608941235 >> v1:172.21.15.119:6789/0 conn(0x7f51c015ca40 0x7f51c00cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33386/0 (socket says 172.21.15.119:33386) 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c6aa6640 1 --2- 172.21.15.119:0/608941235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c01648d0 0x7f51c0166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 -- 172.21.15.119:0/608941235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c01648d0 msgr2=0x7f51c0166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 --2- 172.21.15.119:0/608941235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c01648d0 0x7f51c0166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 -- 172.21.15.119:0/608941235 >> v1:172.21.15.119:6789/0 conn(0x7f51c015ca40 legacy=0x7f51c00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c5aa4640 1 -- 172.21.15.119:0/608941235 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00d05b0 con 0x7f51c00cf0d0 2023-12-19T16:16:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.274+0000 7f51c52a3640 1 -- 172.21.15.119:0/608941235 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380743387 0 0) 0x7f51c00cfa70 con 0x7f51c015ca40 2023-12-19T16:16:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c5aa4640 1 --2- 172.21.15.119:0/608941235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c00cf0d0 0x7f51c00cf530 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51b0006fd0 tx=0x7f51b001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779b90deae1bc065 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c52a3640 1 -- 172.21.15.119:0/608941235 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00aa650 con 0x7f51c00cf0d0 2023-12-19T16:16:18.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c52a3640 1 -- 172.21.15.119:0/608941235 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b00aa7b0 con 0x7f51c00cf0d0 2023-12-19T16:16:18.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c52a3640 1 -- 172.21.15.119:0/608941235 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00aab40 con 0x7f51c00cf0d0 2023-12-19T16:16:18.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 -- 172.21.15.119:0/608941235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c00cf0d0 msgr2=0x7f51c00cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 --2- 172.21.15.119:0/608941235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c00cf0d0 0x7f51c00cf530 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51b0006fd0 tx=0x7f51b001c4f0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 -- 172.21.15.119:0/608941235 shutdown_connections 2023-12-19T16:16:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 --2- 172.21.15.119:0/608941235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c01648d0 0x7f51c0166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 --2- 172.21.15.119:0/608941235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c00cf0d0 0x7f51c00cf530 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 -- 172.21.15.119:0/608941235 >> 172.21.15.119:0/608941235 conn(0x7f51c0089fb0 msgr2=0x7f51c00d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 -- 172.21.15.119:0/608941235 shutdown_connections 2023-12-19T16:16:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.278+0000 7f51c8509640 1 -- 172.21.15.119:0/608941235 wait complete. 2023-12-19T16:16:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 Processor -- start 2023-12-19T16:16:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- start start 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c00cf0d0 0x7f51c0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51c015ca40 0x7f51c015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 0x7f51c015d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0165e50 con 0x7f51c01648d0 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c015e790 con 0x7f51c015ca40 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c015db80 con 0x7f51c00cf0d0 2023-12-19T16:16:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 0x7f51c015d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 0x7f51c015d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48406/0 (socket says 172.21.15.119:48406) 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 -- 172.21.15.119:0/2273247183 learned_addr learned my addr 172.21.15.119:0/2273247183 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c62a5640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c00cf0d0 0x7f51c0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c5aa4640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51c015ca40 0x7f51c015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 -- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c00cf0d0 msgr2=0x7f51c0157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c00cf0d0 0x7f51c0157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 -- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51c015ca40 msgr2=0x7f51c015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51c015ca40 0x7f51c015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 -- 172.21.15.119:0/2273247183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0009480 con 0x7f51c01648d0 2023-12-19T16:16:18.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c6aa6640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 0x7f51c015d4e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f51b8007d80 tx=0x7f51b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8014420 con 0x7f51c01648d0 2023-12-19T16:16:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8014580 con 0x7f51c01648d0 2023-12-19T16:16:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8014930 con 0x7f51c01648d0 2023-12-19T16:16:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c015de60 con 0x7f51c01648d0 2023-12-19T16:16:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c015e420 con 0x7f51c01648d0 2023-12-19T16:16:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.282+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c00d1630 con 0x7f51c01648d0 2023-12-19T16:16:18.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.286+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51b8014a90 con 0x7f51c01648d0 2023-12-19T16:16:18.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.286+0000 7f51b6ffd640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f51a4065a60 0x7f51a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.286+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f51b8083d70 con 0x7f51c01648d0 2023-12-19T16:16:18.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.286+0000 7f51c62a5640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f51a4065a60 0x7f51a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.286+0000 7f51c62a5640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f51a4065a60 0x7f51a4067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f51bc001030 tx=0x7f51bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.290+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f51c00d1630 con 0x7f51c01648d0 2023-12-19T16:16:18.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.442+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51c00d1630 con 0x7f51c01648d0 2023-12-19T16:16:18.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51b6ffd640 1 -- 172.21.15.119:0/2273247183 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f51c00d1630 con 0x7f51c01648d0 2023-12-19T16:16:18.450 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:18.450 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:18.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f51a4065a60 msgr2=0x7f51a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f51a4065a60 0x7f51a4067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f51bc001030 tx=0x7f51bc009040 comp rx=0 tx=0).stop 2023-12-19T16:16:18.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 msgr2=0x7f51c015d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 0x7f51c015d4e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f51b8007d80 tx=0x7f51b800e4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 shutdown_connections 2023-12-19T16:16:18.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f51a4065a60 0x7f51a4067f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51c015ca40 0x7f51c015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51c01648d0 0x7f51c015d4e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 --2- 172.21.15.119:0/2273247183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51c00cf0d0 0x7f51c0157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 >> 172.21.15.119:0/2273247183 conn(0x7f51c0089fb0 msgr2=0x7f51c015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 shutdown_connections 2023-12-19T16:16:18.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.446+0000 7f51c8509640 1 -- 172.21.15.119:0/2273247183 wait complete. 2023-12-19T16:16:18.456 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:18.460 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:18.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:18.472 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:18.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 Processor -- start 2023-12-19T16:16:18.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 -- start start 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f39c00ca410 0x7f39c0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39c00cbff0 0x7f39c00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c00cc930 con 0x7f39c0159fb0 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c015aab0 con 0x7f39c00cbff0 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c71f3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c0070df0 con 0x7f39c00ca410 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.682+0000 7f39c5790640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39c00cbff0 0x7f39c00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39c00cbff0 0x7f39c00cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48408/0 (socket says 172.21.15.119:48408) 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 -- 172.21.15.119:0/3252182880 learned_addr learned my addr 172.21.15.119:0/3252182880 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c4f8f640 1 --2- 172.21.15.119:0/3252182880 >> v2:172.21.15.143:3300/0 conn(0x7f39c00ca410 0x7f39c0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 -- 172.21.15.119:0/3252182880 >> v2:172.21.15.143:3300/0 conn(0x7f39c00ca410 msgr2=0x7f39c0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:18.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 --2- 172.21.15.119:0/3252182880 >> v2:172.21.15.143:3300/0 conn(0x7f39c00ca410 0x7f39c0159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 -- 172.21.15.119:0/3252182880 >> v1:172.21.15.143:6789/0 conn(0x7f39c0159fb0 legacy=0x7f39c0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.690 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 -- 172.21.15.119:0/3252182880 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c015a4f0 con 0x7f39c00cbff0 2023-12-19T16:16:18.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39c5790640 1 --2- 172.21.15.119:0/3252182880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c00cbff0 0x7f39c00cc3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f39c00cbfa0 tx=0x7f39b801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b445e8de6261f1ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39b77fe640 1 -- 172.21.15.119:0/3252182880 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80a5860 con 0x7f39c00cbff0 2023-12-19T16:16:18.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39b77fe640 1 -- 172.21.15.119:0/3252182880 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80a59c0 con 0x7f39c00cbff0 2023-12-19T16:16:18.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.686+0000 7f39b77fe640 1 -- 172.21.15.119:0/3252182880 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80a5d50 con 0x7f39c00cbff0 2023-12-19T16:16:18.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- 172.21.15.119:0/3252182880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c00cbff0 msgr2=0x7f39c00cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 --2- 172.21.15.119:0/3252182880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c00cbff0 0x7f39c00cc3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f39c00cbfa0 tx=0x7f39b801c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- 172.21.15.119:0/3252182880 shutdown_connections 2023-12-19T16:16:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 --2- 172.21.15.119:0/3252182880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c00cbff0 0x7f39c00cc3f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 --2- 172.21.15.119:0/3252182880 >> v2:172.21.15.143:3300/0 conn(0x7f39c00ca410 0x7f39c0159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- 172.21.15.119:0/3252182880 >> 172.21.15.119:0/3252182880 conn(0x7f39c006a2a0 msgr2=0x7f39c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- 172.21.15.119:0/3252182880 shutdown_connections 2023-12-19T16:16:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- 172.21.15.119:0/3252182880 wait complete. 2023-12-19T16:16:18.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 Processor -- start 2023-12-19T16:16:18.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- start start 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39c00ca410 0x7f39c00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39c00cbff0 0x7f39c014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 0x7f39c0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c0149940 con 0x7f39c0159fb0 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00ae4b0 con 0x7f39c00cbff0 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c71f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c0149660 con 0x7f39c00ca410 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 0x7f39c0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 0x7f39c0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48424/0 (socket says 172.21.15.119:48424) 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 -- 172.21.15.119:0/2938531672 learned_addr learned my addr 172.21.15.119:0/2938531672 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c4f8f640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39c00ca410 0x7f39c00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39b7fff640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39c00cbff0 0x7f39c014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 -- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39c00ca410 msgr2=0x7f39c00c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39c00ca410 0x7f39c00c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 -- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39c00cbff0 msgr2=0x7f39c014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39c00cbff0 0x7f39c014f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.690+0000 7f39c5790640 1 -- 172.21.15.119:0/2938531672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009b30 con 0x7f39c0159fb0 2023-12-19T16:16:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39c5790640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 0x7f39c0155710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39b80af040 tx=0x7f39b8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80bd070 con 0x7f39c0159fb0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80b8470 con 0x7f39c0159fb0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80b8800 con 0x7f39c0159fb0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c014b0a0 con 0x7f39c0159fb0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c014ad50 con 0x7f39c0159fb0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c014b550 con 0x7f39c0159fb0 2023-12-19T16:16:18.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39b80b8960 con 0x7f39c0159fb0 2023-12-19T16:16:18.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39b57fa640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39ac065a60 0x7f39ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f39b811e4f0 con 0x7f39c0159fb0 2023-12-19T16:16:18.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39c4f8f640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39ac065a60 0x7f39ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.694+0000 7f39c4f8f640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39ac065a60 0x7f39ac067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39c00cf400 tx=0x7f39bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.698+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39b80ebc00 con 0x7f39c0159fb0 2023-12-19T16:16:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.846+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39c004e000 con 0x7f39c0159fb0 2023-12-19T16:16:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.846+0000 7f39b57fa640 1 -- 172.21.15.119:0/2938531672 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39b80ef220 con 0x7f39c0159fb0 2023-12-19T16:16:18.853 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39ac065a60 msgr2=0x7f39ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39ac065a60 0x7f39ac067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39c00cf400 tx=0x7f39bc009190 comp rx=0 tx=0).stop 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 msgr2=0x7f39c0155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 0x7f39c0155710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39b80af040 tx=0x7f39b8019740 comp rx=0 tx=0).stop 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 shutdown_connections 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f39ac065a60 0x7f39ac067f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39c00cbff0 0x7f39c014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39c0159fb0 0x7f39c0155710 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 --2- 172.21.15.119:0/2938531672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39c00ca410 0x7f39c00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 >> 172.21.15.119:0/2938531672 conn(0x7f39c006a2a0 msgr2=0x7f39c015ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 shutdown_connections 2023-12-19T16:16:18.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:18.850+0000 7f39c71f3640 1 -- 172.21.15.119:0/2938531672 wait complete. 2023-12-19T16:16:18.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 Processor -- start 2023-12-19T16:16:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 -- start start 2023-12-19T16:16:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba641582d0 0x7fba640c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba640ce3b0 0x7fba640ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640c9390 con 0x7fba64070820 2023-12-19T16:16:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640ced60 con 0x7fba641582d0 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6bbce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6415aee0 con 0x7fba640ce3b0 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba641582d0 0x7fba640c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba641582d0 0x7fba640c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48434/0 (socket says 172.21.15.119:48434) 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 -- 172.21.15.119:0/2179295699 learned_addr learned my addr 172.21.15.119:0/2179295699 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6a16b640 1 --2- 172.21.15.119:0/2179295699 >> v2:172.21.15.143:3300/0 conn(0x7fba640ce3b0 0x7fba640ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 -- 172.21.15.119:0/2179295699 >> v2:172.21.15.143:3300/0 conn(0x7fba640ce3b0 msgr2=0x7fba640ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 --2- 172.21.15.119:0/2179295699 >> v2:172.21.15.143:3300/0 conn(0x7fba640ce3b0 0x7fba640ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 -- 172.21.15.119:0/2179295699 >> v1:172.21.15.119:6789/0 conn(0x7fba64070820 legacy=0x7fba640ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba6996a640 1 -- 172.21.15.119:0/2179295699 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6415b1c0 con 0x7fba641582d0 2023-12-19T16:16:19.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.010+0000 7fba68968640 1 -- 172.21.15.119:0/2179295699 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424422135 0 0) 0x7fba640c9390 con 0x7fba64070820 2023-12-19T16:16:19.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6996a640 1 --2- 172.21.15.119:0/2179295699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba641582d0 0x7fba640c8e50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba6406fbb0 tx=0x7fba6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f84d17c1398ac11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba68968640 1 -- 172.21.15.119:0/2179295699 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600aa430 con 0x7fba641582d0 2023-12-19T16:16:19.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba68968640 1 -- 172.21.15.119:0/2179295699 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba600aa590 con 0x7fba641582d0 2023-12-19T16:16:19.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba68968640 1 -- 172.21.15.119:0/2179295699 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600aa920 con 0x7fba641582d0 2023-12-19T16:16:19.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 -- 172.21.15.119:0/2179295699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba641582d0 msgr2=0x7fba640c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 --2- 172.21.15.119:0/2179295699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba641582d0 0x7fba640c8e50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba6406fbb0 tx=0x7fba6001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 -- 172.21.15.119:0/2179295699 shutdown_connections 2023-12-19T16:16:19.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 --2- 172.21.15.119:0/2179295699 >> v2:172.21.15.143:3300/0 conn(0x7fba640ce3b0 0x7fba640ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 --2- 172.21.15.119:0/2179295699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba641582d0 0x7fba640c8e50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 -- 172.21.15.119:0/2179295699 >> 172.21.15.119:0/2179295699 conn(0x7fba6406a2a0 msgr2=0x7fba640aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 -- 172.21.15.119:0/2179295699 shutdown_connections 2023-12-19T16:16:19.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.014+0000 7fba6bbce640 1 -- 172.21.15.119:0/2179295699 wait complete. 2023-12-19T16:16:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 Processor -- start 2023-12-19T16:16:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- start start 2023-12-19T16:16:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 0x7fba641554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba640ce3b0 0x7fba64154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba641582d0 0x7fba640c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640c3e80 con 0x7fba64070820 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64155d60 con 0x7fba640ce3b0 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6415c220 con 0x7fba641582d0 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 0x7fba641554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 0x7fba641554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48448/0 (socket says 172.21.15.119:48448) 2023-12-19T16:16:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 -- 172.21.15.119:0/429523920 learned_addr learned my addr 172.21.15.119:0/429523920 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6a16b640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba641582d0 0x7fba640c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba69169640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba640ce3b0 0x7fba64154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 -- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba641582d0 msgr2=0x7fba640c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba641582d0 0x7fba640c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 -- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba640ce3b0 msgr2=0x7fba64154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba640ce3b0 0x7fba64154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 -- 172.21.15.119:0/429523920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba600094d0 con 0x7fba64070820 2023-12-19T16:16:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6a16b640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba641582d0 0x7fba640c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba69169640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba640ce3b0 0x7fba64154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6996a640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 0x7fba641554e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fba600190e0 tx=0x7fba6001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600b3800 con 0x7fba64070820 2023-12-19T16:16:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba600b3980 con 0x7fba64070820 2023-12-19T16:16:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600b3d30 con 0x7fba64070820 2023-12-19T16:16:19.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6415c4c0 con 0x7fba64070820 2023-12-19T16:16:19.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6415ca80 con 0x7fba64070820 2023-12-19T16:16:19.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.018+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6415cc70 con 0x7fba64070820 2023-12-19T16:16:19.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.022+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba600b2380 con 0x7fba64070820 2023-12-19T16:16:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.022+0000 7fba5a7fc640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba48065a90 0x7fba48067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.022+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fba6011d710 con 0x7fba64070820 2023-12-19T16:16:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.022+0000 7fba69169640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba48065a90 0x7fba48067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.022+0000 7fba69169640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba48065a90 0x7fba48067f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba640af740 tx=0x7fba54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.026+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba600ead60 con 0x7fba64070820 2023-12-19T16:16:19.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba6404e000 con 0x7fba64070820 2023-12-19T16:16:19.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba5a7fc640 1 -- 172.21.15.119:0/429523920 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba600ee380 con 0x7fba64070820 2023-12-19T16:16:19.178 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:19.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba48065a90 msgr2=0x7fba48067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba48065a90 0x7fba48067f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba640af740 tx=0x7fba54009040 comp rx=0 tx=0).stop 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 msgr2=0x7fba641554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 0x7fba641554e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fba600190e0 tx=0x7fba6001ad10 comp rx=0 tx=0).stop 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 shutdown_connections 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba48065a90 0x7fba48067f50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba640ce3b0 0x7fba64154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba641582d0 0x7fba640c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 --2- 172.21.15.119:0/429523920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba64070820 0x7fba641554e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 >> 172.21.15.119:0/429523920 conn(0x7fba6406a2a0 msgr2=0x7fba640ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 shutdown_connections 2023-12-19T16:16:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.174+0000 7fba6bbce640 1 -- 172.21.15.119:0/429523920 wait complete. 2023-12-19T16:16:19.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f1935ee5640 1 Processor -- start 2023-12-19T16:16:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f1935ee5640 1 -- start start 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f1935ee5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19300ca410 0x7f1930159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f1935ee5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1930070df0 con 0x7f19300cbff0 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f1935ee5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193015a4f0 con 0x7f1930159fb0 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f1935ee5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193015aab0 con 0x7f19300ca410 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f192f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19300ca410 0x7f1930159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f192f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19300ca410 0x7f1930159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48458/0 (socket says 172.21.15.119:48458) 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f192f7fe640 1 -- 172.21.15.119:0/1770273975 learned_addr learned my addr 172.21.15.119:0/1770273975 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f192f7fe640 1 -- 172.21.15.119:0/1770273975 >> v1:172.21.15.143:6789/0 conn(0x7f1930159fb0 legacy=0x7f1930071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f192f7fe640 1 -- 172.21.15.119:0/1770273975 >> v1:172.21.15.119:6789/0 conn(0x7f19300cbff0 legacy=0x7f19300ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.334+0000 7f192f7fe640 1 -- 172.21.15.119:0/1770273975 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193015a7d0 con 0x7f19300ca410 2023-12-19T16:16:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f192f7fe640 1 --2- 172.21.15.119:0/1770273975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930159a70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f192001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7a4f8ade12e1d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f192effd640 1 -- 172.21.15.119:0/1770273975 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200aa430 con 0x7f19300ca410 2023-12-19T16:16:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f192effd640 1 -- 172.21.15.119:0/1770273975 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19200aa590 con 0x7f19300ca410 2023-12-19T16:16:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f192effd640 1 -- 172.21.15.119:0/1770273975 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200aa920 con 0x7f19300ca410 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 -- 172.21.15.119:0/1770273975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 msgr2=0x7f1930159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1770273975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930159a70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f192001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 -- 172.21.15.119:0/1770273975 shutdown_connections 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1770273975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930159a70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 -- 172.21.15.119:0/1770273975 >> 172.21.15.119:0/1770273975 conn(0x7f193006a2a0 msgr2=0x7f19300aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 -- 172.21.15.119:0/1770273975 shutdown_connections 2023-12-19T16:16:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.338+0000 7f1935ee5640 1 -- 172.21.15.119:0/1770273975 wait complete. 2023-12-19T16:16:19.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 Processor -- start 2023-12-19T16:16:19.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- start start 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19300cbff0 0x7f1930150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1930159fb0 0x7f19300ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193015b370 con 0x7f19300ca410 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1930151360 con 0x7f19300cbff0 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19300c5850 con 0x7f1930159fb0 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48468/0 (socket says 172.21.15.119:48468) 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 -- 172.21.15.119:0/1449299533 learned_addr learned my addr 172.21.15.119:0/1449299533 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:19.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 -- 172.21.15.119:0/1449299533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1930159fb0 msgr2=0x7f19300ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1930159fb0 0x7f19300ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 -- 172.21.15.119:0/1449299533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19300cbff0 msgr2=0x7f1930150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19300cbff0 0x7f1930150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 -- 172.21.15.119:0/1449299533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200094d0 con 0x7f19300ca410 2023-12-19T16:16:19.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192f7fe640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930151a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f19200ac040 tx=0x7f192001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200b3800 con 0x7f19300ca410 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19200b3960 con 0x7f19300ca410 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193015ca40 con 0x7f19300ca410 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200b3d10 con 0x7f19300ca410 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193015c760 con 0x7f19300ca410 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.342+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193004e000 con 0x7f19300ca410 2023-12-19T16:16:19.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.346+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19200bc390 con 0x7f19300ca410 2023-12-19T16:16:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.346+0000 7f192cff9640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1910065a60 0x7f1910067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.346+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f192011dbd0 con 0x7f19300ca410 2023-12-19T16:16:19.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.346+0000 7f1927fff640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1910065a60 0x7f1910067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.346+0000 7f1927fff640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1910065a60 0x7f1910067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f19300ca8d0 tx=0x7f19180079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.350+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f19200eb220 con 0x7f19300ca410 2023-12-19T16:16:19.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.502+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19301564b0 con 0x7f19300ca410 2023-12-19T16:16:19.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.502+0000 7f192cff9640 1 -- 172.21.15.119:0/1449299533 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19200ee840 con 0x7f19300ca410 2023-12-19T16:16:19.508 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1910065a60 msgr2=0x7f1910067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1910065a60 0x7f1910067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f19300ca8d0 tx=0x7f19180079c0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 msgr2=0x7f1930151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930151a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f19200ac040 tx=0x7f192001ad10 comp rx=0 tx=0).stop 2023-12-19T16:16:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 shutdown_connections 2023-12-19T16:16:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1910065a60 0x7f1910067f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19300cbff0 0x7f1930150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1930159fb0 0x7f19300ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 --2- 172.21.15.119:0/1449299533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19300ca410 0x7f1930151a60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 >> 172.21.15.119:0/1449299533 conn(0x7f193006a2a0 msgr2=0x7f19300ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 shutdown_connections 2023-12-19T16:16:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.506+0000 7f1935ee5640 1 -- 172.21.15.119:0/1449299533 wait complete. 2023-12-19T16:16:19.529 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.662+0000 7f2ae45f3640 1 Processor -- start 2023-12-19T16:16:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.662+0000 7f2ae45f3640 1 -- start start 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae45f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2adc070820 0x7f2adc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae45f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae45f3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0c9390 con 0x7f2adc1582d0 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae45f3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0ced80 con 0x7f2adc070820 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae45f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15aee0 con 0x7f2adc0ce3b0 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae238f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2adc1582d0 0x7f2adc0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33410/0 (socket says 172.21.15.119:33410) 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae238f640 1 -- 172.21.15.119:0/2006576569 learned_addr learned my addr 172.21.15.119:0/2006576569 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae1b8e640 1 --2- 172.21.15.119:0/2006576569 >> v2:172.21.15.119:3300/0 conn(0x7f2adc070820 0x7f2adc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae2b90640 1 --2- 172.21.15.119:0/2006576569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae138d640 1 -- 172.21.15.119:0/2006576569 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679210185 0 0) 0x7f2adc0c9390 con 0x7f2adc1582d0 2023-12-19T16:16:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae138d640 1 -- 172.21.15.119:0/2006576569 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac8003530 con 0x7f2adc1582d0 2023-12-19T16:16:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae1b8e640 1 -- 172.21.15.119:0/2006576569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 msgr2=0x7f2adc0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae1b8e640 1 --2- 172.21.15.119:0/2006576569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae1b8e640 1 -- 172.21.15.119:0/2006576569 >> v1:172.21.15.119:6789/0 conn(0x7f2adc1582d0 legacy=0x7f2adc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.666+0000 7f2ae1b8e640 1 -- 172.21.15.119:0/2006576569 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc15b1c0 con 0x7f2adc070820 2023-12-19T16:16:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae1b8e640 1 --2- 172.21.15.119:0/2006576569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc070820 0x7f2adc0c8e50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0097c0 tx=0x7f2acc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72d9b064985ec77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae138d640 1 -- 172.21.15.119:0/2006576569 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0ab650 con 0x7f2adc070820 2023-12-19T16:16:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae138d640 1 -- 172.21.15.119:0/2006576569 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc0ab7b0 con 0x7f2adc070820 2023-12-19T16:16:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae138d640 1 -- 172.21.15.119:0/2006576569 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0abb20 con 0x7f2adc070820 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 -- 172.21.15.119:0/2006576569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc070820 msgr2=0x7f2adc0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/2006576569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc070820 0x7f2adc0c8e50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0097c0 tx=0x7f2acc01c450 comp rx=0 tx=0).stop 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 -- 172.21.15.119:0/2006576569 shutdown_connections 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/2006576569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/2006576569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc070820 0x7f2adc0c8e50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 -- 172.21.15.119:0/2006576569 >> 172.21.15.119:0/2006576569 conn(0x7f2adc06a2a0 msgr2=0x7f2adc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 -- 172.21.15.119:0/2006576569 shutdown_connections 2023-12-19T16:16:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 -- 172.21.15.119:0/2006576569 wait complete. 2023-12-19T16:16:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 Processor -- start 2023-12-19T16:16:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.670+0000 7f2ae45f3640 1 -- start start 2023-12-19T16:16:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2adc070820 0x7f2adc14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 0x7f2adc15e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc14d8c0 con 0x7f2adc1582d0 2023-12-19T16:16:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc14e220 con 0x7f2adc070820 2023-12-19T16:16:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc148710 con 0x7f2adc0ce3b0 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 0x7f2adc15e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 0x7f2adc15e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48480/0 (socket says 172.21.15.119:48480) 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 -- 172.21.15.119:0/1275969274 learned_addr learned my addr 172.21.15.119:0/1275969274 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae1b8e640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae238f640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2adc070820 0x7f2adc14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 -- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 msgr2=0x7f2adc1481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc1481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 -- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2adc070820 msgr2=0x7f2adc14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2adc070820 0x7f2adc14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 -- 172.21.15.119:0/1275969274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc009420 con 0x7f2adc1582d0 2023-12-19T16:16:19.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae2b90640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 0x7f2adc15e840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007e40 tx=0x7f2ad400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4014620 con 0x7f2adc1582d0 2023-12-19T16:16:19.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400ee90 con 0x7f2adc1582d0 2023-12-19T16:16:19.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40149e0 con 0x7f2adc1582d0 2023-12-19T16:16:19.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc14cc40 con 0x7f2adc1582d0 2023-12-19T16:16:19.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc14d200 con 0x7f2adc1582d0 2023-12-19T16:16:19.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.674+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc14da00 con 0x7f2adc1582d0 2023-12-19T16:16:19.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.678+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ad4014b40 con 0x7f2adc1582d0 2023-12-19T16:16:19.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.678+0000 7f2ad2ffd640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ac0065a60 0x7f2ac0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.678+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2ad4083eb0 con 0x7f2adc1582d0 2023-12-19T16:16:19.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.678+0000 7f2ae238f640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ac0065a60 0x7f2ac0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.678+0000 7f2ae238f640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ac0065a60 0x7f2ac0067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8007fd0 tx=0x7f2ad8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.682+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2adc14da00 con 0x7f2adc1582d0 2023-12-19T16:16:19.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.830+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2adc14da00 con 0x7f2adc1582d0 2023-12-19T16:16:19.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.830+0000 7f2ad2ffd640 1 -- 172.21.15.119:0/1275969274 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2adc14da00 con 0x7f2adc1582d0 2023-12-19T16:16:19.836 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:19.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ac0065a60 msgr2=0x7f2ac0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ac0065a60 0x7f2ac0067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8007fd0 tx=0x7f2ad8009040 comp rx=0 tx=0).stop 2023-12-19T16:16:19.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 msgr2=0x7f2adc15e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 0x7f2adc15e840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007e40 tx=0x7f2ad400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 shutdown_connections 2023-12-19T16:16:19.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ac0065a60 0x7f2ac0067f20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc1582d0 0x7f2adc15e840 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2adc0ce3b0 0x7f2adc1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 --2- 172.21.15.119:0/1275969274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2adc070820 0x7f2adc14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 >> 172.21.15.119:0/1275969274 conn(0x7f2adc06a2a0 msgr2=0x7f2adc154210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 shutdown_connections 2023-12-19T16:16:19.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.834+0000 7f2ae45f3640 1 -- 172.21.15.119:0/1275969274 wait complete. 2023-12-19T16:16:19.858 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:19.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 Processor -- start 2023-12-19T16:16:19.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 -- start start 2023-12-19T16:16:19.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93f006c4f0 0x7f93f00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 0x7f93f0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00c9460 con 0x7f93f01570c0 2023-12-19T16:16:19.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f01574a0 con 0x7f93f006c4f0 2023-12-19T16:16:19.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f7e55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00c8b30 con 0x7f93f00c9e30 2023-12-19T16:16:19.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f5bf1640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f93f01570c0 0x7f93f006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33414/0 (socket says 172.21.15.119:33414) 2023-12-19T16:16:20.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f5bf1640 1 -- 172.21.15.119:0/2754525789 learned_addr learned my addr 172.21.15.119:0/2754525789 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f53f0640 1 --2- 172.21.15.119:0/2754525789 >> v2:172.21.15.143:3300/0 conn(0x7f93f006c4f0 0x7f93f00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 0x7f93f0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269539049 0 0) 0x7f93f00c9460 con 0x7f93f01570c0 2023-12-19T16:16:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93dc005740 con 0x7f93f01570c0 2023-12-19T16:16:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638771184 0 0) 0x7f93dc005740 con 0x7f93f01570c0 2023-12-19T16:16:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 msgr2=0x7f93f0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 0x7f93f0070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 >> v2:172.21.15.143:3300/0 conn(0x7f93f006c4f0 msgr2=0x7f93f00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 --2- 172.21.15.119:0/2754525789 >> v2:172.21.15.143:3300/0 conn(0x7f93f006c4f0 0x7f93f00c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00c8e10 con 0x7f93f01570c0 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f93ec001680 con 0x7f93f01570c0 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 >> v1:172.21.15.119:6789/0 conn(0x7f93f01570c0 legacy=0x7f93f006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc005b90 0x7f93dc005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 0x7f93dc0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93dc006f20 0x7f93dc0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f01574a0 con 0x7f93dc006f20 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00c8b30 con 0x7f93dc005b90 2023-12-19T16:16:20.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc00dba0 con 0x7f93f00c9e30 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f53f0640 1 --2- 172.21.15.119:0/2754525789 >> v2:172.21.15.143:3300/0 conn(0x7f93f006c4f0 0x7f93f00c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.994+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93dc006f20 0x7f93dc0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f5bf1640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc005b90 0x7f93dc005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f53f0640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 0x7f93dc0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 -- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 msgr2=0x7f93dc0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00c9e30 0x7f93dc0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 -- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc005b90 msgr2=0x7f93dc005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc005b90 0x7f93dc005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 -- 172.21.15.119:0/2754525789 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc005740 con 0x7f93dc006f20 2023-12-19T16:16:20.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93dc006f20 0x7f93dc0073a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009fc0 tx=0x7f93e801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733e3950a7528139 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80a5b60 con 0x7f93dc006f20 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e800f040 con 0x7f93dc006f20 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f4bef640 1 -- 172.21.15.119:0/2754525789 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ad440 con 0x7f93dc006f20 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f7e55640 1 -- 172.21.15.119:0/2754525789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93dc006f20 msgr2=0x7f93dc0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2754525789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93dc006f20 0x7f93dc0073a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009fc0 tx=0x7f93e801cc60 comp rx=0 tx=0).stop 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f63f2640 1 -- 172.21.15.119:0/2754525789 reap_dead start 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:19.998+0000 7f93f7e55640 1 -- 172.21.15.119:0/2754525789 shutdown_connections 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- 172.21.15.119:0/2754525789 >> 172.21.15.119:0/2754525789 conn(0x7f93f006a3e0 msgr2=0x7f93f00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- 172.21.15.119:0/2754525789 shutdown_connections 2023-12-19T16:16:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- 172.21.15.119:0/2754525789 wait complete. 2023-12-19T16:16:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 Processor -- start 2023-12-19T16:16:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- start start 2023-12-19T16:16:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc006f20 0x7f93f0158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f014f600 0x7f93f00c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 0x7f93f01f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00cb310 con 0x7f93f01f1290 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f01f1c50 con 0x7f93dc006f20 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f7e55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f015a020 con 0x7f93f014f600 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 0x7f93f01f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 0x7f93f01f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48510/0 (socket says 172.21.15.119:48510) 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 -- 172.21.15.119:0/2153144117 learned_addr learned my addr 172.21.15.119:0/2153144117 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f53f0640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f014f600 0x7f93f00c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f5bf1640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc006f20 0x7f93f0158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 -- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f014f600 msgr2=0x7f93f00c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f014f600 0x7f93f00c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 -- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc006f20 msgr2=0x7f93f0158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc006f20 0x7f93f0158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 -- 172.21.15.119:0/2153144117 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f015a300 con 0x7f93f01f1290 2023-12-19T16:16:20.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.002+0000 7f93f63f2640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 0x7f93f01f1710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f93e8002240 tx=0x7f93e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80039a0 con 0x7f93f01f1290 2023-12-19T16:16:20.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e8003b00 con 0x7f93f01f1290 2023-12-19T16:16:20.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f00cafa0 con 0x7f93f01f1290 2023-12-19T16:16:20.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8003e70 con 0x7f93f01f1290 2023-12-19T16:16:20.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f00c3c70 con 0x7f93f01f1290 2023-12-19T16:16:20.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f00735b0 con 0x7f93f01f1290 2023-12-19T16:16:20.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93e80b4040 con 0x7f93f01f1290 2023-12-19T16:16:20.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93e67fc640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f93d4065a90 0x7f93d4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f93e80a5e40 con 0x7f93f01f1290 2023-12-19T16:16:20.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93f5bf1640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f93d4065a90 0x7f93d4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.006+0000 7f93f5bf1640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f93d4065a90 0x7f93d4067f50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000c10 tx=0x7f93ec001440 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.010+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f93e80eab10 con 0x7f93f01f1290 2023-12-19T16:16:20.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.170+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f93f00cade0 con 0x7f93f01f1290 2023-12-19T16:16:20.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.170+0000 7f93e67fc640 1 -- 172.21.15.119:0/2153144117 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f93e80ee130 con 0x7f93f01f1290 2023-12-19T16:16:20.177 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f93d4065a90 msgr2=0x7f93d4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f93d4065a90 0x7f93d4067f50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000c10 tx=0x7f93ec001440 comp rx=0 tx=0).stop 2023-12-19T16:16:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 msgr2=0x7f93f01f1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 0x7f93f01f1710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f93e8002240 tx=0x7f93e8009750 comp rx=0 tx=0).stop 2023-12-19T16:16:20.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 shutdown_connections 2023-12-19T16:16:20.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f93d4065a90 0x7f93d4067f50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93f01f1290 0x7f93f01f1710 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f014f600 0x7f93f00c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 --2- 172.21.15.119:0/2153144117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93dc006f20 0x7f93f0158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 >> 172.21.15.119:0/2153144117 conn(0x7f93f006a3e0 msgr2=0x7f93f0151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 shutdown_connections 2023-12-19T16:16:20.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.174+0000 7f93f7e55640 1 -- 172.21.15.119:0/2153144117 wait complete. 2023-12-19T16:16:20.198 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi143.front.sepia.ceph.com... 2023-12-19T16:16:20.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:20.198 DEBUG:teuthology.orchestra.run.smithi143:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-19T16:16:20.246 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:20.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:16:20.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:20.246 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T16:16:20.307 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:20.307 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:20.316 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:20.316 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:20.369 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:20.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 Processor -- start 2023-12-19T16:16:20.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 -- start start 2023-12-19T16:16:20.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4e415ca40 0x7fb4e40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e40ce3f0 0x7fb4e40cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40cfa70 con 0x7fb4e40cf610 2023-12-19T16:16:20.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40d11c0 con 0x7fb4e415ca40 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4ebf09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40d0310 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4e415ca40 0x7fb4e40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4e415ca40 0x7fb4e40cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48524/0 (socket says 172.21.15.119:48524) 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/815663420 learned_addr learned my addr 172.21.15.119:0/815663420 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/815663420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e40ce3f0 msgr2=0x7fb4e40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e94a4640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e40ce3f0 0x7fb4e40cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e40ce3f0 0x7fb4e40cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/815663420 >> v1:172.21.15.143:6789/0 conn(0x7fb4e40cf610 legacy=0x7fb4e41605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/815663420 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40d05b0 con 0x7fb4e415ca40 2023-12-19T16:16:20.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.546+0000 7fb4e94a4640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e40ce3f0 0x7fb4e40cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:20.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4e9ca5640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e415ca40 0x7fb4e40cdeb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0006fd0 tx=0x7fb4e001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2c2acf1caefd4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4e8ca3640 1 -- 172.21.15.119:0/815663420 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00ac620 con 0x7fb4e415ca40 2023-12-19T16:16:20.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4e8ca3640 1 -- 172.21.15.119:0/815663420 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00ac780 con 0x7fb4e415ca40 2023-12-19T16:16:20.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4e8ca3640 1 -- 172.21.15.119:0/815663420 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00acb10 con 0x7fb4e415ca40 2023-12-19T16:16:20.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 -- 172.21.15.119:0/815663420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e415ca40 msgr2=0x7fb4e40cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e415ca40 0x7fb4e40cdeb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0006fd0 tx=0x7fb4e001c4e0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 -- 172.21.15.119:0/815663420 shutdown_connections 2023-12-19T16:16:20.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e40ce3f0 0x7fb4e40cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/815663420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e415ca40 0x7fb4e40cdeb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 -- 172.21.15.119:0/815663420 >> 172.21.15.119:0/815663420 conn(0x7fb4e4089fb0 msgr2=0x7fb4e40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 -- 172.21.15.119:0/815663420 shutdown_connections 2023-12-19T16:16:20.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.550+0000 7fb4ebf09640 1 -- 172.21.15.119:0/815663420 wait complete. 2023-12-19T16:16:20.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 Processor -- start 2023-12-19T16:16:20.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 -- start start 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 0x7fb4e40afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40cf610 0x7fb4e406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e415ca40 0x7fb4e4152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e415c0c0 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40b0ce0 con 0x7fb4e40cf610 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e415b440 con 0x7fb4e415ca40 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 0x7fb4e40afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 0x7fb4e40afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48532/0 (socket says 172.21.15.119:48532) 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/1633359024 learned_addr learned my addr 172.21.15.119:0/1633359024 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e94a4640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40cf610 0x7fb4e406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ea4a6640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e415ca40 0x7fb4e4152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e415ca40 msgr2=0x7fb4e4152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e415ca40 0x7fb4e4152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40cf610 msgr2=0x7fb4e406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40cf610 0x7fb4e406b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 -- 172.21.15.119:0/1633359024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009480 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ea4a6640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e415ca40 0x7fb4e4152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:20.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4e9ca5640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 0x7fb4e40afd20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb4e001cd80 tx=0x7fb4e0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00acaf0 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e415b720 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00acc50 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00ac5a0 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.554+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e415bce0 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.558+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e4066570 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.558+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4e00b3070 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.558+0000 7fb4da7fc640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4c8065a60 0x7fb4c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.558+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb4e011c8e0 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.558+0000 7fb4e94a4640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4c8065a60 0x7fb4c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.558+0000 7fb4e94a4640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4c8065a60 0x7fb4c8067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4e415ae00 tx=0x7fb4d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.562+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb4e00e9e20 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.722+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4e404e000 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4da7fc640 1 -- 172.21.15.119:0/1633359024 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7fb4e00ed440 con 0x7fb4e40ce3f0 2023-12-19T16:16:20.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:20.730 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:20.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4c8065a60 msgr2=0x7fb4c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4c8065a60 0x7fb4c8067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4e415ae00 tx=0x7fb4d4008040 comp rx=0 tx=0).stop 2023-12-19T16:16:20.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 msgr2=0x7fb4e40afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 0x7fb4e40afd20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb4e001cd80 tx=0x7fb4e0019280 comp rx=0 tx=0).stop 2023-12-19T16:16:20.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 shutdown_connections 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4c8065a60 0x7fb4c8067f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40cf610 0x7fb4e406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4e415ca40 0x7fb4e4152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 --2- 172.21.15.119:0/1633359024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4e40ce3f0 0x7fb4e40afd20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 >> 172.21.15.119:0/1633359024 conn(0x7fb4e4089fb0 msgr2=0x7fb4e40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 shutdown_connections 2023-12-19T16:16:20.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.726+0000 7fb4ebf09640 1 -- 172.21.15.119:0/1633359024 wait complete. 2023-12-19T16:16:20.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:20.751 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:20.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 Processor -- start 2023-12-19T16:16:20.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 -- start start 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5150070820 0x7f51500c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51500ce3b0 0x7f51500ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500c9390 con 0x7f51501582d0 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500ced80 con 0x7f51500ce3b0 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f515768c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515015aee0 con 0x7f5150070820 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51500ce3b0 0x7f51500ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51500ce3b0 0x7f51500ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48534/0 (socket says 172.21.15.119:48534) 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 -- 172.21.15.119:0/3469419948 learned_addr learned my addr 172.21.15.119:0/3469419948 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5154c27640 1 --2- 172.21.15.119:0/3469419948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5150070820 0x7f51500c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 -- 172.21.15.119:0/3469419948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5150070820 msgr2=0x7f51500c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:20.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 --2- 172.21.15.119:0/3469419948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5150070820 0x7f51500c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 -- 172.21.15.119:0/3469419948 >> v1:172.21.15.143:6789/0 conn(0x7f51501582d0 legacy=0x7f51500ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.886+0000 7f5155c29640 1 -- 172.21.15.119:0/3469419948 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515015b1c0 con 0x7f51500ce3b0 2023-12-19T16:16:20.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f5155c29640 1 --2- 172.21.15.119:0/3469419948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500ce3b0 0x7f51500ce840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5148009e50 tx=0x7f514801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55e9ce5f7a6676d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f5147fff640 1 -- 172.21.15.119:0/3469419948 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480a58a0 con 0x7f51500ce3b0 2023-12-19T16:16:20.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f5147fff640 1 -- 172.21.15.119:0/3469419948 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51480a5a00 con 0x7f51500ce3b0 2023-12-19T16:16:20.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f5147fff640 1 -- 172.21.15.119:0/3469419948 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480a5d90 con 0x7f51500ce3b0 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 -- 172.21.15.119:0/3469419948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500ce3b0 msgr2=0x7f51500ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 --2- 172.21.15.119:0/3469419948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500ce3b0 0x7f51500ce840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5148009e50 tx=0x7f514801c9e0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 -- 172.21.15.119:0/3469419948 shutdown_connections 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 --2- 172.21.15.119:0/3469419948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500ce3b0 0x7f51500ce840 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 --2- 172.21.15.119:0/3469419948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5150070820 0x7f51500c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 -- 172.21.15.119:0/3469419948 >> 172.21.15.119:0/3469419948 conn(0x7f515006a2a0 msgr2=0x7f51500aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 -- 172.21.15.119:0/3469419948 shutdown_connections 2023-12-19T16:16:20.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.890+0000 7f515768c640 1 -- 172.21.15.119:0/3469419948 wait complete. 2023-12-19T16:16:20.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 Processor -- start 2023-12-19T16:16:20.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 -- start start 2023-12-19T16:16:20.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 0x7f51500c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51500ce3b0 0x7f51500c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51501582d0 0x7f5150153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b3f30 con 0x7f5150070820 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150155490 con 0x7f51500ce3b0 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51501f5380 con 0x7f51501582d0 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 0x7f51500c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 0x7f51500c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48544/0 (socket says 172.21.15.119:48544) 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 -- 172.21.15.119:0/3374022290 learned_addr learned my addr 172.21.15.119:0/3374022290 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5154c27640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51500ce3b0 0x7f51500c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155c29640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51501582d0 0x7f5150153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 -- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51501582d0 msgr2=0x7f5150153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51501582d0 0x7f5150153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 -- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51500ce3b0 msgr2=0x7f51500c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51500ce3b0 0x7f51500c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 -- 172.21.15.119:0/3374022290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009b30 con 0x7f5150070820 2023-12-19T16:16:20.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5155428640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 0x7f51500c54f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c3c0 tx=0x7f514c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0052d0 con 0x7f5150070820 2023-12-19T16:16:20.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c005430 con 0x7f5150070820 2023-12-19T16:16:20.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c003840 con 0x7f5150070820 2023-12-19T16:16:20.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51501f5660 con 0x7f5150070820 2023-12-19T16:16:20.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.894+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51501f5c20 con 0x7f5150070820 2023-12-19T16:16:20.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.898+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150155600 con 0x7f5150070820 2023-12-19T16:16:20.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.898+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f514c0039a0 con 0x7f5150070820 2023-12-19T16:16:20.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.898+0000 7f5145ffb640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5134065a60 0x7f5134067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.898+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f514c0829a0 con 0x7f5150070820 2023-12-19T16:16:20.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.898+0000 7f5154c27640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5134065a60 0x7f5134067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.898+0000 7f5154c27640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5134065a60 0x7f5134067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51501578b0 tx=0x7f5140009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:20.902+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5150155600 con 0x7f5150070820 2023-12-19T16:16:21.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.050+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f515004e000 con 0x7f5150070820 2023-12-19T16:16:21.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.050+0000 7f5145ffb640 1 -- 172.21.15.119:0/3374022290 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f514c017020 con 0x7f5150070820 2023-12-19T16:16:21.056 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:21.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5134065a60 msgr2=0x7f5134067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5134065a60 0x7f5134067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51501578b0 tx=0x7f5140009190 comp rx=0 tx=0).stop 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 msgr2=0x7f51500c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 0x7f51500c54f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c3c0 tx=0x7f514c00c880 comp rx=0 tx=0).stop 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 shutdown_connections 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5134065a60 0x7f5134067f20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51500ce3b0 0x7f51500c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51501582d0 0x7f5150153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 --2- 172.21.15.119:0/3374022290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5150070820 0x7f51500c54f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 >> 172.21.15.119:0/3374022290 conn(0x7f515006a2a0 msgr2=0x7f51500cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 shutdown_connections 2023-12-19T16:16:21.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.054+0000 7f515768c640 1 -- 172.21.15.119:0/3374022290 wait complete. 2023-12-19T16:16:21.078 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:21.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 Processor -- start 2023-12-19T16:16:21.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 -- start start 2023-12-19T16:16:21.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab8158e60 0x7f1ab80cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ab80cb510 0x7f1ab80c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80ce010 con 0x7f1ab80b1240 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80cc500 con 0x7f1ab80cb510 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abeb18640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8159240 con 0x7f1ab8158e60 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ab80cb510 0x7f1ab80c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ab80cb510 0x7f1ab80c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48560/0 (socket says 172.21.15.119:48560) 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 -- 172.21.15.119:0/3456995650 learned_addr learned my addr 172.21.15.119:0/3456995650 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1aaffff640 1 --1- 172.21.15.119:0/3456995650 >> v1:172.21.15.119:6789/0 conn(0x7f1ab80b1240 0x7f1ab80cae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33422/0 (socket says 172.21.15.119:33422) 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abc8b4640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab8158e60 0x7f1ab80cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 -- 172.21.15.119:0/3456995650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab8158e60 msgr2=0x7f1ab80cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab8158e60 0x7f1ab80cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 -- 172.21.15.119:0/3456995650 >> v1:172.21.15.119:6789/0 conn(0x7f1ab80b1240 legacy=0x7f1ab80cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abd0b5640 1 -- 172.21.15.119:0/3456995650 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab806d6f0 con 0x7f1ab80cb510 2023-12-19T16:16:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1abc8b4640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab8158e60 0x7f1ab80cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:21.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.214+0000 7f1aaf7fe640 1 -- 172.21.15.119:0/3456995650 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616588401 0 0) 0x7f1ab80ce010 con 0x7f1ab80b1240 2023-12-19T16:16:21.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abd0b5640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab80c9550 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009e50 tx=0x7f1ab001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f3178f535656d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1aaf7fe640 1 -- 172.21.15.119:0/3456995650 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00af400 con 0x7f1ab80cb510 2023-12-19T16:16:21.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1aaf7fe640 1 -- 172.21.15.119:0/3456995650 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00ab050 con 0x7f1ab80cb510 2023-12-19T16:16:21.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1aaf7fe640 1 -- 172.21.15.119:0/3456995650 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00af780 con 0x7f1ab80cb510 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 -- 172.21.15.119:0/3456995650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 msgr2=0x7f1ab80c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab80c9550 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009e50 tx=0x7f1ab001f1f0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 -- 172.21.15.119:0/3456995650 shutdown_connections 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab80c9550 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 --2- 172.21.15.119:0/3456995650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab8158e60 0x7f1ab80cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 -- 172.21.15.119:0/3456995650 >> 172.21.15.119:0/3456995650 conn(0x7f1ab8069e70 msgr2=0x7f1ab806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 -- 172.21.15.119:0/3456995650 shutdown_connections 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.218+0000 7f1abeb18640 1 -- 172.21.15.119:0/3456995650 wait complete. 2023-12-19T16:16:21.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 Processor -- start 2023-12-19T16:16:21.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 -- start start 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab80b1240 0x7f1ab8158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab809aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ab8158e60 0x7f1ab8098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8158a70 con 0x7f1ab80cb510 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab809aff0 con 0x7f1ab8158e60 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab809b2b0 con 0x7f1ab80b1240 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab809aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab809aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48562/0 (socket says 172.21.15.119:48562) 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 -- 172.21.15.119:0/4032575842 learned_addr learned my addr 172.21.15.119:0/4032575842 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abd0b5640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ab8158e60 0x7f1ab8098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abc8b4640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab80b1240 0x7f1ab8158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 -- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab80b1240 msgr2=0x7f1ab8158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab80b1240 0x7f1ab8158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 -- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ab8158e60 msgr2=0x7f1ab8098c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ab8158e60 0x7f1ab8098c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 -- 172.21.15.119:0/4032575842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0009b30 con 0x7f1ab80cb510 2023-12-19T16:16:21.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aaffff640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab809aab0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c450 tx=0x7f1aa800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80074e0 con 0x7f1ab80cb510 2023-12-19T16:16:21.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8007640 con 0x7f1ab80cb510 2023-12-19T16:16:21.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab809b590 con 0x7f1ab80cb510 2023-12-19T16:16:21.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80049f0 con 0x7f1ab80cb510 2023-12-19T16:16:21.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.222+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab809b920 con 0x7f1ab80cb510 2023-12-19T16:16:21.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.226+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab804e000 con 0x7f1ab80cb510 2023-12-19T16:16:21.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.226+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1aa8004b50 con 0x7f1ab80cb510 2023-12-19T16:16:21.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.226+0000 7f1aad7fa640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1aa4065a60 0x7f1aa4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.226+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1aa8082b50 con 0x7f1ab80cb510 2023-12-19T16:16:21.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.226+0000 7f1abc8b4640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1aa4065a60 0x7f1aa4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.226+0000 7f1abc8b4640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1aa4065a60 0x7f1aa4067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4006e30 tx=0x7f1ab4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.230+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1aa8050110 con 0x7f1ab80cb510 2023-12-19T16:16:21.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.378+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ab80c8f00 con 0x7f1ab80cb510 2023-12-19T16:16:21.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1aad7fa640 1 -- 172.21.15.119:0/4032575842 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1aa8018020 con 0x7f1ab80cb510 2023-12-19T16:16:21.385 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1aa4065a60 msgr2=0x7f1aa4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1aa4065a60 0x7f1aa4067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4006e30 tx=0x7f1ab4008040 comp rx=0 tx=0).stop 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 msgr2=0x7f1ab809aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab809aab0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c450 tx=0x7f1aa800c910 comp rx=0 tx=0).stop 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 shutdown_connections 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1aa4065a60 0x7f1aa4067f20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ab8158e60 0x7f1ab8098c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ab80cb510 0x7f1ab809aab0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 --2- 172.21.15.119:0/4032575842 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ab80b1240 0x7f1ab8158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 >> 172.21.15.119:0/4032575842 conn(0x7f1ab8069e70 msgr2=0x7f1ab80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 shutdown_connections 2023-12-19T16:16:21.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.382+0000 7f1abeb18640 1 -- 172.21.15.119:0/4032575842 wait complete. 2023-12-19T16:16:21.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:21.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.542+0000 7f9643eb6640 1 Processor -- start 2023-12-19T16:16:21.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.542+0000 7f9643eb6640 1 -- start start 2023-12-19T16:16:21.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9643eb6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f963c0ceac0 0x7f963c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9643eb6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c0c9390 con 0x7f963c1582d0 2023-12-19T16:16:21.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9643eb6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c15aee0 con 0x7f963c070820 2023-12-19T16:16:21.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9643eb6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963c15b1c0 con 0x7f963c0ceac0 2023-12-19T16:16:21.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9642453640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f963c0ceac0 0x7f963c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9642453640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f963c0ceac0 0x7f963c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48574/0 (socket says 172.21.15.119:48574) 2023-12-19T16:16:21.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9642453640 1 -- 172.21.15.119:0/3854479097 learned_addr learned my addr 172.21.15.119:0/3854479097 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:21.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9642453640 1 -- 172.21.15.119:0/3854479097 >> v1:172.21.15.143:6789/0 conn(0x7f963c070820 legacy=0x7f963c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9642453640 1 -- 172.21.15.119:0/3854479097 >> v1:172.21.15.119:6789/0 conn(0x7f963c1582d0 legacy=0x7f963c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9642453640 1 -- 172.21.15.119:0/3854479097 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c15b4a0 con 0x7f963c0ceac0 2023-12-19T16:16:21.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.546+0000 7f9640c50640 1 -- 172.21.15.119:0/3854479097 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090255422 0 0) 0x7f963c0c9390 con 0x7f963c1582d0 2023-12-19T16:16:21.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9642453640 1 --2- 172.21.15.119:0/3854479097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c8e50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9634009e50 tx=0x7f963401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f464657e06432b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9640c50640 1 -- 172.21.15.119:0/3854479097 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340a5880 con 0x7f963c0ceac0 2023-12-19T16:16:21.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9640c50640 1 -- 172.21.15.119:0/3854479097 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96340a59e0 con 0x7f963c0ceac0 2023-12-19T16:16:21.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9640c50640 1 -- 172.21.15.119:0/3854479097 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340a5d70 con 0x7f963c0ceac0 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 -- 172.21.15.119:0/3854479097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 msgr2=0x7f963c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 --2- 172.21.15.119:0/3854479097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c8e50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9634009e50 tx=0x7f963401c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 -- 172.21.15.119:0/3854479097 shutdown_connections 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 --2- 172.21.15.119:0/3854479097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c8e50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 -- 172.21.15.119:0/3854479097 >> 172.21.15.119:0/3854479097 conn(0x7f963c06a2a0 msgr2=0x7f963c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 -- 172.21.15.119:0/3854479097 shutdown_connections 2023-12-19T16:16:21.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 -- 172.21.15.119:0/3854479097 wait complete. 2023-12-19T16:16:21.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 Processor -- start 2023-12-19T16:16:21.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.550+0000 7f9643eb6640 1 -- start start 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f963c070820 0x7f963c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f963c1582d0 0x7f963c0c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0c6d90 con 0x7f963c0ceac0 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0c84b0 con 0x7f963c1582d0 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0c81d0 con 0x7f963c070820 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48584/0 (socket says 172.21.15.119:48584) 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 -- 172.21.15.119:0/386834989 learned_addr learned my addr 172.21.15.119:0/386834989 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:21.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9642453640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f963c1582d0 0x7f963c0c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641c52640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f963c070820 0x7f963c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 -- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f963c070820 msgr2=0x7f963c151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f963c070820 0x7f963c151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 -- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f963c1582d0 msgr2=0x7f963c0c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f963c1582d0 0x7f963c0c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 -- 172.21.15.119:0/386834989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009b30 con 0x7f963c0ceac0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9641451640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c31a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c450 tx=0x7f962c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c012830 con 0x7f963c0ceac0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c0129b0 con 0x7f963c0ceac0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c0c66d0 con 0x7f963c0ceac0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c012d60 con 0x7f963c0ceac0 2023-12-19T16:16:21.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c1529e0 con 0x7f963c0ceac0 2023-12-19T16:16:21.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c0c6ed0 con 0x7f963c0ceac0 2023-12-19T16:16:21.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.554+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f962c01c460 con 0x7f963c0ceac0 2023-12-19T16:16:21.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.558+0000 7f96327fc640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9620065a60 0x7f9620067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.558+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f962c083360 con 0x7f963c0ceac0 2023-12-19T16:16:21.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.558+0000 7f9641c52640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9620065a60 0x7f9620067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.558+0000 7f9641c52640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9620065a60 0x7f9620067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9638007fd0 tx=0x7f9638009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.566 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.562+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f963c0c6ed0 con 0x7f963c0ceac0 2023-12-19T16:16:21.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.710+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f963c0c6ed0 con 0x7f963c0ceac0 2023-12-19T16:16:21.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.710+0000 7f96327fc640 1 -- 172.21.15.119:0/386834989 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f963c0c6ed0 con 0x7f963c0ceac0 2023-12-19T16:16:21.716 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:21.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9620065a60 msgr2=0x7f9620067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9620065a60 0x7f9620067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9638007fd0 tx=0x7f9638009040 comp rx=0 tx=0).stop 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 msgr2=0x7f963c0c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c31a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c450 tx=0x7f962c00c910 comp rx=0 tx=0).stop 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 shutdown_connections 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9620065a60 0x7f9620067f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f963c1582d0 0x7f963c0c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f963c0ceac0 0x7f963c0c31a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 --2- 172.21.15.119:0/386834989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f963c070820 0x7f963c151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 >> 172.21.15.119:0/386834989 conn(0x7f963c06a2a0 msgr2=0x7f963c0ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 shutdown_connections 2023-12-19T16:16:21.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.714+0000 7f9643eb6640 1 -- 172.21.15.119:0/386834989 wait complete. 2023-12-19T16:16:21.736 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:21.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.870+0000 7f5a5e3cc640 1 Processor -- start 2023-12-19T16:16:21.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.870+0000 7f5a5e3cc640 1 -- start start 2023-12-19T16:16:21.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a5e3cc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a581598d0 0x7f5a580ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a5e3cc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a580ce8d0 0x7f5a58070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a5e3cc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a580c9730 con 0x7f5a58153020 2023-12-19T16:16:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a5e3cc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a580ced60 con 0x7f5a581598d0 2023-12-19T16:16:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a5e3cc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a580c8e00 con 0x7f5a580ce8d0 2023-12-19T16:16:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a57fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5a58153020 0x7f5a580c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33432/0 (socket says 172.21.15.119:33432) 2023-12-19T16:16:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a57fff640 1 -- 172.21.15.119:0/3771373753 learned_addr learned my addr 172.21.15.119:0/3771373753 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a577fe640 1 --2- 172.21.15.119:0/3771373753 >> v2:172.21.15.143:3300/0 conn(0x7f5a581598d0 0x7f5a580ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a5c969640 1 --2- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a580ce8d0 0x7f5a58070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a56ffd640 1 -- 172.21.15.119:0/3771373753 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707014563 0 0) 0x7f5a580c9730 con 0x7f5a58153020 2023-12-19T16:16:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a56ffd640 1 -- 172.21.15.119:0/3771373753 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a40005740 con 0x7f5a58153020 2023-12-19T16:16:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a577fe640 1 -- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a580ce8d0 msgr2=0x7f5a58070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a577fe640 1 --2- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a580ce8d0 0x7f5a58070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a577fe640 1 -- 172.21.15.119:0/3771373753 >> v1:172.21.15.119:6789/0 conn(0x7f5a58153020 legacy=0x7f5a580c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.874+0000 7f5a577fe640 1 -- 172.21.15.119:0/3771373753 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580c90e0 con 0x7f5a581598d0 2023-12-19T16:16:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a577fe640 1 --2- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a581598d0 0x7f5a580ce390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0097c0 tx=0x7f5a4c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d783cdb8be898aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a56ffd640 1 -- 172.21.15.119:0/3771373753 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0ab600 con 0x7f5a581598d0 2023-12-19T16:16:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a56ffd640 1 -- 172.21.15.119:0/3771373753 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0a7050 con 0x7f5a581598d0 2023-12-19T16:16:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a56ffd640 1 -- 172.21.15.119:0/3771373753 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0ab980 con 0x7f5a581598d0 2023-12-19T16:16:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a581598d0 msgr2=0x7f5a580ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a581598d0 0x7f5a580ce390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0097c0 tx=0x7f5a4c01c330 comp rx=0 tx=0).stop 2023-12-19T16:16:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/3771373753 shutdown_connections 2023-12-19T16:16:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a580ce8d0 0x7f5a58070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/3771373753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a581598d0 0x7f5a580ce390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/3771373753 >> 172.21.15.119:0/3771373753 conn(0x7f5a5806a2a0 msgr2=0x7f5a580aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/3771373753 shutdown_connections 2023-12-19T16:16:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/3771373753 wait complete. 2023-12-19T16:16:21.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.878+0000 7f5a5e3cc640 1 Processor -- start 2023-12-19T16:16:21.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- start start 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a580ce8d0 0x7f5a58154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a58153020 0x7f5a58155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 0x7f5a580cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58156240 con 0x7f5a581598d0 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58154000 con 0x7f5a580ce8d0 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58155f60 con 0x7f5a58153020 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 0x7f5a580cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 0x7f5a580cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48600/0 (socket says 172.21.15.119:48600) 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 -- 172.21.15.119:0/1943910758 learned_addr learned my addr 172.21.15.119:0/1943910758 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a577fe640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a58153020 0x7f5a58155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a57fff640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a580ce8d0 0x7f5a58154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 -- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a58153020 msgr2=0x7f5a58155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a58153020 0x7f5a58155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 -- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a580ce8d0 msgr2=0x7f5a58154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a580ce8d0 0x7f5a58154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 -- 172.21.15.119:0/1943910758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c009420 con 0x7f5a581598d0 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5c969640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 0x7f5a580cd420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000efc0 tx=0x7f5a5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50009ba0 con 0x7f5a581598d0 2023-12-19T16:16:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000f040 con 0x7f5a581598d0 2023-12-19T16:16:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a500146c0 con 0x7f5a581598d0 2023-12-19T16:16:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a58153940 con 0x7f5a581598d0 2023-12-19T16:16:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a58155bc0 con 0x7f5a581598d0 2023-12-19T16:16:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.882+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a581537a0 con 0x7f5a581598d0 2023-12-19T16:16:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.886+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a50014820 con 0x7f5a581598d0 2023-12-19T16:16:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.886+0000 7f5a54ff9640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a44065a60 0x7f5a44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.886+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5a500842c0 con 0x7f5a581598d0 2023-12-19T16:16:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.886+0000 7f5a57fff640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a44065a60 0x7f5a44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.886+0000 7f5a57fff640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a44065a60 0x7f5a44067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a480011f0 tx=0x7f5a48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:21.890+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5a581537a0 con 0x7f5a581598d0 2023-12-19T16:16:22.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.038+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5a58154140 con 0x7f5a581598d0 2023-12-19T16:16:22.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.038+0000 7f5a54ff9640 1 -- 172.21.15.119:0/1943910758 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5a58154140 con 0x7f5a581598d0 2023-12-19T16:16:22.045 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a44065a60 msgr2=0x7f5a44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a44065a60 0x7f5a44067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a480011f0 tx=0x7f5a48009040 comp rx=0 tx=0).stop 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 msgr2=0x7f5a580cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 0x7f5a580cd420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000efc0 tx=0x7f5a5000c490 comp rx=0 tx=0).stop 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 shutdown_connections 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a44065a60 0x7f5a44067f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a581598d0 0x7f5a580cd420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a58153020 0x7f5a58155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 --2- 172.21.15.119:0/1943910758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a580ce8d0 0x7f5a58154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 >> 172.21.15.119:0/1943910758 conn(0x7f5a5806a2a0 msgr2=0x7f5a581524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 shutdown_connections 2023-12-19T16:16:22.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.042+0000 7f5a5e3cc640 1 -- 172.21.15.119:0/1943910758 wait complete. 2023-12-19T16:16:22.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:22.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.198+0000 7ffa1c9bc640 1 Processor -- start 2023-12-19T16:16:22.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.198+0000 7ffa1c9bc640 1 -- start start 2023-12-19T16:16:22.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa1c9bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 0x7ffa1815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa1c9bc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 0x7ffa18070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa1c9bc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1815f100 con 0x7ffa1815a680 2023-12-19T16:16:22.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa1c9bc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180707a0 con 0x7ffa1806fdb0 2023-12-19T16:16:22.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa1c9bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180ca7d0 con 0x7ffa180cac10 2023-12-19T16:16:22.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa0ffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 0x7ffa1815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa16d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 0x7ffa18070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa16d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 0x7ffa18070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:44186/0 (socket says 172.21.15.119:44186) 2023-12-19T16:16:22.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa16d9d640 1 -- 172.21.15.119:0/3358666370 learned_addr learned my addr 172.21.15.119:0/3358666370 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:22.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa0ffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 0x7ffa1815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:53234/0 (socket says 172.21.15.119:53234) 2023-12-19T16:16:22.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa0ffff640 1 -- 172.21.15.119:0/3358666370 >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 msgr2=0x7ffa18070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:22.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa0ffff640 1 --2- 172.21.15.119:0/3358666370 >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 0x7ffa18070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa0ffff640 1 -- 172.21.15.119:0/3358666370 >> v1:172.21.15.143:6789/0 conn(0x7ffa1815a680 legacy=0x7ffa1815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa0ffff640 1 -- 172.21.15.119:0/3358666370 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1815e860 con 0x7ffa180cac10 2023-12-19T16:16:22.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.202+0000 7ffa16d9d640 1 --2- 172.21.15.119:0/3358666370 >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 0x7ffa18070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:22.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa0ffff640 1 --2- 172.21.15.119:0/3358666370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 0x7ffa1815e160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa000097c0 tx=0x7ffa0001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c099be81d8f0abfb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa15d9b640 1 -- 172.21.15.119:0/3358666370 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa000ab5f0 con 0x7ffa180cac10 2023-12-19T16:16:22.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa15d9b640 1 -- 172.21.15.119:0/3358666370 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa000ab750 con 0x7ffa180cac10 2023-12-19T16:16:22.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa15d9b640 1 -- 172.21.15.119:0/3358666370 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa000abae0 con 0x7ffa180cac10 2023-12-19T16:16:22.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/3358666370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 msgr2=0x7ffa1815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/3358666370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 0x7ffa1815e160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa000097c0 tx=0x7ffa0001c3f0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/3358666370 shutdown_connections 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/3358666370 >> v2:172.21.15.143:3300/0 conn(0x7ffa1806fdb0 0x7ffa18070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/3358666370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa180cac10 0x7ffa1815e160 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/3358666370 >> 172.21.15.119:0/3358666370 conn(0x7ffa1806a3e0 msgr2=0x7ffa180afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/3358666370 shutdown_connections 2023-12-19T16:16:22.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/3358666370 wait complete. 2023-12-19T16:16:22.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 Processor -- start 2023-12-19T16:16:22.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.206+0000 7ffa1c9bc640 1 -- start start 2023-12-19T16:16:22.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 0x7ffa181637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa180cac10 0x7ffa181523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa1815a680 0x7ffa1814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18164ad0 con 0x7ffa1806fdb0 2023-12-19T16:16:22.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18150d90 con 0x7ffa180cac10 2023-12-19T16:16:22.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18163e50 con 0x7ffa1815a680 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 0x7ffa181637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 0x7ffa181637e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48602/0 (socket says 172.21.15.119:48602) 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 -- 172.21.15.119:0/1017089013 learned_addr learned my addr 172.21.15.119:0/1017089013 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa0ffff640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa180cac10 0x7ffa181523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa16d9d640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa1815a680 0x7ffa1814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 -- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa1815a680 msgr2=0x7ffa1814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa1815a680 0x7ffa1814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 -- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa180cac10 msgr2=0x7ffa181523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa180cac10 0x7ffa181523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 -- 172.21.15.119:0/1017089013 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10009b30 con 0x7ffa1806fdb0 2023-12-19T16:16:22.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1659c640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 0x7ffa181637e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800c420 tx=0x7ffa0800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080052d0 con 0x7ffa1806fdb0 2023-12-19T16:16:22.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08005430 con 0x7ffa1806fdb0 2023-12-19T16:16:22.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa00009420 con 0x7ffa1806fdb0 2023-12-19T16:16:22.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08007260 con 0x7ffa1806fdb0 2023-12-19T16:16:22.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa18164410 con 0x7ffa1806fdb0 2023-12-19T16:16:22.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa180735b0 con 0x7ffa1806fdb0 2023-12-19T16:16:22.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.210+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa080073c0 con 0x7ffa1806fdb0 2023-12-19T16:16:22.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.214+0000 7ffa0effd640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff9f8065a60 0x7ff9f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.214+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ffa08082810 con 0x7ffa1806fdb0 2023-12-19T16:16:22.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.214+0000 7ffa0ffff640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff9f8065a60 0x7ff9f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.214+0000 7ffa0ffff640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff9f8065a60 0x7ff9f8067f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa000af000 tx=0x7ffa000a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.218+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffa0804ff00 con 0x7ffa1806fdb0 2023-12-19T16:16:22.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa18164c10 con 0x7ffa1806fdb0 2023-12-19T16:16:22.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa0effd640 1 -- 172.21.15.119:0/1017089013 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa08053520 con 0x7ffa1806fdb0 2023-12-19T16:16:22.383 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff9f8065a60 msgr2=0x7ff9f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff9f8065a60 0x7ff9f8067f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa000af000 tx=0x7ffa000a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 msgr2=0x7ffa181637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 0x7ffa181637e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800c420 tx=0x7ffa0800c8e0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 shutdown_connections 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff9f8065a60 0x7ff9f8067f20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa180cac10 0x7ffa181523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa1815a680 0x7ffa1814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 --2- 172.21.15.119:0/1017089013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1806fdb0 0x7ffa181637e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 >> 172.21.15.119:0/1017089013 conn(0x7ffa1806a3e0 msgr2=0x7ffa1815c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 shutdown_connections 2023-12-19T16:16:22.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.378+0000 7ffa1c9bc640 1 -- 172.21.15.119:0/1017089013 wait complete. 2023-12-19T16:16:22.404 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:22.404 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:22.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:22.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 Processor -- start 2023-12-19T16:16:22.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 -- start start 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3a340cf7e0 0x7f3a341668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340d11c0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340d0310 con 0x7f3a340cf7e0 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3c1f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340d05b0 con 0x7f3a3415ca40 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:34530/0 (socket says 172.21.15.119:34530) 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 -- 172.21.15.119:0/786619900 learned_addr learned my addr 172.21.15.119:0/786619900 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:22.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a3a78d640 1 --2- 172.21.15.119:0/786619900 >> v2:172.21.15.143:3300/0 conn(0x7f3a340cf7e0 0x7f3a341668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 -- 172.21.15.119:0/786619900 >> v2:172.21.15.143:3300/0 conn(0x7f3a340cf7e0 msgr2=0x7f3a341668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:22.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 --2- 172.21.15.119:0/786619900 >> v2:172.21.15.143:3300/0 conn(0x7f3a340cf7e0 0x7f3a341668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 -- 172.21.15.119:0/786619900 >> v1:172.21.15.143:6789/0 conn(0x7f3a340ce3f0 legacy=0x7f3a340cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.594+0000 7f3a39f8c640 1 -- 172.21.15.119:0/786619900 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340d0890 con 0x7f3a3415ca40 2023-12-19T16:16:22.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a39f8c640 1 --2- 172.21.15.119:0/786619900 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340cdeb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a30006fd0 tx=0x7f3a3001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f44dc9486c801530 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a38f8a640 1 -- 172.21.15.119:0/786619900 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300aa680 con 0x7f3a3415ca40 2023-12-19T16:16:22.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a38f8a640 1 -- 172.21.15.119:0/786619900 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a300aa7e0 con 0x7f3a3415ca40 2023-12-19T16:16:22.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a38f8a640 1 -- 172.21.15.119:0/786619900 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300aab70 con 0x7f3a3415ca40 2023-12-19T16:16:22.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/786619900 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 msgr2=0x7f3a340cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/786619900 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340cdeb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a30006fd0 tx=0x7f3a3001c520 comp rx=0 tx=0).stop 2023-12-19T16:16:22.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/786619900 shutdown_connections 2023-12-19T16:16:22.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/786619900 >> v2:172.21.15.143:3300/0 conn(0x7f3a340cf7e0 0x7f3a341668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/786619900 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340cdeb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/786619900 >> 172.21.15.119:0/786619900 conn(0x7f3a34089fb0 msgr2=0x7f3a340d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/786619900 shutdown_connections 2023-12-19T16:16:22.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.598+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/786619900 wait complete. 2023-12-19T16:16:22.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 Processor -- start 2023-12-19T16:16:22.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 -- start start 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a340ce3f0 0x7f3a3414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 0x7f3a340b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3414e930 con 0x7f3a340cf7e0 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341f82a0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341f8580 con 0x7f3a3415ca40 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3978b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 0x7f3a340b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a340ce3f0 0x7f3a3414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3978b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 0x7f3a340b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34882/0 (socket says 172.21.15.119:34882) 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3978b640 1 -- 172.21.15.119:0/871986400 learned_addr learned my addr 172.21.15.119:0/871986400 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3a78d640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 -- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 msgr2=0x7f3a340b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 -- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 msgr2=0x7f3a340b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 0x7f3a340b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 -- 172.21.15.119:0/871986400 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009480 con 0x7f3a340ce3f0 2023-12-19T16:16:22.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3978b640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 0x7f3a340b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a39f8c640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a340ce3f0 0x7f3a3414e3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a300ab000 tx=0x7f3a300192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300aab50 con 0x7f3a340ce3f0 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a300aacb0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a340d17d0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30003860 con 0x7f3a340ce3f0 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.602+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a341f8b40 con 0x7f3a340ce3f0 2023-12-19T16:16:22.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.606+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3404e000 con 0x7f3a340ce3f0 2023-12-19T16:16:22.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.606+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3a300039c0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.606+0000 7f3a2a7fc640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3a18065a60 0x7f3a18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.606+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3a3011df30 con 0x7f3a340ce3f0 2023-12-19T16:16:22.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.606+0000 7f3a3978b640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3a18065a60 0x7f3a18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.606+0000 7f3a3978b640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3a18065a60 0x7f3a18067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a340d2490 tx=0x7f3a24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.610+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3a300eb580 con 0x7f3a340ce3f0 2023-12-19T16:16:22.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.762+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a341f86c0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.762+0000 7f3a2a7fc640 1 -- 172.21.15.119:0/871986400 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f3a341f86c0 con 0x7f3a340ce3f0 2023-12-19T16:16:22.769 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:22.769 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3a18065a60 msgr2=0x7f3a18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3a18065a60 0x7f3a18067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a340d2490 tx=0x7f3a24009040 comp rx=0 tx=0).stop 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a340ce3f0 msgr2=0x7f3a3414e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a340ce3f0 0x7f3a3414e3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a300ab000 tx=0x7f3a300192c0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 shutdown_connections 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3a18065a60 0x7f3a18067f20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3415ca40 0x7f3a340b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a340cf7e0 0x7f3a340b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 --2- 172.21.15.119:0/871986400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a340ce3f0 0x7f3a3414e3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 >> 172.21.15.119:0/871986400 conn(0x7f3a34089fb0 msgr2=0x7f3a340ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 shutdown_connections 2023-12-19T16:16:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.766+0000 7f3a3c1f0640 1 -- 172.21.15.119:0/871986400 wait complete. 2023-12-19T16:16:22.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:22.791 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:22.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f562596d640 1 Processor -- start 2023-12-19T16:16:22.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f562596d640 1 -- start start 2023-12-19T16:16:22.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f562596d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56200cde90 0x7f56200ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f562596d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562015cec0 con 0x7f562015cae0 2023-12-19T16:16:22.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f562596d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56200d0530 con 0x7f56200cf170 2023-12-19T16:16:22.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f562596d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200d0810 con 0x7f56200cde90 2023-12-19T16:16:22.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f561effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f562015cae0 0x7f56200d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55366/0 (socket says 172.21.15.119:55366) 2023-12-19T16:16:22.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f561effd640 1 -- 172.21.15.119:0/1197094394 learned_addr learned my addr 172.21.15.119:0/1197094394 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:22.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f5617fff640 1 --2- 172.21.15.119:0/1197094394 >> v2:172.21.15.143:3300/0 conn(0x7f56200cde90 0x7f56200ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148080082 0 0) 0x7f562015cec0 con 0x7f562015cae0 2023-12-19T16:16:22.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.926+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f560c003530 con 0x7f562015cae0 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960711731 0 0) 0x7f56200d0530 con 0x7f56200cf170 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f562015cec0 con 0x7f56200cf170 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2594913002 0 0) 0x7f560c003530 con 0x7f562015cae0 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 >> v2:172.21.15.143:3300/0 conn(0x7f56200cde90 msgr2=0x7f56200ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 --2- 172.21.15.119:0/1197094394 >> v2:172.21.15.143:3300/0 conn(0x7f56200cde90 0x7f56200ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 >> v1:172.21.15.143:6789/0 conn(0x7f56200cf170 legacy=0x7f562006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200d0af0 con 0x7f562015cae0 2023-12-19T16:16:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f5610001800 con 0x7f562015cae0 2023-12-19T16:16:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 >> v1:172.21.15.119:6789/0 conn(0x7f562015cae0 legacy=0x7f56200d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f560c003b10 0x7f560c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f560c0047d0 0x7f560c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c005190 0x7f560c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200d0810 con 0x7f560c003b10 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c00c010 con 0x7f560c0047d0 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c00c1d0 con 0x7f560c005190 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f560c003b10 0x7f560c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f5617fff640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f560c0047d0 0x7f560c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561f7fe640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c005190 0x7f560c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 -- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c005190 msgr2=0x7f560c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c005190 0x7f560c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 -- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f560c0047d0 msgr2=0x7f560c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f560c0047d0 0x7f560c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 -- 172.21.15.119:0/1197094394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c003530 con 0x7f560c003b10 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561f7fe640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c005190 0x7f560c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:22.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561f7fe640 1 -- 172.21.15.119:0/1197094394 reap_dead start 2023-12-19T16:16:22.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561effd640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f560c003b10 0x7f560c003f10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f561000c160 tx=0x7f561001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa3707075cc583 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100070d0 con 0x7f560c003b10 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610007250 con 0x7f560c003b10 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.930+0000 7f561e7fc640 1 -- 172.21.15.119:0/1197094394 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610007640 con 0x7f560c003b10 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- 172.21.15.119:0/1197094394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f560c003b10 msgr2=0x7f560c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f560c003b10 0x7f560c003f10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f561000c160 tx=0x7f561001cb70 comp rx=0 tx=0).stop 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- 172.21.15.119:0/1197094394 shutdown_connections 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 --2- 172.21.15.119:0/1197094394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f560c003b10 0x7f560c003f10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- 172.21.15.119:0/1197094394 >> 172.21.15.119:0/1197094394 conn(0x7f5620089fb0 msgr2=0x7f56200d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- 172.21.15.119:0/1197094394 shutdown_connections 2023-12-19T16:16:22.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- 172.21.15.119:0/1197094394 wait complete. 2023-12-19T16:16:22.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 Processor -- start 2023-12-19T16:16:22.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- start start 2023-12-19T16:16:22.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c003b10 0x7f56200b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 0x7f562015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f562015e740 0x7f5620149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562015ebc0 con 0x7f56200c8a80 2023-12-19T16:16:22.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200cb560 con 0x7f562015e740 2023-12-19T16:16:22.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f562596d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56200b22c0 con 0x7f560c003b10 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f5617fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 0x7f562015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f5617fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 0x7f562015e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34910/0 (socket says 172.21.15.119:34910) 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.934+0000 7f5617fff640 1 -- 172.21.15.119:0/2023269372 learned_addr learned my addr 172.21.15.119:0/2023269372 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561effd640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c003b10 0x7f56200b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561f7fe640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f562015e740 0x7f5620149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f5617fff640 1 -- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c003b10 msgr2=0x7f56200b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f5617fff640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c003b10 0x7f56200b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f5617fff640 1 -- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f562015e740 msgr2=0x7f5620149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f5617fff640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f562015e740 0x7f5620149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f5617fff640 1 -- 172.21.15.119:0/2023269372 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562014a780 con 0x7f56200c8a80 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561f7fe640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f562015e740 0x7f5620149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:22.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f5617fff640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 0x7f562015e200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5608011aa0 tx=0x7f5608011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800fb80 con 0x7f56200c8a80 2023-12-19T16:16:22.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800fce0 con 0x7f56200c8a80 2023-12-19T16:16:22.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608014680 con 0x7f56200c8a80 2023-12-19T16:16:22.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56200b2580 con 0x7f56200c8a80 2023-12-19T16:16:22.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56200c8f00 con 0x7f56200c8a80 2023-12-19T16:16:22.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56200ce9b0 con 0x7f56200c8a80 2023-12-19T16:16:22.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f56080147e0 con 0x7f56200c8a80 2023-12-19T16:16:22.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561cff9640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5600065a60 0x7f5600067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.938+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5608083ee0 con 0x7f56200c8a80 2023-12-19T16:16:22.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.942+0000 7f561effd640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5600065a60 0x7f5600067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.942+0000 7f561effd640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5600065a60 0x7f5600067f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f56100aa000 tx=0x7f56100b0040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:22.942+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5608051480 con 0x7f56200c8a80 2023-12-19T16:16:23.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.094+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f562004e000 con 0x7f56200c8a80 2023-12-19T16:16:23.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.094+0000 7f561cff9640 1 -- 172.21.15.119:0/2023269372 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56080220a0 con 0x7f56200c8a80 2023-12-19T16:16:23.100 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5600065a60 msgr2=0x7f5600067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5600065a60 0x7f5600067f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f56100aa000 tx=0x7f56100b0040 comp rx=0 tx=0).stop 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 msgr2=0x7f562015e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 0x7f562015e200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5608011aa0 tx=0x7f5608011f60 comp rx=0 tx=0).stop 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 shutdown_connections 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5600065a60 0x7f5600067f20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f562015e740 0x7f5620149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56200c8a80 0x7f562015e200 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 --2- 172.21.15.119:0/2023269372 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f560c003b10 0x7f56200b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 >> 172.21.15.119:0/2023269372 conn(0x7f5620089fb0 msgr2=0x7f56200b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 shutdown_connections 2023-12-19T16:16:23.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.098+0000 7f562596d640 1 -- 172.21.15.119:0/2023269372 wait complete. 2023-12-19T16:16:23.121 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:23.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.254+0000 7fdf20739640 1 Processor -- start 2023-12-19T16:16:23.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.254+0000 7fdf20739640 1 -- start start 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf20739640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf180ceac0 0x7fdf180c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf20739640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180c9390 con 0x7fdf181582d0 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf20739640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1815aee0 con 0x7fdf18070820 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf20739640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1815b1c0 con 0x7fdf180ceac0 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1ecd6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf180ceac0 0x7fdf180c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1ecd6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf180ceac0 0x7fdf180c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34914/0 (socket says 172.21.15.119:34914) 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1e4d5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdf181582d0 0x7fdf180ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55372/0 (socket says 172.21.15.119:55372) 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1ecd6640 1 -- 172.21.15.119:0/1084763777 learned_addr learned my addr 172.21.15.119:0/1084763777 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:23.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1ecd6640 1 -- 172.21.15.119:0/1084763777 >> v1:172.21.15.143:6789/0 conn(0x7fdf18070820 legacy=0x7fdf180ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:23.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1ecd6640 1 -- 172.21.15.119:0/1084763777 >> v1:172.21.15.119:6789/0 conn(0x7fdf181582d0 legacy=0x7fdf180ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.258+0000 7fdf1ecd6640 1 -- 172.21.15.119:0/1084763777 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1815b4a0 con 0x7fdf180ceac0 2023-12-19T16:16:23.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf1ecd6640 1 --2- 172.21.15.119:0/1084763777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c8e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009e50 tx=0x7fdf1001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d2c57a4bfb19df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf1d4d3640 1 -- 172.21.15.119:0/1084763777 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100a5880 con 0x7fdf180ceac0 2023-12-19T16:16:23.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf1d4d3640 1 -- 172.21.15.119:0/1084763777 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100a59e0 con 0x7fdf180ceac0 2023-12-19T16:16:23.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf1d4d3640 1 -- 172.21.15.119:0/1084763777 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100a5d70 con 0x7fdf180ceac0 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 -- 172.21.15.119:0/1084763777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 msgr2=0x7fdf180c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 --2- 172.21.15.119:0/1084763777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c8e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009e50 tx=0x7fdf1001c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 -- 172.21.15.119:0/1084763777 shutdown_connections 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 --2- 172.21.15.119:0/1084763777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c8e50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 -- 172.21.15.119:0/1084763777 >> 172.21.15.119:0/1084763777 conn(0x7fdf1806a2a0 msgr2=0x7fdf180aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 -- 172.21.15.119:0/1084763777 shutdown_connections 2023-12-19T16:16:23.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 -- 172.21.15.119:0/1084763777 wait complete. 2023-12-19T16:16:23.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 Processor -- start 2023-12-19T16:16:23.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.262+0000 7fdf20739640 1 -- start start 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf18070820 0x7fdf1815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf181582d0 0x7fdf180c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18148b30 con 0x7fdf180ceac0 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18148e10 con 0x7fdf18070820 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf181490f0 con 0x7fdf181582d0 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34928/0 (socket says 172.21.15.119:34928) 2023-12-19T16:16:23.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 -- 172.21.15.119:0/1437811079 learned_addr learned my addr 172.21.15.119:0/1437811079 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1e4d5640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf18070820 0x7fdf1815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1ecd6640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf181582d0 0x7fdf180c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 -- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf181582d0 msgr2=0x7fdf180c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf181582d0 0x7fdf180c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 -- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf18070820 msgr2=0x7fdf1815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf18070820 0x7fdf1815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 -- 172.21.15.119:0/1437811079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009b30 con 0x7fdf180ceac0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf1dcd4640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c1f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c450 tx=0x7fdf0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08012830 con 0x7fdf180ceac0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf080129b0 con 0x7fdf180ceac0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf181493d0 con 0x7fdf180ceac0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08012d60 con 0x7fdf180ceac0 2023-12-19T16:16:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf180c3ff0 con 0x7fdf180ceac0 2023-12-19T16:16:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf18149610 con 0x7fdf180ceac0 2023-12-19T16:16:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.266+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf0801c460 con 0x7fdf180ceac0 2023-12-19T16:16:23.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.270+0000 7fdf0effd640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdefc065a60 0x7fdefc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.270+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fdf08083380 con 0x7fdf180ceac0 2023-12-19T16:16:23.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.270+0000 7fdf1e4d5640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdefc065a60 0x7fdefc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.270+0000 7fdf1e4d5640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdefc065a60 0x7fdefc067f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000f70 tx=0x7fdf14007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.274+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdf18149610 con 0x7fdf180ceac0 2023-12-19T16:16:23.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.426+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf18148c70 con 0x7fdf180ceac0 2023-12-19T16:16:23.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.426+0000 7fdf0effd640 1 -- 172.21.15.119:0/1437811079 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf18148c70 con 0x7fdf180ceac0 2023-12-19T16:16:23.433 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdefc065a60 msgr2=0x7fdefc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdefc065a60 0x7fdefc067f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000f70 tx=0x7fdf14007e50 comp rx=0 tx=0).stop 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 msgr2=0x7fdf180c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c1f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c450 tx=0x7fdf0800c910 comp rx=0 tx=0).stop 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 shutdown_connections 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdefc065a60 0x7fdefc067f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf181582d0 0x7fdf180c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf180ceac0 0x7fdf180c1f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 --2- 172.21.15.119:0/1437811079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf18070820 0x7fdf1815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 >> 172.21.15.119:0/1437811079 conn(0x7fdf1806a2a0 msgr2=0x7fdf180ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 shutdown_connections 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.430+0000 7fdf20739640 1 -- 172.21.15.119:0/1437811079 wait complete. 2023-12-19T16:16:23.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 Processor -- start 2023-12-19T16:16:23.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 -- start start 2023-12-19T16:16:23.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f697c070820 0x7f697c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f697c0ce3b0 0x7f697c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c0c9390 con 0x7f697c1582d0 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0ced60 con 0x7f697c070820 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6981139640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c15aee0 con 0x7f697c0ce3b0 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6973fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f697c070820 0x7f697c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6973fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f697c070820 0x7f697c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34944/0 (socket says 172.21.15.119:34944) 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f6973fff640 1 -- 172.21.15.119:0/2747527639 learned_addr learned my addr 172.21.15.119:0/2747527639 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.590+0000 7f697b59e640 1 --2- 172.21.15.119:0/2747527639 >> v2:172.21.15.143:3300/0 conn(0x7f697c0ce3b0 0x7f697c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6973fff640 1 -- 172.21.15.119:0/2747527639 >> v2:172.21.15.143:3300/0 conn(0x7f697c0ce3b0 msgr2=0x7f697c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6973fff640 1 --2- 172.21.15.119:0/2747527639 >> v2:172.21.15.143:3300/0 conn(0x7f697c0ce3b0 0x7f697c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6973fff640 1 -- 172.21.15.119:0/2747527639 >> v1:172.21.15.143:6789/0 conn(0x7f697c1582d0 legacy=0x7f697c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6973fff640 1 -- 172.21.15.119:0/2747527639 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c15b1c0 con 0x7f697c070820 2023-12-19T16:16:23.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6973fff640 1 --2- 172.21.15.119:0/2747527639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c0c8e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f697c06fbb0 tx=0x7f696401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e080506e8e4bb8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f697a59c640 1 -- 172.21.15.119:0/2747527639 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640aa430 con 0x7f697c070820 2023-12-19T16:16:23.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f697a59c640 1 -- 172.21.15.119:0/2747527639 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640aa590 con 0x7f697c070820 2023-12-19T16:16:23.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f697a59c640 1 -- 172.21.15.119:0/2747527639 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640aa920 con 0x7f697c070820 2023-12-19T16:16:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6981139640 1 -- 172.21.15.119:0/2747527639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 msgr2=0x7f697c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.594+0000 7f6981139640 1 --2- 172.21.15.119:0/2747527639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c0c8e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f697c06fbb0 tx=0x7f696401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- 172.21.15.119:0/2747527639 shutdown_connections 2023-12-19T16:16:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 --2- 172.21.15.119:0/2747527639 >> v2:172.21.15.143:3300/0 conn(0x7f697c0ce3b0 0x7f697c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 --2- 172.21.15.119:0/2747527639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c0c8e50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- 172.21.15.119:0/2747527639 >> 172.21.15.119:0/2747527639 conn(0x7f697c06a2a0 msgr2=0x7f697c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- 172.21.15.119:0/2747527639 shutdown_connections 2023-12-19T16:16:23.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- 172.21.15.119:0/2747527639 wait complete. 2023-12-19T16:16:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 Processor -- start 2023-12-19T16:16:23.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- start start 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f697c0ce3b0 0x7f697c164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f697c1582d0 0x7f697c0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c152360 con 0x7f697c070820 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15e870 con 0x7f697c1582d0 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6981139640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15eb50 con 0x7f697c0ce3b0 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c15e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34956/0 (socket says 172.21.15.119:34956) 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 -- 172.21.15.119:0/741543409 learned_addr learned my addr 172.21.15.119:0/741543409 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f6973fff640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f697c0ce3b0 0x7f697c164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697b59e640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f697c1582d0 0x7f697c0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 -- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f697c0ce3b0 msgr2=0x7f697c164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f697c0ce3b0 0x7f697c164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 -- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f697c1582d0 msgr2=0x7f697c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f697c1582d0 0x7f697c0c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697ad9d640 1 -- 172.21.15.119:0/741543409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640094d0 con 0x7f697c070820 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.598+0000 7f697b59e640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f697c1582d0 0x7f697c0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f697ad9d640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c15e190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f696c00c3c0 tx=0x7f696c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0052d0 con 0x7f697c070820 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c005430 con 0x7f697c070820 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003840 con 0x7f697c070820 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c15ee30 con 0x7f697c070820 2023-12-19T16:16:23.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c164e90 con 0x7f697c070820 2023-12-19T16:16:23.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c152130 con 0x7f697c070820 2023-12-19T16:16:23.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f696c0039a0 con 0x7f697c070820 2023-12-19T16:16:23.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f69737fe640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f695c065a60 0x7f695c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f696c082ad0 con 0x7f697c070820 2023-12-19T16:16:23.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.602+0000 7f6973fff640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f695c065a60 0x7f695c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.606+0000 7f6973fff640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f695c065a60 0x7f695c067f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f69640ae000 tx=0x7f69640b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.606+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f697c152130 con 0x7f697c070820 2023-12-19T16:16:23.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f697c152130 con 0x7f697c070820 2023-12-19T16:16:23.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f69737fe640 1 -- 172.21.15.119:0/741543409 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f696c017020 con 0x7f697c070820 2023-12-19T16:16:23.762 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f695c065a60 msgr2=0x7f695c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f695c065a60 0x7f695c067f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f69640ae000 tx=0x7f69640b5040 comp rx=0 tx=0).stop 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 msgr2=0x7f697c15e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c15e190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f696c00c3c0 tx=0x7f696c00c880 comp rx=0 tx=0).stop 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 shutdown_connections 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f695c065a60 0x7f695c067f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f697c1582d0 0x7f697c0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f697c0ce3b0 0x7f697c164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 --2- 172.21.15.119:0/741543409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f697c070820 0x7f697c15e190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 >> 172.21.15.119:0/741543409 conn(0x7f697c06a2a0 msgr2=0x7f697c06be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 shutdown_connections 2023-12-19T16:16:23.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.758+0000 7f6981139640 1 -- 172.21.15.119:0/741543409 wait complete. 2023-12-19T16:16:23.783 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:23.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfc556d640 1 Processor -- start 2023-12-19T16:16:23.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfc556d640 1 -- start start 2023-12-19T16:16:23.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfc556d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfc00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfc556d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc00cdf40 con 0x7fbfc006d3b0 2023-12-19T16:16:23.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfc556d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc0071dc0 con 0x7fbfc00cb790 2023-12-19T16:16:23.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfc556d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0071610 con 0x7fbfc015a380 2023-12-19T16:16:23.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbf7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbfc006d3b0 0x7fbfc015ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55378/0 (socket says 172.21.15.119:55378) 2023-12-19T16:16:23.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbf7fe640 1 -- 172.21.15.119:0/2161717487 learned_addr learned my addr 172.21.15.119:0/2161717487 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:23.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfc00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579865520 0 0) 0x7fbfc00cdf40 con 0x7fbfc006d3b0 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfac003530 con 0x7fbfc006d3b0 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857171827 0 0) 0x7fbfc0071dc0 con 0x7fbfc00cb790 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc00cdf40 con 0x7fbfc00cb790 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.918+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1633977325 0 0) 0x7fbfac003530 con 0x7fbfc006d3b0 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 msgr2=0x7fbfc00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfc00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 >> v1:172.21.15.143:6789/0 conn(0x7fbfc00cb790 legacy=0x7fbfc0070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00b13e0 con 0x7fbfc006d3b0 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fbfb8001a00 con 0x7fbfc006d3b0 2023-12-19T16:16:23.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 >> v1:172.21.15.119:6789/0 conn(0x7fbfc006d3b0 legacy=0x7fbfc015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfac003b40 0x7fbfac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac0047d0 0x7fbfac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfac0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac00bb20 con 0x7fbfac003b40 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac00bc60 con 0x7fbfac0047d0 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac00bdf0 con 0x7fbfc015a380 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfac003b40 0x7fbfac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbf7fe640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfac0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfb67fc640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac0047d0 0x7fbfac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 -- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 msgr2=0x7fbfac0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfac0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 -- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac0047d0 msgr2=0x7fbfac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac0047d0 0x7fbfac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 -- 172.21.15.119:0/2161717487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac003530 con 0x7fbfac003b40 2023-12-19T16:16:23.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbf7fe640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc015a380 0x7fbfac0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:23.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfb67fc640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac0047d0 0x7fbfac004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfac003b40 0x7fbfac003f40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009b10 tx=0x7fbfb001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b5e23c4f59145b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00a55f0 con 0x7fbfac003b40 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb00a5750 con 0x7fbfac003b40 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.922+0000 7fbfbe7fc640 1 -- 172.21.15.119:0/2161717487 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00a5b00 con 0x7fbfac003b40 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- 172.21.15.119:0/2161717487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfac003b40 msgr2=0x7fbfac003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 --2- 172.21.15.119:0/2161717487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfac003b40 0x7fbfac003f40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009b10 tx=0x7fbfb001ca20 comp rx=0 tx=0).stop 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfbf7fe640 1 -- 172.21.15.119:0/2161717487 reap_dead start 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- 172.21.15.119:0/2161717487 shutdown_connections 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- 172.21.15.119:0/2161717487 >> 172.21.15.119:0/2161717487 conn(0x7fbfc006b1b0 msgr2=0x7fbfc006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- 172.21.15.119:0/2161717487 shutdown_connections 2023-12-19T16:16:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- 172.21.15.119:0/2161717487 wait complete. 2023-12-19T16:16:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 Processor -- start 2023-12-19T16:16:23.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- start start 2023-12-19T16:16:23.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac003b40 0x7fbfc0145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 0x7fbfc0153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc00b1fb0 0x7fbfc00b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0154d10 con 0x7fbfc01539b0 2023-12-19T16:16:23.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc015e3f0 con 0x7fbfac003b40 2023-12-19T16:16:23.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfc556d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00b2970 con 0x7fbfc00b1fb0 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfb67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 0x7fbfc0153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfb67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 0x7fbfc0153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34972/0 (socket says 172.21.15.119:34972) 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.926+0000 7fbfb67fc640 1 -- 172.21.15.119:0/1900944307 learned_addr learned my addr 172.21.15.119:0/1900944307 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac003b40 0x7fbfc0145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfbf7fe640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc00b1fb0 0x7fbfc00b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb67fc640 1 -- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc00b1fb0 msgr2=0x7fbfc00b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb67fc640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc00b1fb0 0x7fbfc00b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb67fc640 1 -- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac003b40 msgr2=0x7fbfc0145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb67fc640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac003b40 0x7fbfc0145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb67fc640 1 -- 172.21.15.119:0/1900944307 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0154470 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb67fc640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 0x7fbfc0153e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800e810 tx=0x7fbfa800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8017070 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800eec0 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80052e0 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0154750 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc00b44b0 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc004e000 con 0x7fbfc01539b0 2023-12-19T16:16:23.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbfa8007020 con 0x7fbfc01539b0 2023-12-19T16:16:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb7fff640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfa0065a90 0x7fbfa0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fbfa8082c70 con 0x7fbfc01539b0 2023-12-19T16:16:23.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.930+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfa0065a90 0x7fbfa0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.934+0000 7fbfbeffd640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfa0065a90 0x7fbfa0067f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00af000 tx=0x7fbfb00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:23.934+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbfa8050360 con 0x7fbfc01539b0 2023-12-19T16:16:24.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.082+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbfc015e530 con 0x7fbfc01539b0 2023-12-19T16:16:24.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfb7fff640 1 -- 172.21.15.119:0/1900944307 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbfa8053980 con 0x7fbfc01539b0 2023-12-19T16:16:24.090 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfa0065a90 msgr2=0x7fbfa0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfa0065a90 0x7fbfa0067f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00af000 tx=0x7fbfb00046d0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 msgr2=0x7fbfc0153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 0x7fbfc0153e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800e810 tx=0x7fbfa800ecd0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 shutdown_connections 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfa0065a90 0x7fbfa0067f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfc00b1fb0 0x7fbfc00b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc01539b0 0x7fbfc0153e30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 --2- 172.21.15.119:0/1900944307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfac003b40 0x7fbfc0145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 >> 172.21.15.119:0/1900944307 conn(0x7fbfc006b1b0 msgr2=0x7fbfc0159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 shutdown_connections 2023-12-19T16:16:24.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.086+0000 7fbfc556d640 1 -- 172.21.15.119:0/1900944307 wait complete. 2023-12-19T16:16:24.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:24.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8fc66640 1 Processor -- start 2023-12-19T16:16:24.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8fc66640 1 -- start start 2023-12-19T16:16:24.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8fc66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b880cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8fc66640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880d11c0 con 0x7f3b880cf7e0 2023-12-19T16:16:24.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8fc66640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880d0310 con 0x7f3b880ce3f0 2023-12-19T16:16:24.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8fc66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880d05b0 con 0x7f3b8815ca40 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8e203640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3b880cf7e0 0x7f3b881668e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55390/0 (socket says 172.21.15.119:55390) 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8e203640 1 -- 172.21.15.119:0/2504357425 learned_addr learned my addr 172.21.15.119:0/2504357425 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8da02640 1 --2- 172.21.15.119:0/2504357425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b880cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8ca00640 1 -- 172.21.15.119:0/2504357425 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002109703 0 0) 0x7f3b880d11c0 con 0x7f3b880cf7e0 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8ca00640 1 -- 172.21.15.119:0/2504357425 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b74003530 con 0x7f3b880cf7e0 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8ca00640 1 -- 172.21.15.119:0/2504357425 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102626422 0 0) 0x7f3b880d0310 con 0x7f3b880ce3f0 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8da02640 1 -- 172.21.15.119:0/2504357425 >> v1:172.21.15.143:6789/0 conn(0x7f3b880ce3f0 legacy=0x7f3b880cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8da02640 1 -- 172.21.15.119:0/2504357425 >> v1:172.21.15.119:6789/0 conn(0x7f3b880cf7e0 legacy=0x7f3b881668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.246+0000 7f3b8da02640 1 -- 172.21.15.119:0/2504357425 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880d0890 con 0x7f3b8815ca40 2023-12-19T16:16:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.250+0000 7f3b8da02640 1 --2- 172.21.15.119:0/2504357425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b880cdeb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b840097d0 tx=0x7f3b8401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f35189610ef3534 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.250+0000 7f3b8ca00640 1 -- 172.21.15.119:0/2504357425 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840a6040 con 0x7f3b8815ca40 2023-12-19T16:16:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.250+0000 7f3b8ca00640 1 -- 172.21.15.119:0/2504357425 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b840aa600 con 0x7f3b8815ca40 2023-12-19T16:16:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.250+0000 7f3b8ca00640 1 -- 172.21.15.119:0/2504357425 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840aa970 con 0x7f3b8815ca40 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.250+0000 7f3b8fc66640 1 -- 172.21.15.119:0/2504357425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 msgr2=0x7f3b880cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.250+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/2504357425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b880cdeb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b840097d0 tx=0x7f3b8401c4a0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- 172.21.15.119:0/2504357425 shutdown_connections 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/2504357425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b880cdeb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- 172.21.15.119:0/2504357425 >> 172.21.15.119:0/2504357425 conn(0x7f3b88089fb0 msgr2=0x7f3b880d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- 172.21.15.119:0/2504357425 shutdown_connections 2023-12-19T16:16:24.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- 172.21.15.119:0/2504357425 wait complete. 2023-12-19T16:16:24.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 Processor -- start 2023-12-19T16:16:24.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- start start 2023-12-19T16:16:24.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 0x7f3b8814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b880cf7e0 0x7f3b880b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b8806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814e190 con 0x7f3b880ce3f0 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814dec0 con 0x7f3b880cf7e0 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8fc66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8815afc0 con 0x7f3b8815ca40 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 0x7f3b8814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 0x7f3b8814d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34976/0 (socket says 172.21.15.119:34976) 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 -- 172.21.15.119:0/172943548 learned_addr learned my addr 172.21.15.119:0/172943548 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8e203640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b8806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8d201640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b880cf7e0 0x7f3b880b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 -- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 msgr2=0x7f3b8806bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b8806bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 -- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b880cf7e0 msgr2=0x7f3b880b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b880cf7e0 0x7f3b880b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8da02640 1 -- 172.21.15.119:0/172943548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840093b0 con 0x7f3b880ce3f0 2023-12-19T16:16:24.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.254+0000 7f3b8e203640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b8806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:24.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b8da02640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 0x7f3b8814d980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b8401ab50 tx=0x7f3b84019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840aab80 con 0x7f3b880ce3f0 2023-12-19T16:16:24.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b840aace0 con 0x7f3b880ce3f0 2023-12-19T16:16:24.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84003820 con 0x7f3b880ce3f0 2023-12-19T16:16:24.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b880d17d0 con 0x7f3b880ce3f0 2023-12-19T16:16:24.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8815b580 con 0x7f3b880ce3f0 2023-12-19T16:16:24.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8804e000 con 0x7f3b880ce3f0 2023-12-19T16:16:24.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b84003980 con 0x7f3b880ce3f0 2023-12-19T16:16:24.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b7e7fc640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3b6c065a60 0x7f3b6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3b840b7070 con 0x7f3b880ce3f0 2023-12-19T16:16:24.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.258+0000 7f3b8d201640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3b6c065a60 0x7f3b6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.262+0000 7f3b8d201640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3b6c065a60 0x7f3b6c067f20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b880cf5f0 tx=0x7f3b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.262+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3b840eb410 con 0x7f3b880ce3f0 2023-12-19T16:16:24.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b880b2e50 con 0x7f3b880ce3f0 2023-12-19T16:16:24.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b7e7fc640 1 -- 172.21.15.119:0/172943548 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3b840eea30 con 0x7f3b880ce3f0 2023-12-19T16:16:24.431 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:24.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3b6c065a60 msgr2=0x7f3b6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3b6c065a60 0x7f3b6c067f20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b880cf5f0 tx=0x7f3b78009040 comp rx=0 tx=0).stop 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 msgr2=0x7f3b8814d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 0x7f3b8814d980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b8401ab50 tx=0x7f3b84019240 comp rx=0 tx=0).stop 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 shutdown_connections 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3b6c065a60 0x7f3b6c067f20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b880cf7e0 0x7f3b880b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b8815ca40 0x7f3b8806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 --2- 172.21.15.119:0/172943548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b880ce3f0 0x7f3b8814d980 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 >> 172.21.15.119:0/172943548 conn(0x7f3b88089fb0 msgr2=0x7f3b880b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 shutdown_connections 2023-12-19T16:16:24.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.426+0000 7f3b8fc66640 1 -- 172.21.15.119:0/172943548 wait complete. 2023-12-19T16:16:24.452 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:16:24.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:24.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-19T16:16:24.474 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:24.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:16:24.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:24.475 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T16:16:24.530 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:16:24.530 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:24.540 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:16:24.540 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:24.596 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:24.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 Processor -- start 2023-12-19T16:16:24.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 -- start start 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f296c0ccea0 0x7f296c0cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296c0d1230 con 0x7f296c0d0e50 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c15ba80 con 0x7f296c0ccea0 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29721a2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0ce0b0 con 0x7f296c15ad10 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f296c0ccea0 0x7f296c0cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f296c0ccea0 0x7f296c0cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34986/0 (socket says 172.21.15.119:34986) 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 -- 172.21.15.119:0/1656633435 learned_addr learned my addr 172.21.15.119:0/1656633435 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29711a0640 1 --1- 172.21.15.119:0/1656633435 >> v1:172.21.15.119:6789/0 conn(0x7f296c0d0e50 0x7f296c0cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55392/0 (socket says 172.21.15.119:55392) 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29719a1640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 -- 172.21.15.119:0/1656633435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 msgr2=0x7f296c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:24.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 -- 172.21.15.119:0/1656633435 >> v1:172.21.15.119:6789/0 conn(0x7f296c0d0e50 legacy=0x7f296c0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f297099f640 1 -- 172.21.15.119:0/1656633435 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c0ce370 con 0x7f296c0ccea0 2023-12-19T16:16:24.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.730+0000 7f29719a1640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:24.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f297099f640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ccea0 0x7f296c0cee50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d15cfcef1d127d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f2963fff640 1 -- 172.21.15.119:0/1656633435 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0aa670 con 0x7f296c0ccea0 2023-12-19T16:16:24.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f2963fff640 1 -- 172.21.15.119:0/1656633435 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c0aa7d0 con 0x7f296c0ccea0 2023-12-19T16:16:24.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f2963fff640 1 -- 172.21.15.119:0/1656633435 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0aab60 con 0x7f296c0ccea0 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 -- 172.21.15.119:0/1656633435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ccea0 msgr2=0x7f296c0cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ccea0 0x7f296c0cee50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c01c510 comp rx=0 tx=0).stop 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 -- 172.21.15.119:0/1656633435 shutdown_connections 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 --2- 172.21.15.119:0/1656633435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ccea0 0x7f296c0cee50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 -- 172.21.15.119:0/1656633435 >> 172.21.15.119:0/1656633435 conn(0x7f296c069ca0 msgr2=0x7f296c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 -- 172.21.15.119:0/1656633435 shutdown_connections 2023-12-19T16:16:24.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.734+0000 7f29721a2640 1 -- 172.21.15.119:0/1656633435 wait complete. 2023-12-19T16:16:24.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 Processor -- start 2023-12-19T16:16:24.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 -- start start 2023-12-19T16:16:24.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f296c0ccea0 0x7f296c0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 0x7f296c159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c4530 con 0x7f296c0d0e50 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c47d0 con 0x7f296c0ccea0 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c4ab0 con 0x7f296c15ad10 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 0x7f296c159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 0x7f296c159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34998/0 (socket says 172.21.15.119:34998) 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 -- 172.21.15.119:0/167846903 learned_addr learned my addr 172.21.15.119:0/167846903 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29719a1640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29711a0640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f296c0ccea0 0x7f296c0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 -- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 msgr2=0x7f296c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 -- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f296c0ccea0 msgr2=0x7f296c0c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f296c0ccea0 0x7f296c0c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 -- 172.21.15.119:0/167846903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0094d0 con 0x7f296c0d0e50 2023-12-19T16:16:24.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f297099f640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 0x7f296c159730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f295c01a140 tx=0x7f295c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0b38c0 con 0x7f296c0d0e50 2023-12-19T16:16:24.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c0b3a20 con 0x7f296c0d0e50 2023-12-19T16:16:24.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c0c4d90 con 0x7f296c0d0e50 2023-12-19T16:16:24.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0b3dd0 con 0x7f296c0d0e50 2023-12-19T16:16:24.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.738+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c0c5350 con 0x7f296c0d0e50 2023-12-19T16:16:24.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.742+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c15ab40 con 0x7f296c0d0e50 2023-12-19T16:16:24.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.742+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f295c0b2380 con 0x7f296c0d0e50 2023-12-19T16:16:24.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.742+0000 7f2961ffb640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2950065a60 0x7f2950067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.742+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f295c11d8b0 con 0x7f296c0d0e50 2023-12-19T16:16:24.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.742+0000 7f29711a0640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2950065a60 0x7f2950067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.742+0000 7f29711a0640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2950065a60 0x7f2950067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2968000f70 tx=0x7f2968007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.746+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f295c0eadc0 con 0x7f296c0d0e50 2023-12-19T16:16:24.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.898+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f296c04e850 con 0x7f296c0d0e50 2023-12-19T16:16:24.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.898+0000 7f2961ffb640 1 -- 172.21.15.119:0/167846903 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f295c0ee3e0 con 0x7f296c0d0e50 2023-12-19T16:16:24.903 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:24.903 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:24.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2950065a60 msgr2=0x7f2950067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2950065a60 0x7f2950067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2968000f70 tx=0x7f2968007c90 comp rx=0 tx=0).stop 2023-12-19T16:16:24.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 msgr2=0x7f296c159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 0x7f296c159730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f295c01a140 tx=0x7f295c01ad50 comp rx=0 tx=0).stop 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 shutdown_connections 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2950065a60 0x7f2950067f20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f296c15ad10 0x7f296c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0d0e50 0x7f296c159730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 --2- 172.21.15.119:0/167846903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f296c0ccea0 0x7f296c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 >> 172.21.15.119:0/167846903 conn(0x7f296c069ca0 msgr2=0x7f296c06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 shutdown_connections 2023-12-19T16:16:24.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:24.902+0000 7f29721a2640 1 -- 172.21.15.119:0/167846903 wait complete. 2023-12-19T16:16:24.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:24.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:25.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 Processor -- start 2023-12-19T16:16:25.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 -- start start 2023-12-19T16:16:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3c80cb4c0 0x7fe3c815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c8160860 con 0x7fe3c815d920 2023-12-19T16:16:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c81611e0 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3cdb98640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c815e110 con 0x7fe3c80adb30 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c6ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3c80cb4c0 0x7fe3c815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c7fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe3c815d920 0x7fe3c815c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55396/0 (socket says 172.21.15.119:55396) 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c7fff640 1 -- 172.21.15.119:0/703292312 learned_addr learned my addr 172.21.15.119:0/703292312 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c77fe640 1 --2- 172.21.15.119:0/703292312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/703292312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 msgr2=0x7fe3c80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c6ffd640 1 --2- 172.21.15.119:0/703292312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/703292312 >> v1:172.21.15.119:6789/0 conn(0x7fe3c815d920 legacy=0x7fe3c815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/703292312 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8160b20 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.062+0000 7fe3c67fc640 1 -- 172.21.15.119:0/703292312 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261824502 0 0) 0x7fe3c8160860 con 0x7fe3c815d920 2023-12-19T16:16:25.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3c6ffd640 1 --2- 172.21.15.119:0/703292312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c815d3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0097c0 tx=0x7fe3bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e575649769c457 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3c67fc640 1 -- 172.21.15.119:0/703292312 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0ab600 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3c67fc640 1 -- 172.21.15.119:0/703292312 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0a7050 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3c67fc640 1 -- 172.21.15.119:0/703292312 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0ab980 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 -- 172.21.15.119:0/703292312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 msgr2=0x7fe3c815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/703292312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c815d3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0097c0 tx=0x7fe3bc01c450 comp rx=0 tx=0).stop 2023-12-19T16:16:25.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 -- 172.21.15.119:0/703292312 shutdown_connections 2023-12-19T16:16:25.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/703292312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c815d3e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/703292312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 -- 172.21.15.119:0/703292312 >> 172.21.15.119:0/703292312 conn(0x7fe3c80b0380 msgr2=0x7fe3c80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 -- 172.21.15.119:0/703292312 shutdown_connections 2023-12-19T16:16:25.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 -- 172.21.15.119:0/703292312 wait complete. 2023-12-19T16:16:25.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.066+0000 7fe3cdb98640 1 Processor -- start 2023-12-19T16:16:25.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- start start 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c8156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3c815d920 0x7fe3c8156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814f8d0 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814fbb0 con 0x7fe3c815d920 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814fe90 con 0x7fe3c80adb30 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c8156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c8156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35020/0 (socket says 172.21.15.119:35020) 2023-12-19T16:16:25.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/537825498 learned_addr learned my addr 172.21.15.119:0/537825498 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c77fe640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 msgr2=0x7fe3c80aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3c815d920 msgr2=0x7fe3c8156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3c815d920 0x7fe3c8156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/537825498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009420 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3c6ffd640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c8156330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc01a080 tx=0x7fe3bc0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b4410 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0b4590 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b4940 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c8150170 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c814f520 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.070+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c80cd060 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.074+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3bc0b2040 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.074+0000 7fe3affff640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.074+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe3bc11d510 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.074+0000 7fe3c77fe640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.074+0000 7fe3c77fe640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80096f0 tx=0x7fe3b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.078+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe3bc0eaac0 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3c804e000 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3affff640 1 -- 172.21.15.119:0/537825498 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3bc0b00a0 con 0x7fe3c80cb4c0 2023-12-19T16:16:25.235 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 msgr2=0x7fe3b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80096f0 tx=0x7fe3b8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 msgr2=0x7fe3c8156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c8156330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc01a080 tx=0x7fe3bc0191f0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 shutdown_connections 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3c815d920 0x7fe3c8156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c80cb4c0 0x7fe3c8156330 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 --2- 172.21.15.119:0/537825498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3c80adb30 0x7fe3c80aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 >> 172.21.15.119:0/537825498 conn(0x7fe3c80b0380 msgr2=0x7fe3c80b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 shutdown_connections 2023-12-19T16:16:25.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.230+0000 7fe3cdb98640 1 -- 172.21.15.119:0/537825498 wait complete. 2023-12-19T16:16:25.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:25.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.390+0000 7f8789266640 1 Processor -- start 2023-12-19T16:16:25.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 -- start start 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87841582d0 0x7f87840c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8784070820 0x7f87840ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87840ce3b0 0x7f87840ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840ced80 con 0x7f87840ce3b0 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840c9390 con 0x7f87841582d0 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8789266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878415aee0 con 0x7f8784070820 2023-12-19T16:16:25.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87840ce3b0 0x7f87840ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87840ce3b0 0x7f87840ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35022/0 (socket says 172.21.15.119:35022) 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 -- 172.21.15.119:0/956014056 learned_addr learned my addr 172.21.15.119:0/956014056 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f8782ffd640 1 --2- 172.21.15.119:0/956014056 >> v2:172.21.15.143:3300/0 conn(0x7f87841582d0 0x7f87840c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87827fc640 1 --2- 172.21.15.119:0/956014056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8784070820 0x7f87840ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 -- 172.21.15.119:0/956014056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8784070820 msgr2=0x7f87840ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 --2- 172.21.15.119:0/956014056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8784070820 0x7f87840ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 -- 172.21.15.119:0/956014056 >> v2:172.21.15.143:3300/0 conn(0x7f87841582d0 msgr2=0x7f87840c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 --2- 172.21.15.119:0/956014056 >> v2:172.21.15.143:3300/0 conn(0x7f87841582d0 0x7f87840c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.394+0000 7f87837fe640 1 -- 172.21.15.119:0/956014056 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878415b1c0 con 0x7f87840ce3b0 2023-12-19T16:16:25.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f87837fe640 1 --2- 172.21.15.119:0/956014056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840ce840 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f87840cf000 tx=0x7f877c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8fb19dff70a360 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8781ffb640 1 -- 172.21.15.119:0/956014056 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0a5820 con 0x7f87840ce3b0 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8781ffb640 1 -- 172.21.15.119:0/956014056 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0a5980 con 0x7f87840ce3b0 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8781ffb640 1 -- 172.21.15.119:0/956014056 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0a5d10 con 0x7f87840ce3b0 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 -- 172.21.15.119:0/956014056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 msgr2=0x7f87840ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 --2- 172.21.15.119:0/956014056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840ce840 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f87840cf000 tx=0x7f877c01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 -- 172.21.15.119:0/956014056 shutdown_connections 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 --2- 172.21.15.119:0/956014056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840ce840 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 --2- 172.21.15.119:0/956014056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8784070820 0x7f87840ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 --2- 172.21.15.119:0/956014056 >> v2:172.21.15.143:3300/0 conn(0x7f87841582d0 0x7f87840c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 -- 172.21.15.119:0/956014056 >> 172.21.15.119:0/956014056 conn(0x7f878406a2a0 msgr2=0x7f87840aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 -- 172.21.15.119:0/956014056 shutdown_connections 2023-12-19T16:16:25.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 -- 172.21.15.119:0/956014056 wait complete. 2023-12-19T16:16:25.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 Processor -- start 2023-12-19T16:16:25.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.398+0000 7f8789266640 1 -- start start 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8784070820 0x7f878415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87841582d0 0x7f87840cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87840cd960 con 0x7f87840ce3b0 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87840ccd50 con 0x7f8784070820 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87840cd030 con 0x7f87841582d0 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35026/0 (socket says 172.21.15.119:35026) 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 -- 172.21.15.119:0/1111587541 learned_addr learned my addr 172.21.15.119:0/1111587541 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8782ffd640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8784070820 0x7f878415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87837fe640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87841582d0 0x7f87840cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 -- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87841582d0 msgr2=0x7f87840cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87841582d0 0x7f87840cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 -- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8784070820 msgr2=0x7f878415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8784070820 0x7f878415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 -- 172.21.15.119:0/1111587541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009b30 con 0x7f87840ce3b0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f87827fc640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840c3920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f877800e930 tx=0x7f877800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778009690 con 0x7f87840ce3b0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800ca00 con 0x7f87840ce3b0 2023-12-19T16:16:25.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87840cd310 con 0x7f87840ce3b0 2023-12-19T16:16:25.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800cd70 con 0x7f87840ce3b0 2023-12-19T16:16:25.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87840cca40 con 0x7f87840ce3b0 2023-12-19T16:16:25.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.402+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878404e000 con 0x7f87840ce3b0 2023-12-19T16:16:25.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.406+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8778013470 con 0x7f87840ce3b0 2023-12-19T16:16:25.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.406+0000 7f876b7fe640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8770065a90 0x7f8770067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.406+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8778083810 con 0x7f87840ce3b0 2023-12-19T16:16:25.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.406+0000 7f8782ffd640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8770065a90 0x7f8770067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.406+0000 7f8782ffd640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8770065a90 0x7f8770067f50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8774009a40 tx=0x7f8774009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.410+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8778050e90 con 0x7f87840ce3b0 2023-12-19T16:16:25.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87840b0c00 con 0x7f87840ce3b0 2023-12-19T16:16:25.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f876b7fe640 1 -- 172.21.15.119:0/1111587541 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87780544b0 con 0x7f87840ce3b0 2023-12-19T16:16:25.571 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8770065a90 msgr2=0x7f8770067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8770065a90 0x7f8770067f50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8774009a40 tx=0x7f8774009190 comp rx=0 tx=0).stop 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 msgr2=0x7f87840c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840c3920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f877800e930 tx=0x7f877800edf0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 shutdown_connections 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8770065a90 0x7f8770067f50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87841582d0 0x7f87840cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87840ce3b0 0x7f87840c3920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 --2- 172.21.15.119:0/1111587541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8784070820 0x7f878415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 >> 172.21.15.119:0/1111587541 conn(0x7f878406a2a0 msgr2=0x7f87841586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 shutdown_connections 2023-12-19T16:16:25.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.566+0000 7f8789266640 1 -- 172.21.15.119:0/1111587541 wait complete. 2023-12-19T16:16:25.592 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.725+0000 7ff955552640 1 Processor -- start 2023-12-19T16:16:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff955552640 1 -- start start 2023-12-19T16:16:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff955552640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff95015cbd0 0x7ff9501610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff955552640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 0x7ff95006b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff955552640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9500ced90 con 0x7ff9500cc7f0 2023-12-19T16:16:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff955552640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9500cf220 con 0x7ff95015cbd0 2023-12-19T16:16:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff955552640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95015cfb0 con 0x7ff9500b2780 2023-12-19T16:16:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 0x7ff95006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff95015cbd0 0x7ff9501610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 0x7ff95006b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:34722/0 (socket says 172.21.15.119:34722) 2023-12-19T16:16:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 -- 172.21.15.119:0/3172005561 learned_addr learned my addr 172.21.15.119:0/3172005561 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 -- 172.21.15.119:0/3172005561 >> v2:172.21.15.143:3300/0 conn(0x7ff95015cbd0 msgr2=0x7ff9501610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 --2- 172.21.15.119:0/3172005561 >> v2:172.21.15.143:3300/0 conn(0x7ff95015cbd0 0x7ff9501610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 -- 172.21.15.119:0/3172005561 >> v1:172.21.15.143:6789/0 conn(0x7ff9500cc7f0 legacy=0x7ff9500b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94f7fe640 1 -- 172.21.15.119:0/3172005561 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500ccc50 con 0x7ff9500b2780 2023-12-19T16:16:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94e7fc640 1 -- 172.21.15.119:0/3172005561 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102742497 0 0) 0x7ff9500ced90 con 0x7ff9500cc7f0 2023-12-19T16:16:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.729+0000 7ff94effd640 1 --2- 172.21.15.119:0/3172005561 >> v2:172.21.15.143:3300/0 conn(0x7ff95015cbd0 0x7ff9501610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:25.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff94f7fe640 1 --2- 172.21.15.119:0/3172005561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 0x7ff95006b280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff948009e50 tx=0x7ff94801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22ae41e1324a254 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff94e7fc640 1 -- 172.21.15.119:0/3172005561 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9480a57d0 con 0x7ff9500b2780 2023-12-19T16:16:25.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff94e7fc640 1 -- 172.21.15.119:0/3172005561 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9480a5930 con 0x7ff9500b2780 2023-12-19T16:16:25.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff94e7fc640 1 -- 172.21.15.119:0/3172005561 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9480a5cc0 con 0x7ff9500b2780 2023-12-19T16:16:25.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 -- 172.21.15.119:0/3172005561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 msgr2=0x7ff95006b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 --2- 172.21.15.119:0/3172005561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 0x7ff95006b280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff948009e50 tx=0x7ff94801ca10 comp rx=0 tx=0).stop 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 -- 172.21.15.119:0/3172005561 shutdown_connections 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 --2- 172.21.15.119:0/3172005561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500b2780 0x7ff95006b280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 --2- 172.21.15.119:0/3172005561 >> v2:172.21.15.143:3300/0 conn(0x7ff95015cbd0 0x7ff9501610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 -- 172.21.15.119:0/3172005561 >> 172.21.15.119:0/3172005561 conn(0x7ff9500cd070 msgr2=0x7ff9500cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 -- 172.21.15.119:0/3172005561 shutdown_connections 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 -- 172.21.15.119:0/3172005561 wait complete. 2023-12-19T16:16:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.733+0000 7ff955552640 1 Processor -- start 2023-12-19T16:16:25.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- start start 2023-12-19T16:16:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 0x7ff95014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500cc7f0 0x7ff950150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff95015cbd0 0x7ff9500b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500b0050 con 0x7ff9500b2780 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95014feb0 con 0x7ff95015cbd0 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff950151310 con 0x7ff9500cc7f0 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 0x7ff95014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 0x7ff95014f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35028/0 (socket says 172.21.15.119:35028) 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 -- 172.21.15.119:0/1314654234 learned_addr learned my addr 172.21.15.119:0/1314654234 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff9467fc640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500cc7f0 0x7ff950150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94f7fe640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff95015cbd0 0x7ff9500b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 -- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500cc7f0 msgr2=0x7ff950150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500cc7f0 0x7ff950150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 -- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff95015cbd0 msgr2=0x7ff9500b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff95015cbd0 0x7ff9500b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 -- 172.21.15.119:0/1314654234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400093b0 con 0x7ff9500b2780 2023-12-19T16:16:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94f7fe640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff95015cbd0 0x7ff9500b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff9467fc640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500cc7f0 0x7ff950150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff94effd640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 0x7ff95014f970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e960 tx=0x7ff94000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000ca00 con 0x7ff9500b2780 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000cb60 con 0x7ff9500b2780 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400059a0 con 0x7ff9500b2780 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948009b30 con 0x7ff9500b2780 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9500b05d0 con 0x7ff9500b2780 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.737+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95004e000 con 0x7ff9500b2780 2023-12-19T16:16:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.741+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff940005b00 con 0x7ff9500b2780 2023-12-19T16:16:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.741+0000 7ff947fff640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff930065a60 0x7ff930067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.741+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff940083a80 con 0x7ff9500b2780 2023-12-19T16:16:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.741+0000 7ff9467fc640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff930065a60 0x7ff930067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.741+0000 7ff9467fc640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff930065a60 0x7ff930067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff950155880 tx=0x7ff938009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.745+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff940050f90 con 0x7ff9500b2780 2023-12-19T16:16:25.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.893+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9500b2c80 con 0x7ff9500b2780 2023-12-19T16:16:25.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.893+0000 7ff947fff640 1 -- 172.21.15.119:0/1314654234 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9400200a0 con 0x7ff9500b2780 2023-12-19T16:16:25.901 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff930065a60 msgr2=0x7ff930067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff930065a60 0x7ff930067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff950155880 tx=0x7ff938009040 comp rx=0 tx=0).stop 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 msgr2=0x7ff95014f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 0x7ff95014f970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e960 tx=0x7ff94000ee20 comp rx=0 tx=0).stop 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 shutdown_connections 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff930065a60 0x7ff930067f20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff95015cbd0 0x7ff9500b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9500cc7f0 0x7ff950150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 --2- 172.21.15.119:0/1314654234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9500b2780 0x7ff95014f970 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 >> 172.21.15.119:0/1314654234 conn(0x7ff9500cd070 msgr2=0x7ff95006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 shutdown_connections 2023-12-19T16:16:25.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:25.897+0000 7ff955552640 1 -- 172.21.15.119:0/1314654234 wait complete. 2023-12-19T16:16:25.922 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:26.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 Processor -- start 2023-12-19T16:16:26.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 -- start start 2023-12-19T16:16:26.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04ac159fb0 0x7f04ac071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac070df0 con 0x7f04ac071db0 2023-12-19T16:16:26.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac15aab0 con 0x7f04ac159fb0 2023-12-19T16:16:26.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b356d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac15a4f0 con 0x7f04ac0ca410 2023-12-19T16:16:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04ac159fb0 0x7f04ac071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b1309640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04ac159fb0 0x7f04ac071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:35916/0 (socket says 172.21.15.119:35916) 2023-12-19T16:16:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 -- 172.21.15.119:0/4183733460 learned_addr learned my addr 172.21.15.119:0/4183733460 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 -- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 msgr2=0x7f04ac159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 --2- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 -- 172.21.15.119:0/4183733460 >> v1:172.21.15.143:6789/0 conn(0x7f04ac071db0 legacy=0x7f04ac0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.057+0000 7f04b0b08640 1 -- 172.21.15.119:0/4183733460 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac15a7d0 con 0x7f04ac159fb0 2023-12-19T16:16:26.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b0b08640 1 --2- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac071870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f049c009870 tx=0x7f049c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12023741d6eb1334 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04a3fff640 1 -- 172.21.15.119:0/4183733460 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c0aa670 con 0x7f04ac159fb0 2023-12-19T16:16:26.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04a3fff640 1 -- 172.21.15.119:0/4183733460 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c0aa7d0 con 0x7f04ac159fb0 2023-12-19T16:16:26.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04a3fff640 1 -- 172.21.15.119:0/4183733460 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c0aab60 con 0x7f04ac159fb0 2023-12-19T16:16:26.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 -- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 msgr2=0x7f04ac071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 --2- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac071870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f049c009870 tx=0x7f049c01c510 comp rx=0 tx=0).stop 2023-12-19T16:16:26.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 -- 172.21.15.119:0/4183733460 shutdown_connections 2023-12-19T16:16:26.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 --2- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac071870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 --2- 172.21.15.119:0/4183733460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 -- 172.21.15.119:0/4183733460 >> 172.21.15.119:0/4183733460 conn(0x7f04ac06a2a0 msgr2=0x7f04ac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 -- 172.21.15.119:0/4183733460 shutdown_connections 2023-12-19T16:16:26.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.061+0000 7f04b356d640 1 -- 172.21.15.119:0/4183733460 wait complete. 2023-12-19T16:16:26.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 Processor -- start 2023-12-19T16:16:26.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 -- start start 2023-12-19T16:16:26.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 0x7f04ac153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac0c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0c6170 con 0x7f04ac071db0 2023-12-19T16:16:26.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0c6450 con 0x7f04ac159fb0 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0c6730 con 0x7f04ac0ca410 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 0x7f04ac153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 0x7f04ac153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35032/0 (socket says 172.21.15.119:35032) 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 -- 172.21.15.119:0/1524246564 learned_addr learned my addr 172.21.15.119:0/1524246564 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b0b08640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1b0a640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac0c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 -- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 msgr2=0x7f04ac0c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac0c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 -- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 msgr2=0x7f04ac0c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac0c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 -- 172.21.15.119:0/1524246564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0094d0 con 0x7f04ac071db0 2023-12-19T16:16:26.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b1309640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 0x7f04ac153370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f04a800e930 tx=0x7f04a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8009690 con 0x7f04ac071db0 2023-12-19T16:16:26.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a800ca00 con 0x7f04ac071db0 2023-12-19T16:16:26.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800cd70 con 0x7f04ac071db0 2023-12-19T16:16:26.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac0c6a10 con 0x7f04ac071db0 2023-12-19T16:16:26.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.065+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac0c7210 con 0x7f04ac071db0 2023-12-19T16:16:26.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.069+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac04e000 con 0x7f04ac071db0 2023-12-19T16:16:26.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.069+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f04a8013470 con 0x7f04ac071db0 2023-12-19T16:16:26.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.069+0000 7f04a1ffb640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0490065a60 0x7f0490067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.069+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f04a8083810 con 0x7f04ac071db0 2023-12-19T16:16:26.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.069+0000 7f04b0b08640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0490065a60 0x7f0490067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.069+0000 7f04b0b08640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0490065a60 0x7f0490067f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f049c0ae000 tx=0x7f049c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.073+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f04a8050e90 con 0x7f04ac071db0 2023-12-19T16:16:26.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.221+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f04ac0ceb50 con 0x7f04ac071db0 2023-12-19T16:16:26.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.221+0000 7f04a1ffb640 1 -- 172.21.15.119:0/1524246564 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f04a80544b0 con 0x7f04ac071db0 2023-12-19T16:16:26.230 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:26.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0490065a60 msgr2=0x7f0490067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0490065a60 0x7f0490067f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f049c0ae000 tx=0x7f049c0a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:26.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 msgr2=0x7f04ac153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 0x7f04ac153370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f04a800e930 tx=0x7f04a800edf0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 shutdown_connections 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0490065a60 0x7f0490067f20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04ac159fb0 0x7f04ac0c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04ac0ca410 0x7f04ac0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 --2- 172.21.15.119:0/1524246564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04ac071db0 0x7f04ac153370 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 >> 172.21.15.119:0/1524246564 conn(0x7f04ac06a2a0 msgr2=0x7f04ac15c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 shutdown_connections 2023-12-19T16:16:26.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.225+0000 7f04b356d640 1 -- 172.21.15.119:0/1524246564 wait complete. 2023-12-19T16:16:26.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:26.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.381+0000 7f8725b98640 1 Processor -- start 2023-12-19T16:16:26.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.381+0000 7f8725b98640 1 -- start start 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f8725b98640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87200cb180 0x7f8720070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f8725b98640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f872015c800 0x7f87200ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f8725b98640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8720070b80 con 0x7f8720158c20 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f8725b98640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8720070e60 con 0x7f872015c800 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f8725b98640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8720071140 con 0x7f87200cb180 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871f7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8720158c20 0x7f87200caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55410/0 (socket says 172.21.15.119:55410) 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871f7fe640 1 -- 172.21.15.119:0/1788594823 learned_addr learned my addr 172.21.15.119:0/1788594823 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871ffff640 1 --2- 172.21.15.119:0/1788594823 >> v2:172.21.15.119:3300/0 conn(0x7f872015c800 0x7f87200ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f8717fff640 1 --2- 172.21.15.119:0/1788594823 >> v2:172.21.15.143:3300/0 conn(0x7f87200cb180 0x7f8720070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871ffff640 1 -- 172.21.15.119:0/1788594823 >> v2:172.21.15.143:3300/0 conn(0x7f87200cb180 msgr2=0x7f8720070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871ffff640 1 --2- 172.21.15.119:0/1788594823 >> v2:172.21.15.143:3300/0 conn(0x7f87200cb180 0x7f8720070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871ffff640 1 -- 172.21.15.119:0/1788594823 >> v1:172.21.15.119:6789/0 conn(0x7f8720158c20 legacy=0x7f87200caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871ffff640 1 -- 172.21.15.119:0/1788594823 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720071420 con 0x7f872015c800 2023-12-19T16:16:26.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.385+0000 7f871effd640 1 -- 172.21.15.119:0/1788594823 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059917618 0 0) 0x7f8720070b80 con 0x7f8720158c20 2023-12-19T16:16:26.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f871ffff640 1 --2- 172.21.15.119:0/1788594823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872015c800 0x7f87200ccc10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f87200cbc00 tx=0x7f871801d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5678023ee7d84281 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f871effd640 1 -- 172.21.15.119:0/1788594823 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180a5930 con 0x7f872015c800 2023-12-19T16:16:26.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f871effd640 1 -- 172.21.15.119:0/1788594823 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87180a5a90 con 0x7f872015c800 2023-12-19T16:16:26.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f871effd640 1 -- 172.21.15.119:0/1788594823 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180a5e20 con 0x7f872015c800 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 -- 172.21.15.119:0/1788594823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872015c800 msgr2=0x7f87200ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 --2- 172.21.15.119:0/1788594823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872015c800 0x7f87200ccc10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f87200cbc00 tx=0x7f871801d2b0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 -- 172.21.15.119:0/1788594823 shutdown_connections 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 --2- 172.21.15.119:0/1788594823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f872015c800 0x7f87200ccc10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 --2- 172.21.15.119:0/1788594823 >> v2:172.21.15.143:3300/0 conn(0x7f87200cb180 0x7f8720070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 -- 172.21.15.119:0/1788594823 >> 172.21.15.119:0/1788594823 conn(0x7f872006a3e0 msgr2=0x7f87200afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 -- 172.21.15.119:0/1788594823 shutdown_connections 2023-12-19T16:16:26.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 -- 172.21.15.119:0/1788594823 wait complete. 2023-12-19T16:16:26.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 Processor -- start 2023-12-19T16:16:26.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.389+0000 7f8725b98640 1 -- start start 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87200cb180 0x7f8720152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 0x7f87201440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f872015c800 0x7f872014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720144610 con 0x7f8720158c20 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872014df30 con 0x7f872015c800 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200c69c0 con 0x7f87200cb180 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 0x7f87201440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 0x7f87201440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35060/0 (socket says 172.21.15.119:35060) 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 -- 172.21.15.119:0/3667707140 learned_addr learned my addr 172.21.15.119:0/3667707140 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871f7fe640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87200cb180 0x7f8720152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871ffff640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f872015c800 0x7f872014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 -- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87200cb180 msgr2=0x7f8720152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87200cb180 0x7f8720152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 -- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f872015c800 msgr2=0x7f872014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f872015c800 0x7f872014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 -- 172.21.15.119:0/3667707140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718009a70 con 0x7f8720158c20 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871f7fe640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87200cb180 0x7f8720152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871ffff640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f872015c800 0x7f872014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8717fff640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 0x7f87201440d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f870800e900 tx=0x7f870800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708009690 con 0x7f8720158c20 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800ca00 con 0x7f8720158c20 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87200c8800 con 0x7f8720158c20 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800cd90 con 0x7f8720158c20 2023-12-19T16:16:26.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87200c6c60 con 0x7f8720158c20 2023-12-19T16:16:26.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87200735b0 con 0x7f8720158c20 2023-12-19T16:16:26.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.393+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8708013470 con 0x7f8720158c20 2023-12-19T16:16:26.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.397+0000 7f871cff9640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8700065a60 0x7f8700067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.397+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8708083830 con 0x7f8720158c20 2023-12-19T16:16:26.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.397+0000 7f871f7fe640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8700065a60 0x7f8700067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.397+0000 7f871f7fe640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8700065a60 0x7f8700067f20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8710000f70 tx=0x7f8710009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.401+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8708050dd0 con 0x7f8720158c20 2023-12-19T16:16:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.565+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87200ce920 con 0x7f8720158c20 2023-12-19T16:16:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.565+0000 7f871cff9640 1 -- 172.21.15.119:0/3667707140 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f87080543f0 con 0x7f8720158c20 2023-12-19T16:16:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8700065a60 msgr2=0x7f8700067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8700065a60 0x7f8700067f20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8710000f70 tx=0x7f8710009040 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 msgr2=0x7f87201440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 0x7f87201440d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f870800e900 tx=0x7f870800edc0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 shutdown_connections 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8700065a60 0x7f8700067f20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f872015c800 0x7f872014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8720158c20 0x7f87201440d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 --2- 172.21.15.119:0/3667707140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87200cb180 0x7f8720152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 >> 172.21.15.119:0/3667707140 conn(0x7f872006a3e0 msgr2=0x7f87200c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 shutdown_connections 2023-12-19T16:16:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.569+0000 7f8725b98640 1 -- 172.21.15.119:0/3667707140 wait complete. 2023-12-19T16:16:26.593 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:16:26.593 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:26.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 Processor -- start 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 -- start start 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb8a4157080 0x7fb8a40ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb8a40cd730 0x7fb8a40ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40d1320 con 0x7fb8a40d05b0 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40d1130 con 0x7fb8a4157080 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8ab88c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a4157460 con 0x7fb8a40cd730 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9628640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb8a4157080 0x7fb8a40ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9e29640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb8a40d05b0 0x7fb8a40d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55418/0 (socket says 172.21.15.119:55418) 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9e29640 1 -- 172.21.15.119:0/3639206773 learned_addr learned my addr 172.21.15.119:0/3639206773 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a8e27640 1 --2- 172.21.15.119:0/3639206773 >> v2:172.21.15.143:3300/0 conn(0x7fb8a40cd730 0x7fb8a40ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9628640 1 -- 172.21.15.119:0/3639206773 >> v2:172.21.15.143:3300/0 conn(0x7fb8a40cd730 msgr2=0x7fb8a40ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9628640 1 --2- 172.21.15.119:0/3639206773 >> v2:172.21.15.143:3300/0 conn(0x7fb8a40cd730 0x7fb8a40ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9628640 1 -- 172.21.15.119:0/3639206773 >> v1:172.21.15.119:6789/0 conn(0x7fb8a40d05b0 legacy=0x7fb8a40d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a9628640 1 -- 172.21.15.119:0/3639206773 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40cc970 con 0x7fb8a4157080 2023-12-19T16:16:26.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.737+0000 7fb8a8e27640 1 --2- 172.21.15.119:0/3639206773 >> v2:172.21.15.143:3300/0 conn(0x7fb8a40cd730 0x7fb8a40ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8a9628640 1 --2- 172.21.15.119:0/3639206773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a4157080 0x7fb8a40ce210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00097c0 tx=0x7fb8a001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582b4ff3267017ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb89bfff640 1 -- 172.21.15.119:0/3639206773 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00ab610 con 0x7fb8a4157080 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb89bfff640 1 -- 172.21.15.119:0/3639206773 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a00ab770 con 0x7fb8a4157080 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb89bfff640 1 -- 172.21.15.119:0/3639206773 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00abb00 con 0x7fb8a4157080 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 -- 172.21.15.119:0/3639206773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a4157080 msgr2=0x7fb8a40ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/3639206773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a4157080 0x7fb8a40ce210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00097c0 tx=0x7fb8a001c410 comp rx=0 tx=0).stop 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 -- 172.21.15.119:0/3639206773 shutdown_connections 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/3639206773 >> v2:172.21.15.143:3300/0 conn(0x7fb8a40cd730 0x7fb8a40ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/3639206773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a4157080 0x7fb8a40ce210 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 -- 172.21.15.119:0/3639206773 >> 172.21.15.119:0/3639206773 conn(0x7fb8a4069ca0 msgr2=0x7fb8a406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 -- 172.21.15.119:0/3639206773 shutdown_connections 2023-12-19T16:16:26.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.741+0000 7fb8ab88c640 1 -- 172.21.15.119:0/3639206773 wait complete. 2023-12-19T16:16:26.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 Processor -- start 2023-12-19T16:16:26.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 -- start start 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 0x7fb8a40c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8a40d05b0 0x7fb8a40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8a4157080 0x7fb8a40c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40b64d0 con 0x7fb8a40cd730 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c8250 con 0x7fb8a40d05b0 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40b5190 con 0x7fb8a4157080 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 0x7fb8a40c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 0x7fb8a40c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35066/0 (socket says 172.21.15.119:35066) 2023-12-19T16:16:26.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 -- 172.21.15.119:0/1960507219 learned_addr learned my addr 172.21.15.119:0/1960507219 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a8e27640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8a40d05b0 0x7fb8a40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9e29640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8a4157080 0x7fb8a40c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 -- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8a4157080 msgr2=0x7fb8a40c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8a4157080 0x7fb8a40c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 -- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8a40d05b0 msgr2=0x7fb8a40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8a40d05b0 0x7fb8a40b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 -- 172.21.15.119:0/1960507219 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009420 con 0x7fb8a40cd730 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9e29640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8a4157080 0x7fb8a40c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8a9628640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 0x7fb8a40c4150 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ad040 tx=0x7fb8a001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00b5810 con 0x7fb8a40cd730 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a00b59b0 con 0x7fb8a40cd730 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00b5d60 con 0x7fb8a40cd730 2023-12-19T16:16:26.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40b5470 con 0x7fb8a40cd730 2023-12-19T16:16:26.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.745+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40b60f0 con 0x7fb8a40cd730 2023-12-19T16:16:26.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.749+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a404e000 con 0x7fb8a40cd730 2023-12-19T16:16:26.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.749+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8a00bf410 con 0x7fb8a40cd730 2023-12-19T16:16:26.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.749+0000 7fb899ffb640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb888065a60 0x7fb888067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.749+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb8a011dfa0 con 0x7fb8a40cd730 2023-12-19T16:16:26.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.749+0000 7fb8a8e27640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb888065a60 0x7fb888067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.749+0000 7fb8a8e27640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb888065a60 0x7fb888067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40c92d0 tx=0x7fb894008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.753+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb8a00eb560 con 0x7fb8a40cd730 2023-12-19T16:16:26.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a40ceb40 con 0x7fb8a40cd730 2023-12-19T16:16:26.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb899ffb640 1 -- 172.21.15.119:0/1960507219 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7fb8a00eeb80 con 0x7fb8a40cd730 2023-12-19T16:16:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:26.912 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:26.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb888065a60 msgr2=0x7fb888067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb888065a60 0x7fb888067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40c92d0 tx=0x7fb894008040 comp rx=0 tx=0).stop 2023-12-19T16:16:26.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 msgr2=0x7fb8a40c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 0x7fb8a40c4150 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ad040 tx=0x7fb8a001ac50 comp rx=0 tx=0).stop 2023-12-19T16:16:26.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 shutdown_connections 2023-12-19T16:16:26.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb888065a60 0x7fb888067f20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8a40d05b0 0x7fb8a40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8a4157080 0x7fb8a40c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 --2- 172.21.15.119:0/1960507219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8a40cd730 0x7fb8a40c4150 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 >> 172.21.15.119:0/1960507219 conn(0x7fb8a4069ca0 msgr2=0x7fb8a4160270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.905+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 shutdown_connections 2023-12-19T16:16:26.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:26.909+0000 7fb8ab88c640 1 -- 172.21.15.119:0/1960507219 wait complete. 2023-12-19T16:16:26.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:26.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:27.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 Processor -- start 2023-12-19T16:16:27.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 -- start start 2023-12-19T16:16:27.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8101598d0 0x7fa8100ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8100ce8d0 0x7fa810070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8100c9730 con 0x7fa810153020 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100ced60 con 0x7fa8101598d0 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa818066640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c8e00 con 0x7fa8100ce8d0 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815e02640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa810153020 0x7fa8100c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55422/0 (socket says 172.21.15.119:55422) 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815e02640 1 -- 172.21.15.119:0/406229941 learned_addr learned my addr 172.21.15.119:0/406229941 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815601640 1 --2- 172.21.15.119:0/406229941 >> v2:172.21.15.119:3300/0 conn(0x7fa8101598d0 0x7fa8100ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa816603640 1 --2- 172.21.15.119:0/406229941 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8100ce8d0 0x7fa810070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa814e00640 1 -- 172.21.15.119:0/406229941 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532625177 0 0) 0x7fa8100c9730 con 0x7fa810153020 2023-12-19T16:16:27.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa814e00640 1 -- 172.21.15.119:0/406229941 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7fc003450 con 0x7fa810153020 2023-12-19T16:16:27.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815601640 1 -- 172.21.15.119:0/406229941 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8100ce8d0 msgr2=0x7fa810070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:27.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815601640 1 --2- 172.21.15.119:0/406229941 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8100ce8d0 0x7fa810070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815601640 1 -- 172.21.15.119:0/406229941 >> v1:172.21.15.119:6789/0 conn(0x7fa810153020 legacy=0x7fa8100c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.069+0000 7fa815601640 1 -- 172.21.15.119:0/406229941 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100c90e0 con 0x7fa8101598d0 2023-12-19T16:16:27.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa815601640 1 --2- 172.21.15.119:0/406229941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8101598d0 0x7fa8100ce390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa8000097c0 tx=0x7fa80001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea29566cd76bc1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa814e00640 1 -- 172.21.15.119:0/406229941 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000ab600 con 0x7fa8101598d0 2023-12-19T16:16:27.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa814e00640 1 -- 172.21.15.119:0/406229941 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8000a7050 con 0x7fa8101598d0 2023-12-19T16:16:27.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa814e00640 1 -- 172.21.15.119:0/406229941 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000ab960 con 0x7fa8101598d0 2023-12-19T16:16:27.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 -- 172.21.15.119:0/406229941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8101598d0 msgr2=0x7fa8100ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 --2- 172.21.15.119:0/406229941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8101598d0 0x7fa8100ce390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa8000097c0 tx=0x7fa80001c330 comp rx=0 tx=0).stop 2023-12-19T16:16:27.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 -- 172.21.15.119:0/406229941 shutdown_connections 2023-12-19T16:16:27.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 --2- 172.21.15.119:0/406229941 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8100ce8d0 0x7fa810070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 --2- 172.21.15.119:0/406229941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8101598d0 0x7fa8100ce390 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 -- 172.21.15.119:0/406229941 >> 172.21.15.119:0/406229941 conn(0x7fa81006a2a0 msgr2=0x7fa8100aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 -- 172.21.15.119:0/406229941 shutdown_connections 2023-12-19T16:16:27.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.073+0000 7fa818066640 1 -- 172.21.15.119:0/406229941 wait complete. 2023-12-19T16:16:27.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 Processor -- start 2023-12-19T16:16:27.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 -- start start 2023-12-19T16:16:27.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 0x7fa810151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa810153020 0x7fa8101537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8101598d0 0x7fa81014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810153ce0 con 0x7fa8100ce8d0 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810153ed0 con 0x7fa810153020 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101541b0 con 0x7fa8101598d0 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 0x7fa810151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 0x7fa810151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35084/0 (socket says 172.21.15.119:35084) 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 -- 172.21.15.119:0/1977708770 learned_addr learned my addr 172.21.15.119:0/1977708770 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa816603640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8101598d0 0x7fa81014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815601640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa810153020 0x7fa8101537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 -- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8101598d0 msgr2=0x7fa81014f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8101598d0 0x7fa81014f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 -- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa810153020 msgr2=0x7fa8101537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa810153020 0x7fa8101537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 -- 172.21.15.119:0/1977708770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800009420 con 0x7fa8100ce8d0 2023-12-19T16:16:27.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa815e02640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 0x7fa810151c70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c450 tx=0x7fa80c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c005cf0 con 0x7fa8100ce8d0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c005e50 con 0x7fa8100ce8d0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c007290 con 0x7fa8100ce8d0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa810154490 con 0x7fa8100ce8d0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.077+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa810154a50 con 0x7fa8100ce8d0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.081+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81004e000 con 0x7fa8100ce8d0 2023-12-19T16:16:27.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.081+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa80c0073f0 con 0x7fa8100ce8d0 2023-12-19T16:16:27.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.081+0000 7fa8067fc640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7f4065a60 0x7fa7f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.081+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa80c082c30 con 0x7fa8100ce8d0 2023-12-19T16:16:27.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.081+0000 7fa815601640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7f4065a60 0x7fa7f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.081+0000 7fa815601640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7f4065a60 0x7fa7f4067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8000ad000 tx=0x7fa8000a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.085+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa80c050140 con 0x7fa8100ce8d0 2023-12-19T16:16:27.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.233+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8100cc600 con 0x7fa8100ce8d0 2023-12-19T16:16:27.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa8067fc640 1 -- 172.21.15.119:0/1977708770 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa80c017070 con 0x7fa8100ce8d0 2023-12-19T16:16:27.242 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:27.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7f4065a60 msgr2=0x7fa7f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7f4065a60 0x7fa7f4067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8000ad000 tx=0x7fa8000a6000 comp rx=0 tx=0).stop 2023-12-19T16:16:27.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 msgr2=0x7fa810151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 0x7fa810151c70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c450 tx=0x7fa80c00c910 comp rx=0 tx=0).stop 2023-12-19T16:16:27.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 shutdown_connections 2023-12-19T16:16:27.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa7f4065a60 0x7fa7f4067f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa810153020 0x7fa8101537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8101598d0 0x7fa81014f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 --2- 172.21.15.119:0/1977708770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8100ce8d0 0x7fa810151c70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 >> 172.21.15.119:0/1977708770 conn(0x7fa81006a2a0 msgr2=0x7fa81015a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 shutdown_connections 2023-12-19T16:16:27.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.237+0000 7fa818066640 1 -- 172.21.15.119:0/1977708770 wait complete. 2023-12-19T16:16:27.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:27.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 Processor -- start 2023-12-19T16:16:27.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 -- start start 2023-12-19T16:16:27.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86f80ca410 0x7f86f8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f8070df0 con 0x7f86f8071db0 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f815aab0 con 0x7f86f80ca410 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86feb25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f815a4f0 con 0x7f86f8159fb0 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86fc8c1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86f80ca410 0x7f86f8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86fc8c1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86f80ca410 0x7f86f8159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35094/0 (socket says 172.21.15.119:35094) 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.397+0000 7f86fc8c1640 1 -- 172.21.15.119:0/2339234351 learned_addr learned my addr 172.21.15.119:0/2339234351 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86f7fff640 1 --2- 172.21.15.119:0/2339234351 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86fc8c1640 1 -- 172.21.15.119:0/2339234351 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 msgr2=0x7f86f8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86fc8c1640 1 --2- 172.21.15.119:0/2339234351 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86fc8c1640 1 -- 172.21.15.119:0/2339234351 >> v1:172.21.15.143:6789/0 conn(0x7f86f8071db0 legacy=0x7f86f80cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86fc8c1640 1 -- 172.21.15.119:0/2339234351 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f815a7d0 con 0x7f86f80ca410 2023-12-19T16:16:27.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86fc8c1640 1 --2- 172.21.15.119:0/2339234351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f8159a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009870 tx=0x7f86ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a33ea58e3ee07ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86f77fe640 1 -- 172.21.15.119:0/2339234351 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0aa670 con 0x7f86f80ca410 2023-12-19T16:16:27.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86f77fe640 1 -- 172.21.15.119:0/2339234351 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0aa7d0 con 0x7f86f80ca410 2023-12-19T16:16:27.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.401+0000 7f86f77fe640 1 -- 172.21.15.119:0/2339234351 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0aab60 con 0x7f86f80ca410 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- 172.21.15.119:0/2339234351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 msgr2=0x7f86f8159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 --2- 172.21.15.119:0/2339234351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f8159a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009870 tx=0x7f86ec01c510 comp rx=0 tx=0).stop 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- 172.21.15.119:0/2339234351 shutdown_connections 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 --2- 172.21.15.119:0/2339234351 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 --2- 172.21.15.119:0/2339234351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f8159a70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- 172.21.15.119:0/2339234351 >> 172.21.15.119:0/2339234351 conn(0x7f86f806a2a0 msgr2=0x7f86f80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- 172.21.15.119:0/2339234351 shutdown_connections 2023-12-19T16:16:27.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- 172.21.15.119:0/2339234351 wait complete. 2023-12-19T16:16:27.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 Processor -- start 2023-12-19T16:16:27.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- start start 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f8071db0 0x7f86f8150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8150fa0 con 0x7f86f80ca410 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80ab9d0 con 0x7f86f8071db0 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86feb25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80abcb0 con 0x7f86f8159fb0 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f81586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35096/0 (socket says 172.21.15.119:35096) 2023-12-19T16:16:27.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 -- 172.21.15.119:0/241694829 learned_addr learned my addr 172.21.15.119:0/241694829 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:27.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86fd0c2640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86fc8c1640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f8071db0 0x7f86f8150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 -- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 msgr2=0x7f86f8158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 -- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f8071db0 msgr2=0x7f86f8150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f8071db0 0x7f86f8150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.405+0000 7f86f7fff640 1 -- 172.21.15.119:0/241694829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0094d0 con 0x7f86f80ca410 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f7fff640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f81586e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f86e400e930 tx=0x7f86e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4009690 con 0x7f86f80ca410 2023-12-19T16:16:27.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e400ca00 con 0x7f86f80ca410 2023-12-19T16:16:27.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f80abf90 con 0x7f86f80ca410 2023-12-19T16:16:27.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400cd70 con 0x7f86f80ca410 2023-12-19T16:16:27.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f80ac550 con 0x7f86f80ca410 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f804e000 con 0x7f86f80ca410 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86e4013470 con 0x7f86f80ca410 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f57fa640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86dc065a60 0x7f86dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f86e4083790 con 0x7f86f80ca410 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86fc8c1640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86dc065a60 0x7f86dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.409+0000 7f86fc8c1640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86dc065a60 0x7f86dc067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0ae000 tx=0x7f86ec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.413+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86e4050e90 con 0x7f86f80ca410 2023-12-19T16:16:27.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.565+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86f80cecf0 con 0x7f86f80ca410 2023-12-19T16:16:27.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.565+0000 7f86f57fa640 1 -- 172.21.15.119:0/241694829 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86e40544b0 con 0x7f86f80ca410 2023-12-19T16:16:27.572 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:27.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86dc065a60 msgr2=0x7f86dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86dc065a60 0x7f86dc067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0ae000 tx=0x7f86ec0a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:27.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 msgr2=0x7f86f81586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f81586e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f86e400e930 tx=0x7f86e400edf0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 shutdown_connections 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86dc065a60 0x7f86dc067f20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f8159fb0 0x7f86f8158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80ca410 0x7f86f81586e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 --2- 172.21.15.119:0/241694829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f8071db0 0x7f86f8150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 >> 172.21.15.119:0/241694829 conn(0x7f86f806a2a0 msgr2=0x7f86f80cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 shutdown_connections 2023-12-19T16:16:27.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.569+0000 7f86feb25640 1 -- 172.21.15.119:0/241694829 wait complete. 2023-12-19T16:16:27.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:27.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.725+0000 7f2b8c98f640 1 Processor -- start 2023-12-19T16:16:27.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b8c98f640 1 -- start start 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b8c98f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2b88071870 0x7f2b88071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b8c98f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880cbff0 0x7f2b880cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b8c98f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b880cc930 con 0x7f2b880ca410 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b8c98f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8815aab0 con 0x7f2b88071870 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b8c98f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88070df0 con 0x7f2b880cbff0 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2b88071870 0x7f2b88071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2b88071870 0x7f2b88071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35108/0 (socket says 172.21.15.119:35108) 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 -- 172.21.15.119:0/664400719 learned_addr learned my addr 172.21.15.119:0/664400719 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b86d9d640 1 --2- 172.21.15.119:0/664400719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880cbff0 0x7f2b880cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 -- 172.21.15.119:0/664400719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880cbff0 msgr2=0x7f2b880cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:27.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 --2- 172.21.15.119:0/664400719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880cbff0 0x7f2b880cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 -- 172.21.15.119:0/664400719 >> v1:172.21.15.143:6789/0 conn(0x7f2b880ca410 legacy=0x7f2b88159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.729+0000 7f2b7ffff640 1 -- 172.21.15.119:0/664400719 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8815a4f0 con 0x7f2b88071870 2023-12-19T16:16:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b7ffff640 1 --2- 172.21.15.119:0/664400719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b88071d00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000bb10 tx=0x7f2b7001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed645898f85bacde server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b85d9b640 1 -- 172.21.15.119:0/664400719 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700a7cb0 con 0x7f2b88071870 2023-12-19T16:16:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b85d9b640 1 -- 172.21.15.119:0/664400719 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700a7e10 con 0x7f2b88071870 2023-12-19T16:16:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b85d9b640 1 -- 172.21.15.119:0/664400719 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700af660 con 0x7f2b88071870 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 -- 172.21.15.119:0/664400719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 msgr2=0x7f2b88071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/664400719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b88071d00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000bb10 tx=0x7f2b7001ebe0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 -- 172.21.15.119:0/664400719 shutdown_connections 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/664400719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880cbff0 0x7f2b880cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/664400719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b88071d00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 -- 172.21.15.119:0/664400719 >> 172.21.15.119:0/664400719 conn(0x7f2b8806a2a0 msgr2=0x7f2b880aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 -- 172.21.15.119:0/664400719 shutdown_connections 2023-12-19T16:16:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 -- 172.21.15.119:0/664400719 wait complete. 2023-12-19T16:16:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 Processor -- start 2023-12-19T16:16:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.733+0000 7f2b8c98f640 1 -- start start 2023-12-19T16:16:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b881f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880ca410 0x7f2b8814d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b880cbff0 0x7f2b880cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8814e460 con 0x7f2b88071870 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88136080 con 0x7f2b880cbff0 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8814dbc0 con 0x7f2b880ca410 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b881f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b881f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35120/0 (socket says 172.21.15.119:35120) 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 -- 172.21.15.119:0/1697700751 learned_addr learned my addr 172.21.15.119:0/1697700751 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b7ffff640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880ca410 0x7f2b8814d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b86d9d640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b880cbff0 0x7f2b880cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 -- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880ca410 msgr2=0x7f2b8814d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880ca410 0x7f2b8814d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 -- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b880cbff0 msgr2=0x7f2b880cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b880cbff0 0x7f2b880cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 -- 172.21.15.119:0/1697700751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7000b770 con 0x7f2b88071870 2023-12-19T16:16:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8659c640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b881f46a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c450 tx=0x7f2b7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780052d0 con 0x7f2b88071870 2023-12-19T16:16:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78005450 con 0x7f2b88071870 2023-12-19T16:16:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78012870 con 0x7f2b88071870 2023-12-19T16:16:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8814dea0 con 0x7f2b88071870 2023-12-19T16:16:27.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8814d720 con 0x7f2b88071870 2023-12-19T16:16:27.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.737+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b88070980 con 0x7f2b88071870 2023-12-19T16:16:27.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.741+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b780129d0 con 0x7f2b88071870 2023-12-19T16:16:27.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.741+0000 7f2b7effd640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b68065a60 0x7f2b68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.741+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2b780830d0 con 0x7f2b88071870 2023-12-19T16:16:27.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.741+0000 7f2b7ffff640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b68065a60 0x7f2b68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.741+0000 7f2b7ffff640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b68065a60 0x7f2b68067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b1000 tx=0x7f2b70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.745+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b780505e0 con 0x7f2b88071870 2023-12-19T16:16:27.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b8814d970 con 0x7f2b88071870 2023-12-19T16:16:27.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b7effd640 1 -- 172.21.15.119:0/1697700751 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b78053c00 con 0x7f2b88071870 2023-12-19T16:16:27.899 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b68065a60 msgr2=0x7f2b68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b68065a60 0x7f2b68067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b1000 tx=0x7f2b70008040 comp rx=0 tx=0).stop 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 msgr2=0x7f2b881f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b881f46a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c450 tx=0x7f2b7800c910 comp rx=0 tx=0).stop 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 shutdown_connections 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b68065a60 0x7f2b68067f20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b880cbff0 0x7f2b880cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b880ca410 0x7f2b8814d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 --2- 172.21.15.119:0/1697700751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b88071870 0x7f2b881f46a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 >> 172.21.15.119:0/1697700751 conn(0x7f2b8806a2a0 msgr2=0x7f2b880cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.893+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 shutdown_connections 2023-12-19T16:16:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:27.897+0000 7f2b8c98f640 1 -- 172.21.15.119:0/1697700751 wait complete. 2023-12-19T16:16:27.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:28.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.053+0000 7f14f359e640 1 Processor -- start 2023-12-19T16:16:28.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.053+0000 7f14f359e640 1 -- start start 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f359e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14f40b0460 0x7f14f415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f359e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14f406fc80 0x7f14f4070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f359e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f4070650 con 0x7f14f40b0460 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f359e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f415e000 con 0x7f14f406fc80 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f415e5c0 con 0x7f14f415aa10 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14f40b0460 0x7f14f415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14f40b0460 0x7f14f415ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35124/0 (socket says 172.21.15.119:35124) 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 -- 172.21.15.119:0/842454520 learned_addr learned my addr 172.21.15.119:0/842454520 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f2d9d640 1 --2- 172.21.15.119:0/842454520 >> v2:172.21.15.143:3300/0 conn(0x7f14f406fc80 0x7f14f4070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14ebfff640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 -- 172.21.15.119:0/842454520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 msgr2=0x7f14f415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 -- 172.21.15.119:0/842454520 >> v2:172.21.15.143:3300/0 conn(0x7f14f406fc80 msgr2=0x7f14f4070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 --2- 172.21.15.119:0/842454520 >> v2:172.21.15.143:3300/0 conn(0x7f14f406fc80 0x7f14f4070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f259c640 1 -- 172.21.15.119:0/842454520 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f415b4d0 con 0x7f14f40b0460 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14ebfff640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:28.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.057+0000 7f14f2d9d640 1 --2- 172.21.15.119:0/842454520 >> v2:172.21.15.143:3300/0 conn(0x7f14f406fc80 0x7f14f4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:28.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f259c640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f415ea50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f14f40c1c90 tx=0x7f14e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e70eb23f4ffa80 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f1d9b640 1 -- 172.21.15.119:0/842454520 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40ab600 con 0x7f14f40b0460 2023-12-19T16:16:28.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f1d9b640 1 -- 172.21.15.119:0/842454520 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40ab760 con 0x7f14f40b0460 2023-12-19T16:16:28.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f1d9b640 1 -- 172.21.15.119:0/842454520 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40abaf0 con 0x7f14f40b0460 2023-12-19T16:16:28.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 -- 172.21.15.119:0/842454520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 msgr2=0x7f14f415ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f415ea50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f14f40c1c90 tx=0x7f14e401c440 comp rx=0 tx=0).stop 2023-12-19T16:16:28.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 -- 172.21.15.119:0/842454520 shutdown_connections 2023-12-19T16:16:28.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 --2- 172.21.15.119:0/842454520 >> v2:172.21.15.143:3300/0 conn(0x7f14f406fc80 0x7f14f4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 --2- 172.21.15.119:0/842454520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f415ea50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 -- 172.21.15.119:0/842454520 >> 172.21.15.119:0/842454520 conn(0x7f14f406a2a0 msgr2=0x7f14f40cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 -- 172.21.15.119:0/842454520 shutdown_connections 2023-12-19T16:16:28.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 -- 172.21.15.119:0/842454520 wait complete. 2023-12-19T16:16:28.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 Processor -- start 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.061+0000 7f14f359e640 1 -- start start 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f406fc80 0x7f14f414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f40cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f40cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f414e830 con 0x7f14f40b0460 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40cc7c0 con 0x7f14f406fc80 2023-12-19T16:16:28.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f414ecc0 con 0x7f14f415aa10 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f40cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f40cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35128/0 (socket says 172.21.15.119:35128) 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 -- 172.21.15.119:0/589025790 learned_addr learned my addr 172.21.15.119:0/589025790 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f259c640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f406fc80 0x7f14f414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f2d9d640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f40cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 -- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 msgr2=0x7f14f40cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f40cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 -- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f406fc80 msgr2=0x7f14f414e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f406fc80 0x7f14f414e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 -- 172.21.15.119:0/589025790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40094d0 con 0x7f14f40b0460 2023-12-19T16:16:28.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14ebfff640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f40cd3b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00d830 tx=0x7f14dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0096c0 con 0x7f14f40b0460 2023-12-19T16:16:28.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc009820 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc009bd0 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f40afe60 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f40cc170 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f404e850 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.065+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14dc014410 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.069+0000 7f14eaffd640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14d4065a90 0x7f14d4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.069+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f14dc083d30 con 0x7f14f40b0460 2023-12-19T16:16:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.069+0000 7f14f259c640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14d4065a90 0x7f14d4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.069+0000 7f14f259c640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14d4065a90 0x7f14d4067f50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f14e40af000 tx=0x7f14e40b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.073+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14dc051380 con 0x7f14f40b0460 2023-12-19T16:16:28.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.217+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f14f40cb770 con 0x7f14f40b0460 2023-12-19T16:16:28.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14eaffd640 1 -- 172.21.15.119:0/589025790 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f14dc0549a0 con 0x7f14f40b0460 2023-12-19T16:16:28.225 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:28.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14d4065a90 msgr2=0x7f14d4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14d4065a90 0x7f14d4067f50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f14e40af000 tx=0x7f14e40b6040 comp rx=0 tx=0).stop 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 msgr2=0x7f14f40cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f40cd3b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00d830 tx=0x7f14dc00dcf0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 shutdown_connections 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14d4065a90 0x7f14d4067f50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f415aa10 0x7f14f40cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14f40b0460 0x7f14f40cd3b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 --2- 172.21.15.119:0/589025790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f406fc80 0x7f14f414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 >> 172.21.15.119:0/589025790 conn(0x7f14f406a2a0 msgr2=0x7f14f4159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 shutdown_connections 2023-12-19T16:16:28.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.221+0000 7f14f359e640 1 -- 172.21.15.119:0/589025790 wait complete. 2023-12-19T16:16:28.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:28.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.377+0000 7f8c42ae5640 1 Processor -- start 2023-12-19T16:16:28.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.377+0000 7f8c42ae5640 1 -- start start 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c42ae5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8c3c15ca40 0x7f8c3c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c42ae5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 0x7f8c3c1668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c42ae5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0d11c0 con 0x7f8c3c0ce3f0 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c42ae5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d0310 con 0x7f8c3c15ca40 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c42ae5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d05b0 con 0x7f8c3c0cf7e0 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8c3c0ce3f0 0x7f8c3c0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55438/0 (socket says 172.21.15.119:55438) 2023-12-19T16:16:28.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 -- 172.21.15.119:0/1143288021 learned_addr learned my addr 172.21.15.119:0/1143288021 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c41082640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 0x7f8c3c1668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c40881640 1 --2- 172.21.15.119:0/1143288021 >> v2:172.21.15.143:3300/0 conn(0x7f8c3c15ca40 0x7f8c3c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259784031 0 0) 0x7f8c3c0d11c0 con 0x7f8c3c0ce3f0 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c24003530 con 0x7f8c3c0ce3f0 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420084687 0 0) 0x7f8c24003530 con 0x7f8c3c0ce3f0 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 msgr2=0x7f8c3c1668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 0x7f8c3c1668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 >> v2:172.21.15.143:3300/0 conn(0x7f8c3c15ca40 msgr2=0x7f8c3c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 --2- 172.21.15.119:0/1143288021 >> v2:172.21.15.143:3300/0 conn(0x7f8c3c15ca40 0x7f8c3c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0d0890 con 0x7f8c3c0ce3f0 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f8c2c001800 con 0x7f8c3c0ce3f0 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c40881640 1 --2- 172.21.15.119:0/1143288021 >> v2:172.21.15.143:3300/0 conn(0x7f8c3c15ca40 0x7f8c3c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 >> v1:172.21.15.119:6789/0 conn(0x7f8c3c0ce3f0 legacy=0x7f8c3c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c24003980 0x7f8c24003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c240047d0 0x7f8c24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 0x7f8c24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d0310 con 0x7f8c240047d0 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d05b0 con 0x7f8c24003980 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2400b990 con 0x7f8c3c0cf7e0 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c240047d0 0x7f8c24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c40881640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c24003980 0x7f8c24003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c41082640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 0x7f8c24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 -- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 msgr2=0x7f8c24005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c3c0cf7e0 0x7f8c24005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 -- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c24003980 msgr2=0x7f8c24003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c24003980 0x7f8c24003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.381+0000 7f8c33fff640 1 -- 172.21.15.119:0/1143288021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24003530 con 0x7f8c240047d0 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c33fff640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c240047d0 0x7f8c24004c50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00c240 tx=0x7f8c2c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200ca9e5be9a3103 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0a8d00 con 0x7f8c240047d0 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0a8e60 con 0x7f8c240047d0 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c337fe640 1 -- 172.21.15.119:0/1143288021 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0072f0 con 0x7f8c240047d0 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1143288021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c240047d0 msgr2=0x7f8c24004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1143288021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c240047d0 0x7f8c24004c50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00c240 tx=0x7f8c2c01f3d0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c41082640 1 -- 172.21.15.119:0/1143288021 reap_dead start 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1143288021 shutdown_connections 2023-12-19T16:16:28.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1143288021 >> 172.21.15.119:0/1143288021 conn(0x7f8c3c089fb0 msgr2=0x7f8c3c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1143288021 shutdown_connections 2023-12-19T16:16:28.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.385+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1143288021 wait complete. 2023-12-19T16:16:28.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 Processor -- start 2023-12-19T16:16:28.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- start start 2023-12-19T16:16:28.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c240047d0 0x7f8c3c1f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c3c15f740 0x7f8c3c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 0x7f8c3c0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c15d370 con 0x7f8c3c15fba0 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c99e0 con 0x7f8c3c15f740 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c9cc0 con 0x7f8c240047d0 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 0x7f8c3c0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 0x7f8c3c0b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35142/0 (socket says 172.21.15.119:35142) 2023-12-19T16:16:28.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 -- 172.21.15.119:0/1545524608 learned_addr learned my addr 172.21.15.119:0/1545524608 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c40881640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c240047d0 0x7f8c3c1f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c33fff640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c3c15f740 0x7f8c3c0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 -- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c240047d0 msgr2=0x7f8c3c1f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c240047d0 0x7f8c3c1f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 -- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c3c15f740 msgr2=0x7f8c3c0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c3c15f740 0x7f8c3c0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 -- 172.21.15.119:0/1545524608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0c9fa0 con 0x7f8c3c15fba0 2023-12-19T16:16:28.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c41082640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 0x7f8c3c0b1860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0c6000 tx=0x7f8c340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400e070 con 0x7f8c3c15fba0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34011e10 con 0x7f8c3c15fba0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c0ca280 con 0x7f8c3c15fba0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340039a0 con 0x7f8c3c15fba0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c0ca840 con 0x7f8c3c15fba0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.389+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c0caa60 con 0x7f8c3c15fba0 2023-12-19T16:16:28.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.393+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c34003b00 con 0x7f8c3c15fba0 2023-12-19T16:16:28.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.393+0000 7f8c317fa640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c28065a60 0x7f8c28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.393+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8c34083af0 con 0x7f8c3c15fba0 2023-12-19T16:16:28.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.393+0000 7f8c40881640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c28065a60 0x7f8c28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.393+0000 7f8c40881640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c28065a60 0x7f8c28067f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009380 tx=0x7f8c38006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.397+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8c34051150 con 0x7f8c3c15fba0 2023-12-19T16:16:28.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.561+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8c3c04e000 con 0x7f8c3c15fba0 2023-12-19T16:16:28.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.561+0000 7f8c317fa640 1 -- 172.21.15.119:0/1545524608 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8c34054770 con 0x7f8c3c15fba0 2023-12-19T16:16:28.568 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:16:28.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c28065a60 msgr2=0x7f8c28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c28065a60 0x7f8c28067f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009380 tx=0x7f8c38006f90 comp rx=0 tx=0).stop 2023-12-19T16:16:28.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 msgr2=0x7f8c3c0b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 0x7f8c3c0b1860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0c6000 tx=0x7f8c340115a0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 shutdown_connections 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c28065a60 0x7f8c28067f20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8c3c15f740 0x7f8c3c0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c3c15fba0 0x7f8c3c0b1860 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 --2- 172.21.15.119:0/1545524608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8c240047d0 0x7f8c3c1f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 >> 172.21.15.119:0/1545524608 conn(0x7f8c3c089fb0 msgr2=0x7f8c3c0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 shutdown_connections 2023-12-19T16:16:28.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.565+0000 7f8c42ae5640 1 -- 172.21.15.119:0/1545524608 wait complete. 2023-12-19T16:16:28.589 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi143.front.sepia.ceph.com... 2023-12-19T16:16:28.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:28.590 DEBUG:teuthology.orchestra.run.smithi143:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:28.616 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:28.616 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:16:28.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:28.616 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T16:16:28.672 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T16:16:28.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:28.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb6a66640 1 Processor -- start 2023-12-19T16:16:28.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb6a66640 1 -- start start 2023-12-19T16:16:28.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb6a66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb01570c0 0x7f8cb006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb6a66640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb00c9460 con 0x7f8cb006c320 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb6a66640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb01574a0 con 0x7f8cb00ca000 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb6a66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb006c7a0 con 0x7f8cb01570c0 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca7fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8cb006c320 0x7f8cb00c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55452/0 (socket says 172.21.15.119:55452) 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca7fff640 1 -- 172.21.15.119:0/367535247 learned_addr learned my addr 172.21.15.119:0/367535247 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb4802640 1 --2- 172.21.15.119:0/367535247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb01570c0 0x7f8cb006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400213994 0 0) 0x7f8cb00c9460 con 0x7f8cb006c320 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c98003530 con 0x7f8cb006c320 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949372784 0 0) 0x7f8cb01574a0 con 0x7f8cb00ca000 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb00c9460 con 0x7f8cb00ca000 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb4802640 1 -- 172.21.15.119:0/367535247 >> v1:172.21.15.143:6789/0 conn(0x7f8cb00ca000 legacy=0x7f8cb0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb4802640 1 -- 172.21.15.119:0/367535247 >> v1:172.21.15.119:6789/0 conn(0x7f8cb006c320 legacy=0x7f8cb00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918469932 0 0) 0x7f8c98003530 con 0x7f8cb006c320 2023-12-19T16:16:28.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.805+0000 7f8cb4802640 1 -- 172.21.15.119:0/367535247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00c8b30 con 0x7f8cb01570c0 2023-12-19T16:16:28.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb4802640 1 --2- 172.21.15.119:0/367535247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb01570c0 0x7f8cb006bde0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0097f0 tx=0x7f8cac01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c51913facf3849 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0001680 con 0x7f8cb01570c0 2023-12-19T16:16:28.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0a7050 con 0x7f8cb01570c0 2023-12-19T16:16:28.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8ca77fe640 1 -- 172.21.15.119:0/367535247 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0ab620 con 0x7f8cb01570c0 2023-12-19T16:16:28.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 -- 172.21.15.119:0/367535247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb01570c0 msgr2=0x7f8cb006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/367535247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb01570c0 0x7f8cb006bde0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0097f0 tx=0x7f8cac01c320 comp rx=0 tx=0).stop 2023-12-19T16:16:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 -- 172.21.15.119:0/367535247 shutdown_connections 2023-12-19T16:16:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/367535247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb01570c0 0x7f8cb006bde0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 -- 172.21.15.119:0/367535247 >> 172.21.15.119:0/367535247 conn(0x7f8cb006a3e0 msgr2=0x7f8cb00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 -- 172.21.15.119:0/367535247 shutdown_connections 2023-12-19T16:16:28.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.809+0000 7f8cb6a66640 1 -- 172.21.15.119:0/367535247 wait complete. 2023-12-19T16:16:28.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 Processor -- start 2023-12-19T16:16:28.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 -- start start 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb006c320 0x7f8cb0163000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cb00ca000 0x7f8cb0151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 0x7f8cb0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00cdc40 con 0x7f8cb01570c0 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb015bde0 con 0x7f8cb00ca000 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00cd960 con 0x7f8cb006c320 2023-12-19T16:16:28.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 0x7f8cb0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 0x7f8cb0150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35152/0 (socket says 172.21.15.119:35152) 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 -- 172.21.15.119:0/3088572977 learned_addr learned my addr 172.21.15.119:0/3088572977 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8ca7fff640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cb00ca000 0x7f8cb0151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 -- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb006c320 msgr2=0x7f8cb0163000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb4802640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb006c320 0x7f8cb0163000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb006c320 0x7f8cb0163000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 -- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cb00ca000 msgr2=0x7f8cb0151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cb00ca000 0x7f8cb0151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 -- 172.21.15.119:0/3088572977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009420 con 0x7f8cb01570c0 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb4802640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb006c320 0x7f8cb0163000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8ca7fff640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cb00ca000 0x7f8cb0151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:28.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb5003640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 0x7f8cb0150c30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c790 tx=0x7f8ca800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800cea0 con 0x7f8cb01570c0 2023-12-19T16:16:28.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8003b80 con 0x7f8cb01570c0 2023-12-19T16:16:28.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800a850 con 0x7f8cb01570c0 2023-12-19T16:16:28.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb00caef0 con 0x7f8cb01570c0 2023-12-19T16:16:28.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.813+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb015c0c0 con 0x7f8cb01570c0 2023-12-19T16:16:28.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.817+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb00735b0 con 0x7f8cb01570c0 2023-12-19T16:16:28.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.817+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8ca800a9b0 con 0x7f8cb01570c0 2023-12-19T16:16:28.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.817+0000 7f8ca57fa640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c9c065a90 0x7f8c9c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.817+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8ca8083450 con 0x7f8cb01570c0 2023-12-19T16:16:28.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.817+0000 7f8cb4802640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c9c065a90 0x7f8c9c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.817+0000 7f8cb4802640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c9c065a90 0x7f8c9c067f50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0ad000 tx=0x7f8cac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:28.821+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8ca80509f0 con 0x7f8cb01570c0 2023-12-19T16:16:29.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.001+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb00c7bf0 con 0x7f8cb01570c0 2023-12-19T16:16:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.001+0000 7f8ca57fa640 1 -- 172.21.15.119:0/3088572977 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f8cb00c7bf0 con 0x7f8cb01570c0 2023-12-19T16:16:29.008 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:29.008 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c9c065a90 msgr2=0x7f8c9c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c9c065a90 0x7f8c9c067f50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0ad000 tx=0x7f8cac008040 comp rx=0 tx=0).stop 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 msgr2=0x7f8cb0150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 0x7f8cb0150c30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c790 tx=0x7f8ca800cc50 comp rx=0 tx=0).stop 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 shutdown_connections 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8c9c065a90 0x7f8c9c067f50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cb00ca000 0x7f8cb0151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cb01570c0 0x7f8cb0150c30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 --2- 172.21.15.119:0/3088572977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cb006c320 0x7f8cb0163000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 >> 172.21.15.119:0/3088572977 conn(0x7f8cb006a3e0 msgr2=0x7f8cb00c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 shutdown_connections 2023-12-19T16:16:29.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.005+0000 7f8cb6a66640 1 -- 172.21.15.119:0/3088572977 wait complete. 2023-12-19T16:16:29.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f2115925640 1 Processor -- start 2023-12-19T16:16:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f2115925640 1 -- start start 2023-12-19T16:16:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f2115925640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f21101570c0 0x7f211006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f2115925640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21100c9460 con 0x7f211006c320 2023-12-19T16:16:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f2115925640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21101574a0 con 0x7f21100ca000 2023-12-19T16:16:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f2115925640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211006c7a0 con 0x7f21101570c0 2023-12-19T16:16:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f21067fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f211006c320 0x7f21100c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55456/0 (socket says 172.21.15.119:55456) 2023-12-19T16:16:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f21067fc640 1 -- 172.21.15.119:0/350124398 learned_addr learned my addr 172.21.15.119:0/350124398 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210effd640 1 --2- 172.21.15.119:0/350124398 >> v2:172.21.15.143:3300/0 conn(0x7f21101570c0 0x7f211006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033617590 0 0) 0x7f21100c9460 con 0x7f211006c320 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f0003530 con 0x7f211006c320 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604297177 0 0) 0x7f21101574a0 con 0x7f21100ca000 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21100c9460 con 0x7f21100ca000 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 129357489 0 0) 0x7f20f0003530 con 0x7f211006c320 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 >> v2:172.21.15.143:3300/0 conn(0x7f21101570c0 msgr2=0x7f211006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 --2- 172.21.15.119:0/350124398 >> v2:172.21.15.143:3300/0 conn(0x7f21101570c0 0x7f211006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 >> v1:172.21.15.143:6789/0 conn(0x7f21100ca000 legacy=0x7f2110070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21100c8b30 con 0x7f211006c320 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f20f8001680 con 0x7f211006c320 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 >> v1:172.21.15.119:6789/0 conn(0x7f211006c320 legacy=0x7f21100c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20f0003b10 0x7f20f0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f00047d0 0x7f20f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f0005190 0x7f20f000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211006c7a0 con 0x7f20f0005190 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f000e2d0 con 0x7f20f00047d0 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f000e490 con 0x7f20f0003b10 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210f7fe640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f0005190 0x7f20f000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f21067fc640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f00047d0 0x7f20f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.161+0000 7f210effd640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20f0003b10 0x7f20f0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 -- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20f0003b10 msgr2=0x7f20f0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20f0003b10 0x7f20f0003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 -- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f00047d0 msgr2=0x7f20f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f00047d0 0x7f20f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 -- 172.21.15.119:0/350124398 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0003530 con 0x7f20f0005190 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 -- 172.21.15.119:0/350124398 reap_dead start 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210f7fe640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f0005190 0x7f20f000dba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2108001fd0 tx=0x7f210801f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fd9f614be2ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080a8c70 con 0x7f20f0005190 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080a8dd0 con 0x7f20f0005190 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f210e7fc640 1 -- 172.21.15.119:0/350124398 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108003bc0 con 0x7f20f0005190 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 -- 172.21.15.119:0/350124398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f0005190 msgr2=0x7f20f000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f0005190 0x7f20f000dba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2108001fd0 tx=0x7f210801f050 comp rx=0 tx=0).stop 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 -- 172.21.15.119:0/350124398 shutdown_connections 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 --2- 172.21.15.119:0/350124398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f0005190 0x7f20f000dba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 -- 172.21.15.119:0/350124398 >> 172.21.15.119:0/350124398 conn(0x7f211006a3e0 msgr2=0x7f21100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 -- 172.21.15.119:0/350124398 shutdown_connections 2023-12-19T16:16:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.165+0000 7f2115925640 1 -- 172.21.15.119:0/350124398 wait complete. 2023-12-19T16:16:29.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 Processor -- start 2023-12-19T16:16:29.175 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 -- start start 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f0005190 0x7f211014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f211015c320 0x7f211015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 0x7f21100c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211015cce0 con 0x7f21100c2ca0 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21101f5f10 con 0x7f20f0005190 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21101f5340 con 0x7f211015c320 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 0x7f21100c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 0x7f21100c3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35168/0 (socket says 172.21.15.119:35168) 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 -- 172.21.15.119:0/6611741 learned_addr learned my addr 172.21.15.119:0/6611741 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210effd640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f0005190 0x7f211014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f21067fc640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f211015c320 0x7f211015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 -- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f211015c320 msgr2=0x7f211015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f211015c320 0x7f211015c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 -- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f0005190 msgr2=0x7f211014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f0005190 0x7f211014f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 -- 172.21.15.119:0/6611741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21101f55e0 con 0x7f21100c2ca0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f21067fc640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f211015c320 0x7f211015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210f7fe640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 0x7f21100c3120 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f210801f8f0 tx=0x7f20f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080b5070 con 0x7f21100c2ca0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080a8b30 con 0x7f21100c2ca0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21101f58c0 con 0x7f21100c2ca0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108003b80 con 0x7f21100c2ca0 2023-12-19T16:16:29.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.169+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211014f980 con 0x7f21100c2ca0 2023-12-19T16:16:29.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.173+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21100735b0 con 0x7f21100c2ca0 2023-12-19T16:16:29.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.173+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2108003ce0 con 0x7f21100c2ca0 2023-12-19T16:16:29.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.173+0000 7f210cff9640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f20f4065a60 0x7f20f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.173+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f210811fbc0 con 0x7f21100c2ca0 2023-12-19T16:16:29.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.173+0000 7f210effd640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f20f4065a60 0x7f20f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.173+0000 7f210effd640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f20f4065a60 0x7f20f4067f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2100009aa0 tx=0x7f2100008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.177+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f21080ed0d0 con 0x7f21100c2ca0 2023-12-19T16:16:29.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.329+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21100ce040 con 0x7f21100c2ca0 2023-12-19T16:16:29.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.329+0000 7f210cff9640 1 -- 172.21.15.119:0/6611741 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f21080f06f0 con 0x7f21100c2ca0 2023-12-19T16:16:29.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:29.336 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:29.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f20f4065a60 msgr2=0x7f20f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f20f4065a60 0x7f20f4067f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2100009aa0 tx=0x7f2100008040 comp rx=0 tx=0).stop 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 msgr2=0x7f21100c3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 0x7f21100c3120 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f210801f8f0 tx=0x7f20f0005800 comp rx=0 tx=0).stop 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 shutdown_connections 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f20f4065a60 0x7f20f4067f20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21100c2ca0 0x7f21100c3120 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f211015c320 0x7f211015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 --2- 172.21.15.119:0/6611741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20f0005190 0x7f211014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 >> 172.21.15.119:0/6611741 conn(0x7f211006a3e0 msgr2=0x7f21101516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 shutdown_connections 2023-12-19T16:16:29.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.333+0000 7f2115925640 1 -- 172.21.15.119:0/6611741 wait complete. 2023-12-19T16:16:29.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:18.672779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:19.549827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T16:15:22.618073+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T16:16:29.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:29.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.493+0000 7f249fe55640 1 Processor -- start 2023-12-19T16:16:29.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.493+0000 7f249fe55640 1 -- start start 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249fe55640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24980ca410 0x7f2498159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249fe55640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2498070df0 con 0x7f2498159fb0 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249fe55640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249815a4f0 con 0x7f24980cbff0 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249fe55640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249815aab0 con 0x7f24980ca410 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249d3f0640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2498159fb0 0x7f2498071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55466/0 (socket says 172.21.15.119:55466) 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249d3f0640 1 -- 172.21.15.119:0/2439858039 learned_addr learned my addr 172.21.15.119:0/2439858039 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2439858039 >> v2:172.21.15.143:3300/0 conn(0x7f24980ca410 0x7f2498159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360063313 0 0) 0x7f2498070df0 con 0x7f2498159fb0 2023-12-19T16:16:29.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2484003530 con 0x7f2498159fb0 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409300771 0 0) 0x7f2484003530 con 0x7f2498159fb0 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 >> v2:172.21.15.143:3300/0 conn(0x7f24980ca410 msgr2=0x7f2498159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 --2- 172.21.15.119:0/2439858039 >> v2:172.21.15.143:3300/0 conn(0x7f24980ca410 0x7f2498159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 >> v1:172.21.15.143:6789/0 conn(0x7f24980cbff0 legacy=0x7f24980ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249815a7d0 con 0x7f2498159fb0 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f2488001680 con 0x7f2498159fb0 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 >> v1:172.21.15.119:6789/0 conn(0x7f2498159fb0 legacy=0x7f2498071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484003980 0x7f2484003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484004380 0x7f2484004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2484005050 0x7f248400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249815aab0 con 0x7f2484003980 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248400e1c0 con 0x7f2484004380 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248400e380 con 0x7f2484005050 2023-12-19T16:16:29.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484003980 0x7f2484003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249d3f0640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484004380 0x7f2484004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249e3f2640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2484005050 0x7f248400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 -- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2484005050 msgr2=0x7f248400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2484005050 0x7f248400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 -- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484004380 msgr2=0x7f2484004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484004380 0x7f2484004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249dbf1640 1 -- 172.21.15.119:0/2439858039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484003530 con 0x7f2484003980 2023-12-19T16:16:29.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.497+0000 7f249e3f2640 1 -- 172.21.15.119:0/2439858039 reap_dead start 2023-12-19T16:16:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484003980 0x7f2484003d60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2494009ae0 tx=0x7f249401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6c397704b2eb57 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940a5640 con 0x7f2484003980 2023-12-19T16:16:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940a57a0 con 0x7f2484003980 2023-12-19T16:16:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249cbef640 1 -- 172.21.15.119:0/2439858039 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940a5b50 con 0x7f2484003980 2023-12-19T16:16:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 -- 172.21.15.119:0/2439858039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484003980 msgr2=0x7f2484003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484003980 0x7f2484003d60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2494009ae0 tx=0x7f249401ca50 comp rx=0 tx=0).stop 2023-12-19T16:16:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 -- 172.21.15.119:0/2439858039 shutdown_connections 2023-12-19T16:16:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 --2- 172.21.15.119:0/2439858039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484003980 0x7f2484003d60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 -- 172.21.15.119:0/2439858039 >> 172.21.15.119:0/2439858039 conn(0x7f249806a2a0 msgr2=0x7f24980aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 -- 172.21.15.119:0/2439858039 shutdown_connections 2023-12-19T16:16:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.501+0000 7f249fe55640 1 -- 172.21.15.119:0/2439858039 wait complete. 2023-12-19T16:16:29.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 Processor -- start 2023-12-19T16:16:29.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- start start 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484003980 0x7f249814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 0x7f24980ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24980c6210 0x7f24980ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249815af70 con 0x7f24980c5d90 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c5890 con 0x7f2484003980 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249815b180 con 0x7f24980c6210 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 0x7f24980ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 0x7f24980ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35182/0 (socket says 172.21.15.119:35182) 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 -- 172.21.15.119:0/2866154325 learned_addr learned my addr 172.21.15.119:0/2866154325 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:29.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484003980 0x7f249814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249e3f2640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24980c6210 0x7f24980ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 -- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24980c6210 msgr2=0x7f24980ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24980c6210 0x7f24980ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 -- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484003980 msgr2=0x7f249814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484003980 0x7f249814a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 -- 172.21.15.119:0/2866154325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249815b460 con 0x7f24980c5d90 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484003980 0x7f249814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:29.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249d3f0640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 0x7f24980ae350 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f24880072c0 tx=0x7f2488007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800f9c0 con 0x7f24980c5d90 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248800fb20 con 0x7f24980c5d90 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800fe90 con 0x7f24980c5d90 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249815b740 con 0x7f24980c5d90 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249814ad90 con 0x7f24980c5d90 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.505+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24980cdbc0 con 0x7f24980c5d90 2023-12-19T16:16:29.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.509+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f248801d460 con 0x7f24980c5d90 2023-12-19T16:16:29.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.509+0000 7f248e7fc640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f247c065a90 0x7f247c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.509+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2488083640 con 0x7f24980c5d90 2023-12-19T16:16:29.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.509+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f247c065a90 0x7f247c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.509+0000 7f249dbf1640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f247c065a90 0x7f247c067f50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f24940af000 tx=0x7f24940046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.513+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2488050c00 con 0x7f24980c5d90 2023-12-19T16:16:29.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f249804e000 con 0x7f24980c5d90 2023-12-19T16:16:29.667 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f248e7fc640 1 -- 172.21.15.119:0/2866154325 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2488054220 con 0x7f24980c5d90 2023-12-19T16:16:29.667 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:29.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f247c065a90 msgr2=0x7f247c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f247c065a90 0x7f247c067f50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f24940af000 tx=0x7f24940046d0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 msgr2=0x7f24980ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 0x7f24980ae350 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f24880072c0 tx=0x7f2488007780 comp rx=0 tx=0).stop 2023-12-19T16:16:29.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 shutdown_connections 2023-12-19T16:16:29.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f247c065a90 0x7f247c067f50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24980c6210 0x7f24980ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24980c5d90 0x7f24980ae350 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 --2- 172.21.15.119:0/2866154325 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2484003980 0x7f249814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.661+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 >> 172.21.15.119:0/2866154325 conn(0x7f249806a2a0 msgr2=0x7f2498157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.665+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 shutdown_connections 2023-12-19T16:16:29.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.665+0000 7f249fe55640 1 -- 172.21.15.119:0/2866154325 wait complete. 2023-12-19T16:16:29.688 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:29.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.821+0000 7fbfed3bc640 1 Processor -- start 2023-12-19T16:16:29.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.821+0000 7fbfed3bc640 1 -- start start 2023-12-19T16:16:29.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfed3bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815a770 0x7fbfe8160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfed3bc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8160940 con 0x7fbfe815a390 2023-12-19T16:16:29.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfed3bc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe806ba40 con 0x7fbfe806ca30 2023-12-19T16:16:29.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfed3bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806bd20 con 0x7fbfe815a770 2023-12-19T16:16:29.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe6ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbfe815a390 0x7fbfe806b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55482/0 (socket says 172.21.15.119:55482) 2023-12-19T16:16:29.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe6ffd640 1 -- 172.21.15.119:0/67282810 learned_addr learned my addr 172.21.15.119:0/67282810 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815a770 0x7fbfe8160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402830590 0 0) 0x7fbfe8160940 con 0x7fbfe815a390 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd4003530 con 0x7fbfe815a390 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488477815 0 0) 0x7fbfd4003530 con 0x7fbfe815a390 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815a770 msgr2=0x7fbfe8160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815a770 0x7fbfe8160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 >> v1:172.21.15.143:6789/0 conn(0x7fbfe806ca30 legacy=0x7fbfe80b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe81605d0 con 0x7fbfe815a390 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fbfd8001680 con 0x7fbfe815a390 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 >> v1:172.21.15.119:6789/0 conn(0x7fbfe815a390 legacy=0x7fbfe806b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd40039b0 0x7fbfd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfd40047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd4004ff0 0x7fbfd400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806bd20 con 0x7fbfd4004310 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd400bf00 con 0x7fbfd4004ff0 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd400c0c0 con 0x7fbfd40039b0 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfd40047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe6ffd640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd40039b0 0x7fbfd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe77fe640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd4004ff0 0x7fbfd400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 -- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd40039b0 msgr2=0x7fbfd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd40039b0 0x7fbfd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 -- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd4004ff0 msgr2=0x7fbfd400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd4004ff0 0x7fbfd400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfdffff640 1 -- 172.21.15.119:0/67282810 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4003530 con 0x7fbfd4004310 2023-12-19T16:16:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.825+0000 7fbfe77fe640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd4004ff0 0x7fbfd400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:29.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfdffff640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfd40047f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009ae0 tx=0x7fbfd001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dd4082bdfb2d31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00a5580 con 0x7fbfd4004310 2023-12-19T16:16:29.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00a56e0 con 0x7fbfd4004310 2023-12-19T16:16:29.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfe67fc640 1 -- 172.21.15.119:0/67282810 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00a5a90 con 0x7fbfd4004310 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 -- 172.21.15.119:0/67282810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 msgr2=0x7fbfd40047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/67282810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfd40047f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009ae0 tx=0x7fbfd001c990 comp rx=0 tx=0).stop 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfe77fe640 1 -- 172.21.15.119:0/67282810 reap_dead start 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 -- 172.21.15.119:0/67282810 shutdown_connections 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 -- 172.21.15.119:0/67282810 >> 172.21.15.119:0/67282810 conn(0x7fbfe80ccf90 msgr2=0x7fbfe80cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 -- 172.21.15.119:0/67282810 shutdown_connections 2023-12-19T16:16:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 -- 172.21.15.119:0/67282810 wait complete. 2023-12-19T16:16:29.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 Processor -- start 2023-12-19T16:16:29.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.829+0000 7fbfed3bc640 1 -- start start 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfe8150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfe8159010 0x7fbfe8150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815e070 0x7fbfe8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81507d0 con 0x7fbfd4004310 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80c5100 con 0x7fbfe8159010 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8159490 con 0x7fbfe815e070 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfe8150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfe8150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35204/0 (socket says 172.21.15.119:35204) 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 -- 172.21.15.119:0/1658252487 learned_addr learned my addr 172.21.15.119:0/1658252487 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfdffff640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfe8159010 0x7fbfe8150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe77fe640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815e070 0x7fbfe8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 -- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815e070 msgr2=0x7fbfe8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815e070 0x7fbfe8156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 -- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfe8159010 msgr2=0x7fbfe8150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfe8159010 0x7fbfe8150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 -- 172.21.15.119:0/1658252487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80b1fd0 con 0x7fbfd4004310 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe77fe640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815e070 0x7fbfe8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfe6ffd640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfe8150930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004fd0 tx=0x7fbfd8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800fa00 con 0x7fbfd4004310 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800fb80 con 0x7fbfd4004310 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80133f0 con 0x7fbfd4004310 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe8159710 con 0x7fbfd4004310 2023-12-19T16:16:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe80c5360 con 0x7fbfd4004310 2023-12-19T16:16:29.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8159c30 con 0x7fbfd4004310 2023-12-19T16:16:29.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.833+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbfd8013550 con 0x7fbfd4004310 2023-12-19T16:16:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.837+0000 7fbfdf7fe640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfc8065a90 0x7fbfc8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.837+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fbfd80837f0 con 0x7fbfd4004310 2023-12-19T16:16:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.837+0000 7fbfdffff640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfc8065a90 0x7fbfc8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.837+0000 7fbfdffff640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfc8065a90 0x7fbfc8067f50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00af000 tx=0x7fbfd00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.841+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbfd8050d00 con 0x7fbfd4004310 2023-12-19T16:16:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.989+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfe80ce2d0 con 0x7fbfd4004310 2023-12-19T16:16:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.989+0000 7fbfdf7fe640 1 -- 172.21.15.119:0/1658252487 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbfd8054320 con 0x7fbfd4004310 2023-12-19T16:16:29.996 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfc8065a90 msgr2=0x7fbfc8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfc8065a90 0x7fbfc8067f50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00af000 tx=0x7fbfd00046d0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 msgr2=0x7fbfe8150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfe8150930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004fd0 tx=0x7fbfd8007720 comp rx=0 tx=0).stop 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 shutdown_connections 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbfc8065a90 0x7fbfc8067f50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfe8159010 0x7fbfe8150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfe815e070 0x7fbfe8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 --2- 172.21.15.119:0/1658252487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfd4004310 0x7fbfe8150930 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 >> 172.21.15.119:0/1658252487 conn(0x7fbfe80ccf90 msgr2=0x7fbfe80cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 shutdown_connections 2023-12-19T16:16:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:29.993+0000 7fbfed3bc640 1 -- 172.21.15.119:0/1658252487 wait complete. 2023-12-19T16:16:30.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:30.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 Processor -- start 2023-12-19T16:16:30.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 -- start start 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a4160a60 0x7f03a40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03a40ce8f0 0x7f03a4164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f03a4164e60 0x7f03a40cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a40ced50 con 0x7f03a40ce8f0 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a40cc980 con 0x7f03a4164e60 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03abf39640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40cc090 con 0x7f03a4160a60 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03a40ce8f0 0x7f03a4164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03a40ce8f0 0x7f03a4164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35218/0 (socket says 172.21.15.119:35218) 2023-12-19T16:16:30.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 -- 172.21.15.119:0/4162640230 learned_addr learned my addr 172.21.15.119:0/4162640230 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 -- 172.21.15.119:0/4162640230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a4160a60 msgr2=0x7f03a40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03aa4d6640 1 --2- 172.21.15.119:0/4162640230 >> v2:172.21.15.143:3300/0 conn(0x7f03a4164e60 0x7f03a40cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a9cd5640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a4160a60 0x7f03a40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a4160a60 0x7f03a40ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 -- 172.21.15.119:0/4162640230 >> v2:172.21.15.143:3300/0 conn(0x7f03a4164e60 msgr2=0x7f03a40cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 --2- 172.21.15.119:0/4162640230 >> v2:172.21.15.143:3300/0 conn(0x7f03a4164e60 0x7f03a40cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a94d4640 1 -- 172.21.15.119:0/4162640230 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a40cc330 con 0x7f03a40ce8f0 2023-12-19T16:16:30.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03a9cd5640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a4160a60 0x7f03a40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:30.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.153+0000 7f03aa4d6640 1 --2- 172.21.15.119:0/4162640230 >> v2:172.21.15.143:3300/0 conn(0x7f03a4164e60 0x7f03a40cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03a94d4640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a40ce8f0 0x7f03a4164920 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f03a40c8f10 tx=0x7f039401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23e6a2876602d3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03a8cd3640 1 -- 172.21.15.119:0/4162640230 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940aa610 con 0x7f03a40ce8f0 2023-12-19T16:16:30.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03a8cd3640 1 -- 172.21.15.119:0/4162640230 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03940a6040 con 0x7f03a40ce8f0 2023-12-19T16:16:30.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03a8cd3640 1 -- 172.21.15.119:0/4162640230 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940aa990 con 0x7f03a40ce8f0 2023-12-19T16:16:30.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 -- 172.21.15.119:0/4162640230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a40ce8f0 msgr2=0x7f03a4164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a40ce8f0 0x7f03a4164920 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f03a40c8f10 tx=0x7f039401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 -- 172.21.15.119:0/4162640230 shutdown_connections 2023-12-19T16:16:30.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 --2- 172.21.15.119:0/4162640230 >> v2:172.21.15.143:3300/0 conn(0x7f03a4164e60 0x7f03a40cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a40ce8f0 0x7f03a4164920 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 --2- 172.21.15.119:0/4162640230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a4160a60 0x7f03a40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 -- 172.21.15.119:0/4162640230 >> 172.21.15.119:0/4162640230 conn(0x7f03a406a2a0 msgr2=0x7f03a40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 -- 172.21.15.119:0/4162640230 shutdown_connections 2023-12-19T16:16:30.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.157+0000 7f03abf39640 1 -- 172.21.15.119:0/4162640230 wait complete. 2023-12-19T16:16:30.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 Processor -- start 2023-12-19T16:16:30.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- start start 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a40ce8f0 0x7f03a41648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 0x7f03a414da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03a4164e60 0x7f03a40712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a414f030 con 0x7f03a4160a60 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a414df70 con 0x7f03a4164e60 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a414f4c0 con 0x7f03a40ce8f0 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 0x7f03a414da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a9cd5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a40ce8f0 0x7f03a41648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 0x7f03a414da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35226/0 (socket says 172.21.15.119:35226) 2023-12-19T16:16:30.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 -- 172.21.15.119:0/2418742277 learned_addr learned my addr 172.21.15.119:0/2418742277 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03aa4d6640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03a4164e60 0x7f03a40712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 -- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a40ce8f0 msgr2=0x7f03a41648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a40ce8f0 0x7f03a41648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 -- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03a4164e60 msgr2=0x7f03a40712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03a4164e60 0x7f03a40712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 -- 172.21.15.119:0/2418742277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940094d0 con 0x7f03a4160a60 2023-12-19T16:16:30.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03a94d4640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 0x7f03a414da30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f039401ab80 tx=0x7f039401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940b3800 con 0x7f03a4160a60 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03940b3960 con 0x7f03a4160a60 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a40b10f0 con 0x7f03a4160a60 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940b3d10 con 0x7f03a4160a60 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a414ecc0 con 0x7f03a4160a60 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.161+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a404e000 con 0x7f03a4160a60 2023-12-19T16:16:30.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.165+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f03940c6440 con 0x7f03a4160a60 2023-12-19T16:16:30.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.165+0000 7f039a7fc640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0388065a60 0x7f0388067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.165+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f039411e0a0 con 0x7f03a4160a60 2023-12-19T16:16:30.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.165+0000 7f03a9cd5640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0388065a60 0x7f0388067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.165+0000 7f03a9cd5640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0388065a60 0x7f0388067f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ab60 tx=0x7f03a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.175 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.169+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f03940eb710 con 0x7f03a4160a60 2023-12-19T16:16:30.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.317+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03a40b0c00 con 0x7f03a4160a60 2023-12-19T16:16:30.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.317+0000 7f039a7fc640 1 -- 172.21.15.119:0/2418742277 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03940eed30 con 0x7f03a4160a60 2023-12-19T16:16:30.324 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0388065a60 msgr2=0x7f0388067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0388065a60 0x7f0388067f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ab60 tx=0x7f03a0008040 comp rx=0 tx=0).stop 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 msgr2=0x7f03a414da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 0x7f03a414da30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f039401ab80 tx=0x7f039401ad10 comp rx=0 tx=0).stop 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 shutdown_connections 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0388065a60 0x7f0388067f20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03a4164e60 0x7f03a40712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a4160a60 0x7f03a414da30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 --2- 172.21.15.119:0/2418742277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03a40ce8f0 0x7f03a41648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 >> 172.21.15.119:0/2418742277 conn(0x7f03a406a2a0 msgr2=0x7f03a40c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 shutdown_connections 2023-12-19T16:16:30.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.321+0000 7f03abf39640 1 -- 172.21.15.119:0/2418742277 wait complete. 2023-12-19T16:16:30.346 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T16:16:30.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.481+0000 7fa2004d1640 1 Processor -- start 2023-12-19T16:16:30.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.481+0000 7fa2004d1640 1 -- start start 2023-12-19T16:16:30.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.481+0000 7fa2004d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa1f80ca410 0x7fa1f8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.481+0000 7fa2004d1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f8070df0 con 0x7fa1f8159fb0 2023-12-19T16:16:30.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.481+0000 7fa2004d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f815a4f0 con 0x7fa1f80cbff0 2023-12-19T16:16:30.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.481+0000 7fa2004d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f815aab0 con 0x7fa1f80ca410 2023-12-19T16:16:30.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fda6c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa1f8159fb0 0x7fa1f8071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55492/0 (socket says 172.21.15.119:55492) 2023-12-19T16:16:30.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fda6c640 1 -- 172.21.15.119:0/1852365365 learned_addr learned my addr 172.21.15.119:0/1852365365 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:30.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fe26d640 1 --2- 172.21.15.119:0/1852365365 >> v2:172.21.15.143:3300/0 conn(0x7fa1f80ca410 0x7fa1f8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806213920 0 0) 0x7fa1f8070df0 con 0x7fa1f8159fb0 2023-12-19T16:16:30.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e4005740 con 0x7fa1f8159fb0 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009647876 0 0) 0x7fa1e4005740 con 0x7fa1f8159fb0 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 >> v2:172.21.15.143:3300/0 conn(0x7fa1f80ca410 msgr2=0x7fa1f8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 --2- 172.21.15.119:0/1852365365 >> v2:172.21.15.143:3300/0 conn(0x7fa1f80ca410 0x7fa1f8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 >> v1:172.21.15.143:6789/0 conn(0x7fa1f80cbff0 legacy=0x7fa1f80ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f815a7d0 con 0x7fa1f8159fb0 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fa1e8001680 con 0x7fa1f8159fb0 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 >> v1:172.21.15.119:6789/0 conn(0x7fa1f8159fb0 legacy=0x7fa1f8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e4005b90 0x7fa1e4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1e40069e0 0x7fa1e4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e40073a0 0x7fa1e400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f815aab0 con 0x7fa1e40073a0 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e400e240 con 0x7fa1e4005b90 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e400e400 con 0x7fa1e40069e0 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fea6e640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e40073a0 0x7fa1e400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fda6c640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1e40069e0 0x7fa1e4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fe26d640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e4005b90 0x7fa1e4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fea6e640 1 -- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1e40069e0 msgr2=0x7fa1e4006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fea6e640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1e40069e0 0x7fa1e4006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fea6e640 1 -- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e4005b90 msgr2=0x7fa1e4005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fea6e640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e4005b90 0x7fa1e4005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.485+0000 7fa1fea6e640 1 -- 172.21.15.119:0/1852365365 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4005740 con 0x7fa1e40073a0 2023-12-19T16:16:30.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa1fea6e640 1 -- 172.21.15.119:0/1852365365 reap_dead start 2023-12-19T16:16:30.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa1fea6e640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e40073a0 0x7fa1e400dba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0001e70 tx=0x7fa1f001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67488ba3fa96bb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0003980 con 0x7fa1e40073a0 2023-12-19T16:16:30.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0003b20 con 0x7fa1e40073a0 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa1fd26b640 1 -- 172.21.15.119:0/1852365365 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0005020 con 0x7fa1e40073a0 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 -- 172.21.15.119:0/1852365365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e40073a0 msgr2=0x7fa1e400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e40073a0 0x7fa1e400dba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0001e70 tx=0x7fa1f001c760 comp rx=0 tx=0).stop 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 -- 172.21.15.119:0/1852365365 shutdown_connections 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 --2- 172.21.15.119:0/1852365365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e40073a0 0x7fa1e400dba0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 -- 172.21.15.119:0/1852365365 >> 172.21.15.119:0/1852365365 conn(0x7fa1f806a2a0 msgr2=0x7fa1f80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 -- 172.21.15.119:0/1852365365 shutdown_connections 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 -- 172.21.15.119:0/1852365365 wait complete. 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 Processor -- start 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.489+0000 7fa2004d1640 1 -- start start 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e40073a0 0x7fa1f81ed720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 0x7fa1f81425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1f81f1720 0x7fa1f8158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8151090 con 0x7fa1f814f290 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f81ee910 con 0x7fa1e40073a0 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8142af0 con 0x7fa1f81f1720 2023-12-19T16:16:30.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 0x7fa1f81425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 0x7fa1f81425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35246/0 (socket says 172.21.15.119:35246) 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 -- 172.21.15.119:0/4005638579 learned_addr learned my addr 172.21.15.119:0/4005638579 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fe26d640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e40073a0 0x7fa1f81ed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fea6e640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1f81f1720 0x7fa1f8158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 -- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1f81f1720 msgr2=0x7fa1f8158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1f81f1720 0x7fa1f8158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 -- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e40073a0 msgr2=0x7fa1f81ed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e40073a0 0x7fa1f81ed720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 -- 172.21.15.119:0/4005638579 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f81edd90 con 0x7fa1f814f290 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fe26d640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e40073a0 0x7fa1f81ed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1fda6c640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 0x7fa1f81425b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8007290 tx=0x7fa1e8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800f9c0 con 0x7fa1f814f290 2023-12-19T16:16:30.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e800fb20 con 0x7fa1f814f290 2023-12-19T16:16:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f81ee070 con 0x7fa1f814f290 2023-12-19T16:16:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800feb0 con 0x7fa1f814f290 2023-12-19T16:16:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f81ee630 con 0x7fa1f814f290 2023-12-19T16:16:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f81534c0 con 0x7fa1f814f290 2023-12-19T16:16:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa1e801d460 con 0x7fa1f814f290 2023-12-19T16:16:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.493+0000 7fa1eeffd640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa1dc065a60 0x7fa1dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.497+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa1e80837f0 con 0x7fa1f814f290 2023-12-19T16:16:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.497+0000 7fa1fe26d640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa1dc065a60 0x7fa1dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.497+0000 7fa1fe26d640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa1dc065a60 0x7fa1dc067f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009b60 tx=0x7fa1f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.497+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa1f81534c0 con 0x7fa1f814f290 2023-12-19T16:16:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1f81534c0 con 0x7fa1f814f290 2023-12-19T16:16:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa1eeffd640 1 -- 172.21.15.119:0/4005638579 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa1e8050d90 con 0x7fa1f814f290 2023-12-19T16:16:30.655 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:16:30.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa1dc065a60 msgr2=0x7fa1dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa1dc065a60 0x7fa1dc067f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009b60 tx=0x7fa1f4008040 comp rx=0 tx=0).stop 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 msgr2=0x7fa1f81425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 0x7fa1f81425b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8007290 tx=0x7fa1e8007750 comp rx=0 tx=0).stop 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 shutdown_connections 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa1dc065a60 0x7fa1dc067f20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1f81f1720 0x7fa1f8158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f814f290 0x7fa1f81425b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 --2- 172.21.15.119:0/4005638579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1e40073a0 0x7fa1f81ed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 >> 172.21.15.119:0/4005638579 conn(0x7fa1f806a2a0 msgr2=0x7fa1f8155600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 shutdown_connections 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.649+0000 7fa2004d1640 1 -- 172.21.15.119:0/4005638579 wait complete. 2023-12-19T16:16:30.675 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:30.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.805+0000 7fcd07fa6640 1 Processor -- start 2023-12-19T16:16:30.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.805+0000 7fcd07fa6640 1 -- start start 2023-12-19T16:16:30.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd07fa6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd000cac10 0x7fcd0015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd07fa6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0015f100 con 0x7fcd0006fdb0 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd07fa6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000ca7d0 con 0x7fcd0015a680 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd07fa6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0015e860 con 0x7fcd000cac10 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd05541640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd000cac10 0x7fcd0015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd05541640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd000cac10 0x7fcd0015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35250/0 (socket says 172.21.15.119:35250) 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd05541640 1 -- 172.21.15.119:0/1832287255 learned_addr learned my addr 172.21.15.119:0/1832287255 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd05541640 1 -- 172.21.15.119:0/1832287255 >> v1:172.21.15.143:6789/0 conn(0x7fcd0015a680 legacy=0x7fcd0015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd05541640 1 -- 172.21.15.119:0/1832287255 >> v1:172.21.15.119:6789/0 conn(0x7fcd0006fdb0 legacy=0x7fcd000c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd05541640 1 -- 172.21.15.119:0/1832287255 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0015eb40 con 0x7fcd000cac10 2023-12-19T16:16:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.809+0000 7fcd04d40640 1 -- 172.21.15.119:0/1832287255 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545892788 0 0) 0x7fcd0015f100 con 0x7fcd0006fdb0 2023-12-19T16:16:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd05541640 1 --2- 172.21.15.119:0/1832287255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd000cac10 0x7fcd0015e160 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009870 tx=0x7fccf001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02d253a271cc661 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd04d40640 1 -- 172.21.15.119:0/1832287255 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00aa610 con 0x7fcd000cac10 2023-12-19T16:16:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd04d40640 1 -- 172.21.15.119:0/1832287255 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf00a6040 con 0x7fcd000cac10 2023-12-19T16:16:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd04d40640 1 -- 172.21.15.119:0/1832287255 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00aa990 con 0x7fcd000cac10 2023-12-19T16:16:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- 172.21.15.119:0/1832287255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd000cac10 msgr2=0x7fcd0015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/1832287255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd000cac10 0x7fcd0015e160 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009870 tx=0x7fccf001c4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- 172.21.15.119:0/1832287255 shutdown_connections 2023-12-19T16:16:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/1832287255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd000cac10 0x7fcd0015e160 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- 172.21.15.119:0/1832287255 >> 172.21.15.119:0/1832287255 conn(0x7fcd0006a3e0 msgr2=0x7fcd000afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- 172.21.15.119:0/1832287255 shutdown_connections 2023-12-19T16:16:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- 172.21.15.119:0/1832287255 wait complete. 2023-12-19T16:16:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 Processor -- start 2023-12-19T16:16:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- start start 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 0x7fcd001572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000cac10 0x7fcd000c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd0015a680 0x7fcd000c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00157830 con 0x7fcd0006fdb0 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000c8030 con 0x7fcd000cac10 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd07fa6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000c2030 con 0x7fcd0015a680 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.813+0000 7fcd05d42640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 0x7fcd001572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 0x7fcd001572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35254/0 (socket says 172.21.15.119:35254) 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 -- 172.21.15.119:0/2436311775 learned_addr learned my addr 172.21.15.119:0/2436311775 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05541640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000cac10 0x7fcd000c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd06543640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd0015a680 0x7fcd000c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 -- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd0015a680 msgr2=0x7fcd000c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd0015a680 0x7fcd000c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 -- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000cac10 msgr2=0x7fcd000c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000cac10 0x7fcd000c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 -- 172.21.15.119:0/2436311775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00094d0 con 0x7fcd0006fdb0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05541640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000cac10 0x7fcd000c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd05d42640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 0x7fcd001572f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c500 tx=0x7fccfc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc005220 con 0x7fcd0006fdb0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc005380 con 0x7fcd0006fdb0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc007270 con 0x7fcd0006fdb0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000c2310 con 0x7fcd0006fdb0 2023-12-19T16:16:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000c28d0 con 0x7fcd0006fdb0 2023-12-19T16:16:30.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd000735b0 con 0x7fcd0006fdb0 2023-12-19T16:16:30.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fccfc0073d0 con 0x7fcd0006fdb0 2023-12-19T16:16:30.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fccf67fc640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcce4065a60 0x7fcce4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.817+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fccfc082fa0 con 0x7fcd0006fdb0 2023-12-19T16:16:30.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.821+0000 7fcd05541640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcce4065a60 0x7fcce4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.821+0000 7fcd05541640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcce4065a60 0x7fcce4067f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fccf00ae000 tx=0x7fccf00b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:30.821+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fccfc0504c0 con 0x7fcd0006fdb0 2023-12-19T16:16:31.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.005+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd0006c800 con 0x7fcd0006fdb0 2023-12-19T16:16:31.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fccf67fc640 1 -- 172.21.15.119:0/2436311775 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7fccfc053ae0 con 0x7fcd0006fdb0 2023-12-19T16:16:31.013 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:31.014 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:31.014 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:16:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcce4065a60 msgr2=0x7fcce4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcce4065a60 0x7fcce4067f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fccf00ae000 tx=0x7fccf00b5040 comp rx=0 tx=0).stop 2023-12-19T16:16:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 msgr2=0x7fcd001572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 0x7fcd001572f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c500 tx=0x7fccfc00c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 shutdown_connections 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcce4065a60 0x7fcce4067f20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000cac10 0x7fcd000c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd0015a680 0x7fcd000c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 --2- 172.21.15.119:0/2436311775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd0006fdb0 0x7fcd001572f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 >> 172.21.15.119:0/2436311775 conn(0x7fcd0006a3e0 msgr2=0x7fcd0015c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 shutdown_connections 2023-12-19T16:16:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.009+0000 7fcd07fa6640 1 -- 172.21.15.119:0/2436311775 wait complete. 2023-12-19T16:16:31.034 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:31.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 Processor -- start 2023-12-19T16:16:31.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 -- start start 2023-12-19T16:16:31.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60580afd10 0x7f60580b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f605806fb60 0x7f605806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580cbc70 con 0x7f60580cc6c0 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580b0630 con 0x7f605806fb60 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605edbe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580c3bb0 con 0x7f60580afd10 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f605806fb60 0x7f605806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f605806fb60 0x7f605806ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35256/0 (socket says 172.21.15.119:35256) 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 -- 172.21.15.119:0/3970528840 learned_addr learned my addr 172.21.15.119:0/3970528840 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605ddbc640 1 --2- 172.21.15.119:0/3970528840 >> v2:172.21.15.143:3300/0 conn(0x7f60580afd10 0x7f60580b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 -- 172.21.15.119:0/3970528840 >> v2:172.21.15.143:3300/0 conn(0x7f60580afd10 msgr2=0x7f60580b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 --2- 172.21.15.119:0/3970528840 >> v2:172.21.15.143:3300/0 conn(0x7f60580afd10 0x7f60580b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 -- 172.21.15.119:0/3970528840 >> v1:172.21.15.143:6789/0 conn(0x7f60580cc6c0 legacy=0x7f60580c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.165+0000 7f605d5bb640 1 -- 172.21.15.119:0/3970528840 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580c3e90 con 0x7f605806fb60 2023-12-19T16:16:31.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605ddbc640 1 --2- 172.21.15.119:0/3970528840 >> v2:172.21.15.143:3300/0 conn(0x7f60580afd10 0x7f60580b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:31.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605d5bb640 1 --2- 172.21.15.119:0/3970528840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f605806fb60 0x7f605806ffe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6058143370 tx=0x7f604801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d3f4a17376d24a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605cdba640 1 -- 172.21.15.119:0/3970528840 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480aa5f0 con 0x7f605806fb60 2023-12-19T16:16:31.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605cdba640 1 -- 172.21.15.119:0/3970528840 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480aa750 con 0x7f605806fb60 2023-12-19T16:16:31.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605cdba640 1 -- 172.21.15.119:0/3970528840 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480aaae0 con 0x7f605806fb60 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605edbe640 1 -- 172.21.15.119:0/3970528840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f605806fb60 msgr2=0x7f605806ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605edbe640 1 --2- 172.21.15.119:0/3970528840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f605806fb60 0x7f605806ffe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6058143370 tx=0x7f604801c490 comp rx=0 tx=0).stop 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605edbe640 1 -- 172.21.15.119:0/3970528840 shutdown_connections 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605edbe640 1 --2- 172.21.15.119:0/3970528840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f605806fb60 0x7f605806ffe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605edbe640 1 --2- 172.21.15.119:0/3970528840 >> v2:172.21.15.143:3300/0 conn(0x7f60580afd10 0x7f60580b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.169+0000 7f605edbe640 1 -- 172.21.15.119:0/3970528840 >> 172.21.15.119:0/3970528840 conn(0x7f60580ce130 msgr2=0x7f60580ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 -- 172.21.15.119:0/3970528840 shutdown_connections 2023-12-19T16:16:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 -- 172.21.15.119:0/3970528840 wait complete. 2023-12-19T16:16:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 Processor -- start 2023-12-19T16:16:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 -- start start 2023-12-19T16:16:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f605806fb60 0x7f60580c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60580afd10 0x7f605813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580cc6c0 0x7f6058162a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580c71c0 con 0x7f60580cc6c0 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580c5c20 con 0x7f605806fb60 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605edbe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605813d370 con 0x7f60580afd10 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605ddbc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f605806fb60 0x7f60580c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580cc6c0 0x7f6058162a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605ddbc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f605806fb60 0x7f60580c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:36196/0 (socket says 172.21.15.119:36196) 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605ddbc640 1 -- 172.21.15.119:0/308452277 learned_addr learned my addr 172.21.15.119:0/308452277 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605d5bb640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60580afd10 0x7f605813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 -- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60580afd10 msgr2=0x7f605813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60580afd10 0x7f605813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 -- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f605806fb60 msgr2=0x7f60580c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f605806fb60 0x7f60580c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 -- 172.21.15.119:0/308452277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480094d0 con 0x7f60580cc6c0 2023-12-19T16:16:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.173+0000 7f605e5bd640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580cc6c0 0x7f6058162a30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f605000be00 tx=0x7f605000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000ce70 con 0x7f60580cc6c0 2023-12-19T16:16:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050003980 con 0x7f60580cc6c0 2023-12-19T16:16:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050003d70 con 0x7f60580cc6c0 2023-12-19T16:16:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60580c5ec0 con 0x7f60580cc6c0 2023-12-19T16:16:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60580c6480 con 0x7f60580cc6c0 2023-12-19T16:16:31.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605804e850 con 0x7f60580cc6c0 2023-12-19T16:16:31.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6050003ef0 con 0x7f60580cc6c0 2023-12-19T16:16:31.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f604e7fc640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f603c065a60 0x7f603c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6050083510 con 0x7f60580cc6c0 2023-12-19T16:16:31.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f605ddbc640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f603c065a60 0x7f603c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.177+0000 7f605ddbc640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f603c065a60 0x7f603c067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6054006fd0 tx=0x7f6054008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.181+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6050050ad0 con 0x7f60580cc6c0 2023-12-19T16:16:31.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.333+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6058142290 con 0x7f60580cc6c0 2023-12-19T16:16:31.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.333+0000 7f604e7fc640 1 -- 172.21.15.119:0/308452277 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f60500540f0 con 0x7f60580cc6c0 2023-12-19T16:16:31.341 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:31.341 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f603c065a60 msgr2=0x7f603c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f603c065a60 0x7f603c067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6054006fd0 tx=0x7f6054008040 comp rx=0 tx=0).stop 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580cc6c0 msgr2=0x7f6058162a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580cc6c0 0x7f6058162a30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f605000be00 tx=0x7f605000bef0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 shutdown_connections 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f603c065a60 0x7f603c067f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580cc6c0 0x7f6058162a30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60580afd10 0x7f605813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 --2- 172.21.15.119:0/308452277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f605806fb60 0x7f60580c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 >> 172.21.15.119:0/308452277 conn(0x7f60580ce130 msgr2=0x7f60580c2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 shutdown_connections 2023-12-19T16:16:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.337+0000 7f605edbe640 1 -- 172.21.15.119:0/308452277 wait complete. 2023-12-19T16:16:31.362 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:16:31.362 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:31.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2753820640 1 Processor -- start 2023-12-19T16:16:31.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2753820640 1 -- start start 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2753820640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f274c0cf530 0x7f274c168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2753820640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0d11c0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2753820640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0d0310 con 0x7f274c15ca40 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2753820640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0d05b0 con 0x7f274c0cf530 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2750dbb640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f274c0cf0d0 0x7f274c1648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55524/0 (socket says 172.21.15.119:55524) 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2750dbb640 1 -- 172.21.15.119:0/880149705 learned_addr learned my addr 172.21.15.119:0/880149705 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2751dbd640 1 --2- 172.21.15.119:0/880149705 >> v2:172.21.15.143:3300/0 conn(0x7f274c0cf530 0x7f274c168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660328860 0 0) 0x7f274c0d11c0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2738003530 con 0x7f274c0cf0d0 2023-12-19T16:16:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266633053 0 0) 0x7f274c0d0310 con 0x7f274c15ca40 2023-12-19T16:16:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c0d11c0 con 0x7f274c15ca40 2023-12-19T16:16:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2751dbd640 1 -- 172.21.15.119:0/880149705 >> v1:172.21.15.143:6789/0 conn(0x7f274c15ca40 legacy=0x7f274c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399932017 0 0) 0x7f2738003530 con 0x7f274c0cf0d0 2023-12-19T16:16:31.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2751dbd640 1 -- 172.21.15.119:0/880149705 >> v1:172.21.15.119:6789/0 conn(0x7f274c0cf0d0 legacy=0x7f274c1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.497+0000 7f2751dbd640 1 -- 172.21.15.119:0/880149705 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0d0890 con 0x7f274c0cf530 2023-12-19T16:16:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2751dbd640 1 --2- 172.21.15.119:0/880149705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c0cf530 0x7f274c168000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2744009d90 tx=0x7f274401c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700bd0e0ef4f3f37 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c001800 con 0x7f274c0cf530 2023-12-19T16:16:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27440a5680 con 0x7f274c0cf530 2023-12-19T16:16:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2743fff640 1 -- 172.21.15.119:0/880149705 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27440a5a10 con 0x7f274c0cf530 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 -- 172.21.15.119:0/880149705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c0cf530 msgr2=0x7f274c168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 --2- 172.21.15.119:0/880149705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c0cf530 0x7f274c168000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2744009d90 tx=0x7f274401c840 comp rx=0 tx=0).stop 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 -- 172.21.15.119:0/880149705 shutdown_connections 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 --2- 172.21.15.119:0/880149705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c0cf530 0x7f274c168000 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 -- 172.21.15.119:0/880149705 >> 172.21.15.119:0/880149705 conn(0x7f274c089fb0 msgr2=0x7f274c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 -- 172.21.15.119:0/880149705 shutdown_connections 2023-12-19T16:16:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.501+0000 7f2753820640 1 -- 172.21.15.119:0/880149705 wait complete. 2023-12-19T16:16:31.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 Processor -- start 2023-12-19T16:16:31.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 -- start start 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 0x7f274c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f274c0cf530 0x7f274c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c15ca40 0x7f274c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c151380 con 0x7f274c0cf0d0 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0af6e0 con 0x7f274c15ca40 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0b0540 con 0x7f274c0cf530 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 0x7f274c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 0x7f274c150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35276/0 (socket says 172.21.15.119:35276) 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 -- 172.21.15.119:0/3539830095 learned_addr learned my addr 172.21.15.119:0/3539830095 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2751dbd640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c15ca40 0x7f274c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 -- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f274c0cf530 msgr2=0x7f274c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f274c0cf530 0x7f274c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 -- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c15ca40 msgr2=0x7f274c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c15ca40 0x7f274c0b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 -- 172.21.15.119:0/3539830095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2744009a70 con 0x7f274c0cf0d0 2023-12-19T16:16:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f27515bc640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 0x7f274c150e40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f274800c500 tx=0x7f274800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480052d0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748005430 con 0x7f274c0cf0d0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748003850 con 0x7f274c0cf0d0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.505+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c0af930 con 0x7f274c0cf0d0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c0afef0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c04e000 con 0x7f274c0cf0d0 2023-12-19T16:16:31.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27480039b0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2741ffb640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2730065a60 0x7f2730067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f27480831b0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2750dbb640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2730065a60 0x7f2730067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.509+0000 7f2750dbb640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2730065a60 0x7f2730067f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f273c0010f0 tx=0x7f273c0013c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.513+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2748050770 con 0x7f274c0cf0d0 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.693+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f274c157cb0 con 0x7f274c0cf0d0 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2741ffb640 1 -- 172.21.15.119:0/3539830095 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f2748053d90 con 0x7f274c0cf0d0 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2730065a60 msgr2=0x7f2730067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2730065a60 0x7f2730067f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f273c0010f0 tx=0x7f273c0013c0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 msgr2=0x7f274c150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 0x7f274c150e40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f274800c500 tx=0x7f274800c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 shutdown_connections 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2730065a60 0x7f2730067f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f274c15ca40 0x7f274c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f274c0cf530 0x7f274c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 --2- 172.21.15.119:0/3539830095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f274c0cf0d0 0x7f274c150e40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 >> 172.21.15.119:0/3539830095 conn(0x7f274c089fb0 msgr2=0x7f274c0b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 shutdown_connections 2023-12-19T16:16:31.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.697+0000 7f2753820640 1 -- 172.21.15.119:0/3539830095 wait complete. 2023-12-19T16:16:31.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:31.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.853+0000 7f7137273640 1 Processor -- start 2023-12-19T16:16:31.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.853+0000 7f7137273640 1 -- start start 2023-12-19T16:16:31.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.853+0000 7f7137273640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7130160cc0 0x7f71300cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.853+0000 7f7137273640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c1280 0x7f71300cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7137273640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713006fdb0 con 0x7f71300c17d0 2023-12-19T16:16:31.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7137273640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71301654a0 con 0x7f7130160cc0 2023-12-19T16:16:31.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7137273640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71301610a0 con 0x7f71300c1280 2023-12-19T16:16:31.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713500f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7130160cc0 0x7f71300cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7135810640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f71300c17d0 0x7f713006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55536/0 (socket says 172.21.15.119:55536) 2023-12-19T16:16:31.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7135810640 1 -- 172.21.15.119:0/1221136849 learned_addr learned my addr 172.21.15.119:0/1221136849 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:31.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713480e640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c1280 0x7f71300cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713500f640 1 -- 172.21.15.119:0/1221136849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c1280 msgr2=0x7f71300cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713500f640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c1280 0x7f71300cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713500f640 1 -- 172.21.15.119:0/1221136849 >> v1:172.21.15.119:6789/0 conn(0x7f71300c17d0 legacy=0x7f713006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713500f640 1 -- 172.21.15.119:0/1221136849 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300cb6b0 con 0x7f7130160cc0 2023-12-19T16:16:31.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713480e640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c1280 0x7f71300cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:31.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7127fff640 1 -- 172.21.15.119:0/1221136849 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071186682 0 0) 0x7f713006fdb0 con 0x7f71300c17d0 2023-12-19T16:16:31.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f713500f640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7130160cc0 0x7f71300cac30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f712c0097f0 tx=0x7f712c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77edbb09516fb082 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7127fff640 1 -- 172.21.15.119:0/1221136849 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0ab600 con 0x7f7130160cc0 2023-12-19T16:16:31.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7127fff640 1 -- 172.21.15.119:0/1221136849 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c0a7050 con 0x7f7130160cc0 2023-12-19T16:16:31.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.857+0000 7f7127fff640 1 -- 172.21.15.119:0/1221136849 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0ab980 con 0x7f7130160cc0 2023-12-19T16:16:31.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- 172.21.15.119:0/1221136849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7130160cc0 msgr2=0x7f71300cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7130160cc0 0x7f71300cac30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f712c0097f0 tx=0x7f712c01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- 172.21.15.119:0/1221136849 shutdown_connections 2023-12-19T16:16:31.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c1280 0x7f71300cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 --2- 172.21.15.119:0/1221136849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7130160cc0 0x7f71300cac30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- 172.21.15.119:0/1221136849 >> 172.21.15.119:0/1221136849 conn(0x7f713006a3e0 msgr2=0x7f71300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- 172.21.15.119:0/1221136849 shutdown_connections 2023-12-19T16:16:31.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- 172.21.15.119:0/1221136849 wait complete. 2023-12-19T16:16:31.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 Processor -- start 2023-12-19T16:16:31.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- start start 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 0x7f7130153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c17d0 0x7f71300c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7130160cc0 0x7f7130162360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c22d0 con 0x7f71300c1280 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c2520 con 0x7f7130160cc0 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f7137273640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c2800 con 0x7f71300c17d0 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 0x7f7130153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 0x7f7130153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35296/0 (socket says 172.21.15.119:35296) 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 -- 172.21.15.119:0/4173925204 learned_addr learned my addr 172.21.15.119:0/4173925204 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 -- 172.21.15.119:0/4173925204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c17d0 msgr2=0x7f71300c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c17d0 0x7f71300c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 -- 172.21.15.119:0/4173925204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7130160cc0 msgr2=0x7f7130162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7130160cc0 0x7f7130162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.861+0000 7f713500f640 1 -- 172.21.15.119:0/4173925204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c009420 con 0x7f71300c1280 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f713500f640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 0x7f7130153480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f712c01aa70 tx=0x7f712c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c004020 con 0x7f71300c1280 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c004180 con 0x7f71300c1280 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300c2ae0 con 0x7f71300c1280 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0044f0 con 0x7f71300c1280 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300c3820 con 0x7f71300c1280 2023-12-19T16:16:31.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71300735b0 con 0x7f71300c1280 2023-12-19T16:16:31.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.865+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f712c0b2040 con 0x7f71300c1280 2023-12-19T16:16:31.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.869+0000 7f7125ffb640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7114065a60 0x7f7114067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.869+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f712c11d540 con 0x7f71300c1280 2023-12-19T16:16:31.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.869+0000 7f713480e640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7114065a60 0x7f7114067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.869+0000 7f713480e640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7114065a60 0x7f7114067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71300c8830 tx=0x7f7120008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:31.873+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f712c0eaae0 con 0x7f71300c1280 2023-12-19T16:16:32.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.049+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7130164dc0 con 0x7f71300c1280 2023-12-19T16:16:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.049+0000 7f7125ffb640 1 -- 172.21.15.119:0/4173925204 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f7130164dc0 con 0x7f71300c1280 2023-12-19T16:16:32.057 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:32.057 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/630182262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":630182262},{"type":"v1","addr":"172.21.15.143:6834","nonce":630182262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/596695090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":596695090},{"type":"v1","addr":"172.21.15.143:6835","nonce":596695090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3418178143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3418178143},{"type":"v1","addr":"172.21.15.119:6836","nonce":3418178143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:20.558027+0000","modified":"2023-12-19T16:15:43.194399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/2766451211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2766451211},{"type":"v1","addr":"172.21.15.119:6837","nonce":2766451211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 9 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7114065a60 msgr2=0x7f7114067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7114065a60 0x7f7114067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71300c8830 tx=0x7f7120008040 comp rx=0 tx=0).stop 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 msgr2=0x7f7130153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 0x7f7130153480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f712c01aa70 tx=0x7f712c019160 comp rx=0 tx=0).stop 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 shutdown_connections 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7114065a60 0x7f7114067f20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7130160cc0 0x7f7130162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71300c17d0 0x7f71300c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 --2- 172.21.15.119:0/4173925204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71300c1280 0x7f7130153480 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 >> 172.21.15.119:0/4173925204 conn(0x7f713006a3e0 msgr2=0x7f7130070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 shutdown_connections 2023-12-19T16:16:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.053+0000 7f7137273640 1 -- 172.21.15.119:0/4173925204 wait complete. 2023-12-19T16:16:32.078 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.209+0000 7f56c26b6640 1 Processor -- start 2023-12-19T16:16:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.209+0000 7f56c26b6640 1 -- start start 2023-12-19T16:16:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56c26b6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc1570c0 0x7f56bc06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56c26b6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56bc06c320 0x7f56bc0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56c26b6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56bc0c9460 con 0x7f56bc0c9e30 2023-12-19T16:16:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56c26b6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc06c7a0 con 0x7f56bc06c320 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56c26b6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1574a0 con 0x7f56bc1570c0 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56bc06c320 0x7f56bc0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56bc06c320 0x7f56bc0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:36240/0 (socket says 172.21.15.119:36240) 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 -- 172.21.15.119:0/1914326794 learned_addr learned my addr 172.21.15.119:0/1914326794 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56c0c53640 1 --1- 172.21.15.119:0/1914326794 >> v1:172.21.15.143:6789/0 conn(0x7f56bc0c9e30 0x7f56bc15d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:50120/0 (socket says 172.21.15.119:50120) 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bbfff640 1 --2- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc1570c0 0x7f56bc06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 -- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc1570c0 msgr2=0x7f56bc06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 --2- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc1570c0 0x7f56bc06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 -- 172.21.15.119:0/1914326794 >> v1:172.21.15.143:6789/0 conn(0x7f56bc0c9e30 legacy=0x7f56bc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56bb7fe640 1 -- 172.21.15.119:0/1914326794 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc0c8b30 con 0x7f56bc06c320 2023-12-19T16:16:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.213+0000 7f56baffd640 1 -- 172.21.15.119:0/1914326794 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820218163 0 0) 0x7f56bc0c9460 con 0x7f56bc0c9e30 2023-12-19T16:16:32.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56bb7fe640 1 --2- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c98f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009870 tx=0x7f56b001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc496c8d400373 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56baffd640 1 -- 172.21.15.119:0/1914326794 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00ad640 con 0x7f56bc06c320 2023-12-19T16:16:32.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56baffd640 1 -- 172.21.15.119:0/1914326794 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00ad7a0 con 0x7f56bc06c320 2023-12-19T16:16:32.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56baffd640 1 -- 172.21.15.119:0/1914326794 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00adb30 con 0x7f56bc06c320 2023-12-19T16:16:32.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 -- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 msgr2=0x7f56bc0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 --2- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c98f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009870 tx=0x7f56b001c480 comp rx=0 tx=0).stop 2023-12-19T16:16:32.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 -- 172.21.15.119:0/1914326794 shutdown_connections 2023-12-19T16:16:32.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 --2- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c98f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 --2- 172.21.15.119:0/1914326794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc1570c0 0x7f56bc06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 -- 172.21.15.119:0/1914326794 >> 172.21.15.119:0/1914326794 conn(0x7f56bc06a3e0 msgr2=0x7f56bc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 -- 172.21.15.119:0/1914326794 shutdown_connections 2023-12-19T16:16:32.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 -- 172.21.15.119:0/1914326794 wait complete. 2023-12-19T16:16:32.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 Processor -- start 2023-12-19T16:16:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.217+0000 7f56c26b6640 1 -- start start 2023-12-19T16:16:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc0c9e30 0x7f56bc0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 0x7f56bc162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0c7f20 con 0x7f56bc1570c0 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0c6e80 con 0x7f56bc06c320 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0c7160 con 0x7f56bc0c9e30 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 0x7f56bc162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 0x7f56bc162850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35300/0 (socket says 172.21.15.119:35300) 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 -- 172.21.15.119:0/411680776 learned_addr learned my addr 172.21.15.119:0/411680776 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56bb7fe640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc0c9e30 0x7f56bc0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56bbfff640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 -- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc0c9e30 msgr2=0x7f56bc0c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc0c9e30 0x7f56bc0c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 -- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 msgr2=0x7f56bc0c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 -- 172.21.15.119:0/411680776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00094d0 con 0x7f56bc1570c0 2023-12-19T16:16:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c0c53640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 0x7f56bc162850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f56b400caf0 tx=0x7f56b4002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b400a7c0 con 0x7f56bc1570c0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b400a920 con 0x7f56bc1570c0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc0c7440 con 0x7f56bc1570c0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b400ad50 con 0x7f56bc1570c0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc0c7a00 con 0x7f56bc1570c0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc0735b0 con 0x7f56bc1570c0 2023-12-19T16:16:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.221+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f56b4006070 con 0x7f56bc1570c0 2023-12-19T16:16:32.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.225+0000 7f56b8ff9640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f56a8065a60 0x7f56a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.225+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f56b4083170 con 0x7f56bc1570c0 2023-12-19T16:16:32.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.225+0000 7f56bbfff640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f56a8065a60 0x7f56a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.225+0000 7f56bbfff640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f56a8065a60 0x7f56a8067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009ac0 tx=0x7f56ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.229+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f56b40506a0 con 0x7f56bc1570c0 2023-12-19T16:16:32.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56bc0c7bf0 con 0x7f56bc1570c0 2023-12-19T16:16:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56b8ff9640 1 -- 172.21.15.119:0/411680776 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f56b4017020 con 0x7f56bc1570c0 2023-12-19T16:16:32.389 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:32.389 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:02.302031+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:18.672779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:19.549827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T16:15:22.618073+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.16","mappings":[{"from":3,"to":7}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:32.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f56a8065a60 msgr2=0x7f56a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f56a8065a60 0x7f56a8067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009ac0 tx=0x7f56ac009190 comp rx=0 tx=0).stop 2023-12-19T16:16:32.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 msgr2=0x7f56bc162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 0x7f56bc162850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f56b400caf0 tx=0x7f56b4002190 comp rx=0 tx=0).stop 2023-12-19T16:16:32.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 shutdown_connections 2023-12-19T16:16:32.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f56a8065a60 0x7f56a8067f20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56bc1570c0 0x7f56bc162850 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56bc0c9e30 0x7f56bc0c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 --2- 172.21.15.119:0/411680776 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56bc06c320 0x7f56bc0c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.381+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 >> 172.21.15.119:0/411680776 conn(0x7f56bc06a3e0 msgr2=0x7f56bc153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.385+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 shutdown_connections 2023-12-19T16:16:32.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.385+0000 7f56c26b6640 1 -- 172.21.15.119:0/411680776 wait complete. 2023-12-19T16:16:32.410 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:16:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 Processor -- start 2023-12-19T16:16:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 -- start start 2023-12-19T16:16:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbbd80ae040 0x7fbbd806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbbd806d170 0x7fbbd80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80cccf0 con 0x7fbbd80ce290 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80ce720 con 0x7fbbd80ae040 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbdcb60640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80ae420 con 0x7fbbd806d170 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbbd80ae040 0x7fbbd806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbbd80ae040 0x7fbbd806cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41702/0 (socket says 172.21.15.119:41702) 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 -- 172.21.15.119:0/3249912693 learned_addr learned my addr 172.21.15.119:0/3249912693 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbcffff640 1 --2- 172.21.15.119:0/3249912693 >> v2:172.21.15.143:3300/0 conn(0x7fbbd806d170 0x7fbbd80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 -- 172.21.15.119:0/3249912693 >> v2:172.21.15.143:3300/0 conn(0x7fbbd806d170 msgr2=0x7fbbd80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 --2- 172.21.15.119:0/3249912693 >> v2:172.21.15.143:3300/0 conn(0x7fbbd806d170 0x7fbbd80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 -- 172.21.15.119:0/3249912693 >> v1:172.21.15.143:6789/0 conn(0x7fbbd80ce290 legacy=0x7fbbd80c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.545+0000 7fbbd659c640 1 -- 172.21.15.119:0/3249912693 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80ccf90 con 0x7fbbd80ae040 2023-12-19T16:16:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbd659c640 1 --2- 172.21.15.119:0/3249912693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd806cc30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80cc710 tx=0x7fbbc801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff78f852c019201 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbd5d9b640 1 -- 172.21.15.119:0/3249912693 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80ac600 con 0x7fbbd80ae040 2023-12-19T16:16:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbd5d9b640 1 -- 172.21.15.119:0/3249912693 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80a8050 con 0x7fbbd80ae040 2023-12-19T16:16:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbd5d9b640 1 -- 172.21.15.119:0/3249912693 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80ac980 con 0x7fbbd80ae040 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3249912693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 msgr2=0x7fbbd806cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3249912693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd806cc30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80cc710 tx=0x7fbbc801c490 comp rx=0 tx=0).stop 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3249912693 shutdown_connections 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3249912693 >> v2:172.21.15.143:3300/0 conn(0x7fbbd806d170 0x7fbbd80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3249912693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd806cc30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3249912693 >> 172.21.15.119:0/3249912693 conn(0x7fbbd80cb610 msgr2=0x7fbbd80cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3249912693 shutdown_connections 2023-12-19T16:16:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.549+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3249912693 wait complete. 2023-12-19T16:16:32.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 Processor -- start 2023-12-19T16:16:32.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 -- start start 2023-12-19T16:16:32.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbd806d170 0x7fbbd80c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd81f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd80ce290 0x7fbbd81f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.560 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd81528d0 con 0x7fbbd80ae040 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80c74d0 con 0x7fbbd80ce290 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80b2cf0 con 0x7fbbd806d170 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd81f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd81f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41712/0 (socket says 172.21.15.119:41712) 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 -- 172.21.15.119:0/3911881767 learned_addr learned my addr 172.21.15.119:0/3911881767 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbd659c640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbd806d170 0x7fbbd80c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbd6d9d640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd80ce290 0x7fbbd81f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 -- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbd806d170 msgr2=0x7fbbd80c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbd806d170 0x7fbbd80c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 -- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd80ce290 msgr2=0x7fbbd81f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd80ce290 0x7fbbd81f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 -- 172.21.15.119:0/3911881767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80094d0 con 0x7fbbd80ae040 2023-12-19T16:16:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbcffff640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd81f89c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000d5f0 tx=0x7fbbc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00125f0 con 0x7fbbd80ae040 2023-12-19T16:16:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0012750 con 0x7fbbd80ae040 2023-12-19T16:16:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd80c6620 con 0x7fbbd80ae040 2023-12-19T16:16:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0012ae0 con 0x7fbbd80ae040 2023-12-19T16:16:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.553+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd80c6e80 con 0x7fbbd80ae040 2023-12-19T16:16:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.557+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd804e000 con 0x7fbbd80ae040 2023-12-19T16:16:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.557+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbbc0012c40 con 0x7fbbd80ae040 2023-12-19T16:16:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.557+0000 7fbbceffd640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb8065a60 0x7fbbb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.557+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fbbc0083aa0 con 0x7fbbd80ae040 2023-12-19T16:16:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.557+0000 7fbbd659c640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb8065a60 0x7fbbb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.557+0000 7fbbd659c640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb8065a60 0x7fbbb8067f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80ae000 tx=0x7fbbc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.561+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbbc0051030 con 0x7fbbd80ae040 2023-12-19T16:16:32.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.745+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbbd80b2e80 con 0x7fbbd80ae040 2023-12-19T16:16:32.753 INFO:tasks.ceph.mon.a.smithi119.stderr:2023-12-19T16:16:32.749+0000 7f5651957640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:16:32.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.757+0000 7fbbceffd640 1 -- 172.21.15.119:0/3911881767 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbbc0007380 con 0x7fbbd80ae040 2023-12-19T16:16:32.764 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb8065a60 msgr2=0x7fbbb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb8065a60 0x7fbbb8067f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80ae000 tx=0x7fbbc8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 msgr2=0x7fbbd81f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd81f89c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000d5f0 tx=0x7fbbc000dab0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 shutdown_connections 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbbb8065a60 0x7fbbb8067f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbd80ce290 0x7fbbd81f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbd80ae040 0x7fbbd81f89c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 --2- 172.21.15.119:0/3911881767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbd806d170 0x7fbbd80c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 >> 172.21.15.119:0/3911881767 conn(0x7fbbd80cb610 msgr2=0x7fbbd80af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 shutdown_connections 2023-12-19T16:16:32.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.761+0000 7fbbdcb60640 1 -- 172.21.15.119:0/3911881767 wait complete. 2023-12-19T16:16:32.772 INFO:tasks.ceph.mds.a.smithi119.stderr: -4158> 2023-12-19T16:15:25.000+0000 7fbf2939b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:16:32.787 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:16:32.822 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2023-12-19T16:16:32.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 Processor -- start 2023-12-19T16:16:32.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 -- start start 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2200153020 0x7f22000c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22001598d0 0x7f22000ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22000c9730 con 0x7f22000ce8d0 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22000ced60 con 0x7f22001598d0 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f2205796640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22000c8e00 con 0x7f2200153020 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22001598d0 0x7f22000ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22001598d0 0x7f22000ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41720/0 (socket says 172.21.15.119:41720) 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 -- 172.21.15.119:0/3088133405 learned_addr learned my addr 172.21.15.119:0/3088133405 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21feffd640 1 --2- 172.21.15.119:0/3088133405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2200153020 0x7f22000c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 -- 172.21.15.119:0/3088133405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2200153020 msgr2=0x7f22000c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 --2- 172.21.15.119:0/3088133405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2200153020 0x7f22000c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 -- 172.21.15.119:0/3088133405 >> v1:172.21.15.119:6789/0 conn(0x7f22000ce8d0 legacy=0x7f2200070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21f67fc640 1 -- 172.21.15.119:0/3088133405 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22000c90e0 con 0x7f22001598d0 2023-12-19T16:16:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.925+0000 7f21fe7fc640 1 -- 172.21.15.119:0/3088133405 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341042630 0 0) 0x7f22000c9730 con 0x7f22000ce8d0 2023-12-19T16:16:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f21f67fc640 1 --2- 172.21.15.119:0/3088133405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22001598d0 0x7f22000ce390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f21e8006fd0 tx=0x7f21e801e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f2700dd36ceac1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f21fe7fc640 1 -- 172.21.15.119:0/3088133405 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8004230 con 0x7f22001598d0 2023-12-19T16:16:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f21fe7fc640 1 -- 172.21.15.119:0/3088133405 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80ab070 con 0x7f22001598d0 2023-12-19T16:16:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f21fe7fc640 1 -- 172.21.15.119:0/3088133405 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80a7690 con 0x7f22001598d0 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 -- 172.21.15.119:0/3088133405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22001598d0 msgr2=0x7f22000ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 --2- 172.21.15.119:0/3088133405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22001598d0 0x7f22000ce390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f21e8006fd0 tx=0x7f21e801e880 comp rx=0 tx=0).stop 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 -- 172.21.15.119:0/3088133405 shutdown_connections 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 --2- 172.21.15.119:0/3088133405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22001598d0 0x7f22000ce390 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 --2- 172.21.15.119:0/3088133405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2200153020 0x7f22000c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 -- 172.21.15.119:0/3088133405 >> 172.21.15.119:0/3088133405 conn(0x7f220006a2a0 msgr2=0x7f22000aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 -- 172.21.15.119:0/3088133405 shutdown_connections 2023-12-19T16:16:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.929+0000 7f2205796640 1 -- 172.21.15.119:0/3088133405 wait complete. 2023-12-19T16:16:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 Processor -- start 2023-12-19T16:16:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 -- start start 2023-12-19T16:16:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22000ce8d0 0x7f22000af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 0x7f22001481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22001598d0 0x7f22000b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22000c6210 con 0x7f2200153020 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22000ae390 con 0x7f22000ce8d0 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22000ae670 con 0x7f22001598d0 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 0x7f22001481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 0x7f22001481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41734/0 (socket says 172.21.15.119:41734) 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 -- 172.21.15.119:0/856859234 learned_addr learned my addr 172.21.15.119:0/856859234 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 -- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22001598d0 msgr2=0x7f22000b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21feffd640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22000ce8d0 0x7f22000af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21ff7fe640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22001598d0 0x7f22000b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22001598d0 0x7f22000b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 -- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22000ce8d0 msgr2=0x7f22000af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22000ce8d0 0x7f22000af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 -- 172.21.15.119:0/856859234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e800b780 con 0x7f2200153020 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21feffd640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22000ce8d0 0x7f22000af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21ff7fe640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22001598d0 0x7f22000b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f67fc640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 0x7f22001481d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f21e8006fd0 tx=0x7f21e801b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80a7a20 con 0x7f2200153020 2023-12-19T16:16:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80a7b80 con 0x7f2200153020 2023-12-19T16:16:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22000ae950 con 0x7f2200153020 2023-12-19T16:16:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.933+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8003620 con 0x7f2200153020 2023-12-19T16:16:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22000aef10 con 0x7f2200153020 2023-12-19T16:16:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22000af100 con 0x7f2200153020 2023-12-19T16:16:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f21e80b9050 con 0x7f2200153020 2023-12-19T16:16:32.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f21f7fff640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f21e0065a60 0x7f21e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:32.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f21e811f7d0 con 0x7f2200153020 2023-12-19T16:16:32.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f21feffd640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f21e0065a60 0x7f21e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:32.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.937+0000 7f21feffd640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f21e0065a60 0x7f21e0067f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009f50 tx=0x7f21f000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:32.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:32.941+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f21e80ecd30 con 0x7f2200153020 2023-12-19T16:16:33.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.129+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f220004e000 con 0x7f2200153020 2023-12-19T16:16:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f21f7fff640 1 -- 172.21.15.119:0/856859234 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21e80f0350 con 0x7f2200153020 2023-12-19T16:16:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f21e0065a60 msgr2=0x7f21e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f21e0065a60 0x7f21e0067f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009f50 tx=0x7f21f000b040 comp rx=0 tx=0).stop 2023-12-19T16:16:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 msgr2=0x7f22001481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 0x7f22001481d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f21e8006fd0 tx=0x7f21e801b620 comp rx=0 tx=0).stop 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 shutdown_connections 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f21e0065a60 0x7f21e0067f20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22001598d0 0x7f22000b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2200153020 0x7f22001481d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 --2- 172.21.15.119:0/856859234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22000ce8d0 0x7f22000af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.761+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 >> 172.21.15.119:0/856859234 conn(0x7f220006a2a0 msgr2=0x7f220015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.765+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 shutdown_connections 2023-12-19T16:16:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.765+0000 7f2205796640 1 -- 172.21.15.119:0/856859234 wait complete. 2023-12-19T16:16:33.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:16:33.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 Processor -- start 2023-12-19T16:16:33.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 -- start start 2023-12-19T16:16:33.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15a80d07c0 0x7f15a80d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15a80d12b0 0x7f15a806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a80af360 con 0x7f15a815cab0 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80d1740 con 0x7f15a80d07c0 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15ad18f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80ce6b0 con 0x7f15a80d12b0 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a6d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f15a815cab0 0x7f15a80cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52874/0 (socket says 172.21.15.119:52874) 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a6d9d640 1 -- 172.21.15.119:0/3823073681 learned_addr learned my addr 172.21.15.119:0/3823073681 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476375368 0 0) 0x7f15a80af360 con 0x7f15a815cab0 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f159ffff640 1 --2- 172.21.15.119:0/3823073681 >> v2:172.21.15.143:3300/0 conn(0x7f15a80d07c0 0x7f15a80d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a759e640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15a80d12b0 0x7f15a806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1594003530 con 0x7f15a815cab0 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244556753 0 0) 0x7f1594003530 con 0x7f15a815cab0 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15a80d12b0 msgr2=0x7f15a806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15a80d12b0 0x7f15a806bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 >> v2:172.21.15.143:3300/0 conn(0x7f15a80d07c0 msgr2=0x7f15a80d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 --2- 172.21.15.119:0/3823073681 >> v2:172.21.15.143:3300/0 conn(0x7f15a80d07c0 0x7f15a80d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.969+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a806ae90 con 0x7f15a815cab0 2023-12-19T16:16:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f1598001680 con 0x7f15a815cab0 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 >> v1:172.21.15.119:6789/0 conn(0x7f15a815cab0 legacy=0x7f15a80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1594003980 0x7f1594003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15940047d0 0x7f1594004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594005190 0x7f159400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80d1740 con 0x7f1594003980 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80ce6b0 con 0x7f15940047d0 2023-12-19T16:16:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159400bf00 con 0x7f1594005190 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a759e640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15a80d12b0 0x7f15a806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1594003980 0x7f1594003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f159ffff640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15940047d0 0x7f1594004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a759e640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594005190 0x7f159400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 -- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594005190 msgr2=0x7f159400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594005190 0x7f159400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 -- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15940047d0 msgr2=0x7f1594004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15940047d0 0x7f1594004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 -- 172.21.15.119:0/3823073681 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594003530 con 0x7f1594003980 2023-12-19T16:16:33.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1594003980 0x7f1594003da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f159800c240 tx=0x7f159801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81467492ec06f9fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:33.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15980058e0 con 0x7f1594003980 2023-12-19T16:16:33.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598005a40 con 0x7f1594003980 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.973+0000 7f15a659c640 1 -- 172.21.15.119:0/3823073681 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598005e10 con 0x7f1594003980 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- 172.21.15.119:0/3823073681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1594003980 msgr2=0x7f1594003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 --2- 172.21.15.119:0/3823073681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1594003980 0x7f1594003da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f159800c240 tx=0x7f159801cc00 comp rx=0 tx=0).stop 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15a759e640 1 -- 172.21.15.119:0/3823073681 reap_dead start 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- 172.21.15.119:0/3823073681 shutdown_connections 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- 172.21.15.119:0/3823073681 >> 172.21.15.119:0/3823073681 conn(0x7f15a8089fb0 msgr2=0x7f15a80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- 172.21.15.119:0/3823073681 shutdown_connections 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- 172.21.15.119:0/3823073681 wait complete. 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 Processor -- start 2023-12-19T16:16:33.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- start start 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594003980 0x7f15a80b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a815d830 0x7f15a80b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 0x7f15a8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81550c0 con 0x7f15a80b2da0 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80b3220 con 0x7f15a815d830 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15ad18f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a815d3a0 con 0x7f1594003980 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15a759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 0x7f15a8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15a759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 0x7f15a8153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41750/0 (socket says 172.21.15.119:41750) 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15a759e640 1 -- 172.21.15.119:0/896942783 learned_addr learned my addr 172.21.15.119:0/896942783 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f159ffff640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a815d830 0x7f15a80b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.977+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594003980 0x7f15a80b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15a759e640 1 -- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594003980 msgr2=0x7f15a80b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15a759e640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594003980 0x7f15a80b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15a759e640 1 -- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a815d830 msgr2=0x7f15a80b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15a759e640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a815d830 0x7f15a80b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15a759e640 1 -- 172.21.15.119:0/896942783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8154b00 con 0x7f15a80b2da0 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15a759e640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 0x7f15a8153060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f15a806ab40 tx=0x7f15a0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00048a0 con 0x7f15a80b2da0 2023-12-19T16:16:33.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a000f050 con 0x7f15a80b2da0 2023-12-19T16:16:33.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0014630 con 0x7f15a80b2da0 2023-12-19T16:16:33.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a8154de0 con 0x7f15a80b2da0 2023-12-19T16:16:33.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a814f560 con 0x7f15a80b2da0 2023-12-19T16:16:33.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a815ce90 con 0x7f15a80b2da0 2023-12-19T16:16:33.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f15a0014790 con 0x7f15a80b2da0 2023-12-19T16:16:33.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f159f7fe640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1588065a90 0x7f1588067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.981+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f15a0083a10 con 0x7f15a80b2da0 2023-12-19T16:16:33.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.985+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1588065a90 0x7f1588067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.985+0000 7f15a6d9d640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1588065a90 0x7f1588067f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15980aa000 tx=0x7f1598001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:33.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:33.985+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f15a815ce90 con 0x7f15a80b2da0 2023-12-19T16:16:34.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.137+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f15a815ce90 con 0x7f15a80b2da0 2023-12-19T16:16:34.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.769+0000 7f159f7fe640 1 -- 172.21.15.119:0/896942783 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f15a815ce90 con 0x7f15a80b2da0 2023-12-19T16:16:34.776 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:16:34.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1588065a90 msgr2=0x7f1588067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1588065a90 0x7f1588067f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15980aa000 tx=0x7f1598001a80 comp rx=0 tx=0).stop 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 msgr2=0x7f15a8153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 0x7f15a8153060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f15a806ab40 tx=0x7f15a0007700 comp rx=0 tx=0).stop 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 shutdown_connections 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1588065a90 0x7f1588067f50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a815d830 0x7f15a80b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a80b2da0 0x7f15a8153060 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 --2- 172.21.15.119:0/896942783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1594003980 0x7f15a80b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 >> 172.21.15.119:0/896942783 conn(0x7f15a8089fb0 msgr2=0x7f15a8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 shutdown_connections 2023-12-19T16:16:34.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.773+0000 7f15ad18f640 1 -- 172.21.15.119:0/896942783 wait complete. 2023-12-19T16:16:34.804 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:16:34.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b4d77b640 1 Processor -- start 2023-12-19T16:16:34.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b4d77b640 1 -- start start 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b4d77b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2b480d2b30 0x7f2b4806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b4d77b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48160130 con 0x7f2b4806c260 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b4d77b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b480af840 con 0x7f2b4815fd50 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b4d77b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4806ca10 con 0x7f2b480d2b30 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b477fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2b4806c260 0x7f2b480afcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52878/0 (socket says 172.21.15.119:52878) 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b477fe640 1 -- 172.21.15.119:0/1506921267 learned_addr learned my addr 172.21.15.119:0/1506921267 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b467fc640 1 --2- 172.21.15.119:0/1506921267 >> v2:172.21.15.143:3300/0 conn(0x7f2b480d2b30 0x7f2b4806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247912782 0 0) 0x7f2b48160130 con 0x7f2b4806c260 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b30003530 con 0x7f2b4806c260 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2850738403 0 0) 0x7f2b30003530 con 0x7f2b4806c260 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 >> v2:172.21.15.143:3300/0 conn(0x7f2b480d2b30 msgr2=0x7f2b4806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 --2- 172.21.15.119:0/1506921267 >> v2:172.21.15.143:3300/0 conn(0x7f2b480d2b30 0x7f2b4806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 >> v1:172.21.15.143:6789/0 conn(0x7f2b4815fd50 legacy=0x7f2b480d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480af1f0 con 0x7f2b4806c260 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f2b40001a00 con 0x7f2b4806c260 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 >> v1:172.21.15.119:6789/0 conn(0x7f2b4806c260 legacy=0x7f2b480afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b30003980 0x7f2b30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b300047d0 0x7f2b30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30005190 0x7f2b3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4806ca10 con 0x7f2b30003980 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3000c030 con 0x7f2b300047d0 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3000c1f0 con 0x7f2b30005190 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b30003980 0x7f2b30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b467fc640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b300047d0 0x7f2b30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b477fe640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30005190 0x7f2b3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b46ffd640 1 -- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30005190 msgr2=0x7f2b3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30005190 0x7f2b3000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b46ffd640 1 -- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b300047d0 msgr2=0x7f2b30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b300047d0 0x7f2b30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b46ffd640 1 -- 172.21.15.119:0/1506921267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30003530 con 0x7f2b30003980 2023-12-19T16:16:34.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.941+0000 7f2b477fe640 1 -- 172.21.15.119:0/1506921267 reap_dead start 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b30003980 0x7f2b30003da0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b380017b0 tx=0x7f2b3801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f077b0ac42052029 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380052d0 con 0x7f2b30003980 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b380a7050 con 0x7f2b30003980 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b45ffb640 1 -- 172.21.15.119:0/1506921267 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38003650 con 0x7f2b30003980 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 -- 172.21.15.119:0/1506921267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b30003980 msgr2=0x7f2b30003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b30003980 0x7f2b30003da0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b380017b0 tx=0x7f2b3801c3b0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 -- 172.21.15.119:0/1506921267 shutdown_connections 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/1506921267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b30003980 0x7f2b30003da0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 -- 172.21.15.119:0/1506921267 >> 172.21.15.119:0/1506921267 conn(0x7f2b48089fb0 msgr2=0x7f2b4809b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 -- 172.21.15.119:0/1506921267 shutdown_connections 2023-12-19T16:16:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.945+0000 7f2b4d77b640 1 -- 172.21.15.119:0/1506921267 wait complete. 2023-12-19T16:16:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 Processor -- start 2023-12-19T16:16:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 -- start start 2023-12-19T16:16:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30003980 0x7f2b4815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 0x7f2b480b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b480b5250 0x7f2b480b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480b10a0 con 0x7f2b480b06e0 2023-12-19T16:16:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480b5f80 con 0x7f2b480b5250 2023-12-19T16:16:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480b6260 con 0x7f2b30003980 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 0x7f2b480b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 0x7f2b480b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41762/0 (socket says 172.21.15.119:41762) 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 -- 172.21.15.119:0/3642252704 learned_addr learned my addr 172.21.15.119:0/3642252704 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30003980 0x7f2b4815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b477fe640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b480b5250 0x7f2b480b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 -- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30003980 msgr2=0x7f2b4815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30003980 0x7f2b4815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 -- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b480b5250 msgr2=0x7f2b480b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b480b5250 0x7f2b480b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 -- 172.21.15.119:0/3642252704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480b6540 con 0x7f2b480b06e0 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b467fc640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 0x7f2b480b0b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c011870 tx=0x7f2b3c011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c0095b0 con 0x7f2b480b06e0 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c004240 con 0x7f2b480b06e0 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b480c7740 con 0x7f2b480b06e0 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00f820 con 0x7f2b480b06e0 2023-12-19T16:16:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.949+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b480b5c40 con 0x7f2b480b06e0 2023-12-19T16:16:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.953+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b480c75a0 con 0x7f2b480b06e0 2023-12-19T16:16:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.953+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b3c00f980 con 0x7f2b480b06e0 2023-12-19T16:16:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.953+0000 7f2b2f7fe640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b34065a90 0x7f2b34067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.953+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f2b3c0838e0 con 0x7f2b480b06e0 2023-12-19T16:16:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.953+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b34065a90 0x7f2b34067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.953+0000 7f2b46ffd640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b34065a90 0x7f2b34067f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b380ac000 tx=0x7f2b380011f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:34.957+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b480c75a0 con 0x7f2b480b06e0 2023-12-19T16:16:35.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.109+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b480c75a0 con 0x7f2b480b06e0 2023-12-19T16:16:35.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.777+0000 7f2b2f7fe640 1 -- 172.21.15.119:0/3642252704 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2b480c75a0 con 0x7f2b480b06e0 2023-12-19T16:16:35.786 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2023-12-19T16:16:35.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b34065a90 msgr2=0x7f2b34067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b34065a90 0x7f2b34067f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b380ac000 tx=0x7f2b380011f0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 msgr2=0x7f2b480b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 0x7f2b480b0b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c011870 tx=0x7f2b3c011d30 comp rx=0 tx=0).stop 2023-12-19T16:16:35.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 shutdown_connections 2023-12-19T16:16:35.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2b34065a90 0x7f2b34067f50 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b380ac000 tx=0x7f2b380011f0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b480b5250 0x7f2b480b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b480b06e0 0x7f2b480b0b60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 --2- 172.21.15.119:0/3642252704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b30003980 0x7f2b4815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.781+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 >> 172.21.15.119:0/3642252704 conn(0x7f2b48089fb0 msgr2=0x7f2b480b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.785+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 shutdown_connections 2023-12-19T16:16:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.785+0000 7f2b4d77b640 1 -- 172.21.15.119:0/3642252704 wait complete. 2023-12-19T16:16:35.815 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-19T16:16:35.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceaf066640 1 Processor -- start 2023-12-19T16:16:35.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceaf066640 1 -- start start 2023-12-19T16:16:35.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceaf066640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea806d440 0x7fcea806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceaf066640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80b28a0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceaf066640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea815ab30 con 0x7fcea80ab190 2023-12-19T16:16:35.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceaf066640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80b1c90 con 0x7fcea806d440 2023-12-19T16:16:35.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceace02640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcea80ce5d0 0x7fcea80ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52888/0 (socket says 172.21.15.119:52888) 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fceace02640 1 -- 172.21.15.119:0/4292159092 learned_addr learned my addr 172.21.15.119:0/4292159092 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9ffff640 1 --2- 172.21.15.119:0/4292159092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea806d440 0x7fcea806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768305760 0 0) 0x7fcea80b28a0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce90003530 con 0x7fcea80ce5d0 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269053093 0 0) 0x7fcea815ab30 con 0x7fcea80ab190 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea80b28a0 con 0x7fcea80ab190 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9ffff640 1 -- 172.21.15.119:0/4292159092 >> v1:172.21.15.143:6789/0 conn(0x7fcea80ab190 legacy=0x7fcea80ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9ffff640 1 -- 172.21.15.119:0/4292159092 >> v1:172.21.15.119:6789/0 conn(0x7fcea80ce5d0 legacy=0x7fcea80ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.961+0000 7fce9ffff640 1 -- 172.21.15.119:0/4292159092 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80b1f70 con 0x7fcea806d440 2023-12-19T16:16:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fce9ffff640 1 --2- 172.21.15.119:0/4292159092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea806d440 0x7fcea806d8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce980097f0 tx=0x7fce9801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba99aa9f92bdbd33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980aa610 con 0x7fcea806d440 2023-12-19T16:16:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce980a6040 con 0x7fcea806d440 2023-12-19T16:16:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fce9f7fe640 1 -- 172.21.15.119:0/4292159092 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980aa990 con 0x7fcea806d440 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 -- 172.21.15.119:0/4292159092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea806d440 msgr2=0x7fcea806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 --2- 172.21.15.119:0/4292159092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea806d440 0x7fcea806d8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce980097f0 tx=0x7fce9801c490 comp rx=0 tx=0).stop 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 -- 172.21.15.119:0/4292159092 shutdown_connections 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 --2- 172.21.15.119:0/4292159092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea806d440 0x7fcea806d8a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 -- 172.21.15.119:0/4292159092 >> 172.21.15.119:0/4292159092 conn(0x7fcea8069e70 msgr2=0x7fcea806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 -- 172.21.15.119:0/4292159092 shutdown_connections 2023-12-19T16:16:35.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.965+0000 7fceaf066640 1 -- 172.21.15.119:0/4292159092 wait complete. 2023-12-19T16:16:35.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 Processor -- start 2023-12-19T16:16:35.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- start start 2023-12-19T16:16:35.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcea806d440 0x7fcea8155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea80ab190 0x7fcea81f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 0x7fcea80b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81f4930 con 0x7fcea80ce5d0 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81f4c10 con 0x7fcea806d440 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81f4ef0 con 0x7fcea80ab190 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 0x7fcea80b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 0x7fcea80b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41770/0 (socket says 172.21.15.119:41770) 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 -- 172.21.15.119:0/620454056 learned_addr learned my addr 172.21.15.119:0/620454056 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceace02640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcea806d440 0x7fcea8155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fce9ffff640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea80ab190 0x7fcea81f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 -- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea80ab190 msgr2=0x7fcea81f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea80ab190 0x7fcea81f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 -- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcea806d440 msgr2=0x7fcea8155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcea806d440 0x7fcea8155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 -- 172.21.15.119:0/620454056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98009420 con 0x7fcea80ce5d0 2023-12-19T16:16:35.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fcead603640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 0x7fcea80b0d00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c790 tx=0x7fcea000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000cea0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0003b80 con 0x7fcea80ce5d0 2023-12-19T16:16:35.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000a850 con 0x7fcea80ce5d0 2023-12-19T16:16:35.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea81f51d0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea81560d0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.969+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea81f56f0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.973+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcea000a9b0 con 0x7fcea80ce5d0 2023-12-19T16:16:35.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.973+0000 7fce9d7fa640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fce94065a60 0x7fce94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.973+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5810+0+0 (secure 0 0 0) 0x7fcea0083010 con 0x7fcea80ce5d0 2023-12-19T16:16:35.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.973+0000 7fceace02640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fce94065a60 0x7fce94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.973+0000 7fceace02640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fce94065a60 0x7fce94067f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcea40011f0 tx=0x7fcea4007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:35.977+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcea81f56f0 con 0x7fcea80ce5d0 2023-12-19T16:16:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.149+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcea81f56f0 con 0x7fcea80ce5d0 2023-12-19T16:16:36.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.785+0000 7fce9d7fa640 1 -- 172.21.15.119:0/620454056 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fcea81f56f0 con 0x7fcea80ce5d0 2023-12-19T16:16:36.791 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data_ec' removed 2023-12-19T16:16:36.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fce94065a60 msgr2=0x7fce94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fce94065a60 0x7fce94067f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcea40011f0 tx=0x7fcea4007d40 comp rx=0 tx=0).stop 2023-12-19T16:16:36.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 msgr2=0x7fcea80b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 0x7fcea80b0d00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c790 tx=0x7fcea000cc50 comp rx=0 tx=0).stop 2023-12-19T16:16:36.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 shutdown_connections 2023-12-19T16:16:36.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fce94065a60 0x7fce94067f20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcea80ce5d0 0x7fcea80b0d00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcea80ab190 0x7fcea81f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 --2- 172.21.15.119:0/620454056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcea806d440 0x7fcea8155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 >> 172.21.15.119:0/620454056 conn(0x7fcea8069e70 msgr2=0x7fcea806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 shutdown_connections 2023-12-19T16:16:36.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:36.789+0000 7fceaf066640 1 -- 172.21.15.119:0/620454056 wait complete. 2023-12-19T16:16:36.815 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:16:36.815 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:16:36.816 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:16:36.816 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:36.816 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:16:36.816 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:16:36.816 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:16:36.816 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:36.816 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:16:36.817 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:16:36.817 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:16:36.817 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:36.817 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:16:36.817 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T16:16:36.817 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:16:36.817 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:36.828 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:16:36.828 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:16:36.829 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:16:36.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:16:36.832 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:16:36.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:16:36.833 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:16:36.833 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:16:36.876 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:16:36.876 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:36.878 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:16:36.878 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:36.881 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:16:36.882 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:36.883 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:16:36.884 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:36.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T16:16:36.963 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2023-12-19T16:16:36.965 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2023-12-19T16:16:36.977 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-19T16:16:36.978 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-19T16:16:37.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.037+0000 7f5af3012640 1 Processor -- start 2023-12-19T16:16:37.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af3012640 1 -- start start 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af3012640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af3012640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5aec0c9e30 0x7f5aec070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af3012640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec0c9460 con 0x7f5aec1570c0 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af3012640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec1574a0 con 0x7f5aec0c9e30 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af3012640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0c8b30 con 0x7f5aec06c4f0 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5aec0c9e30 0x7f5aec070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5aec0c9e30 0x7f5aec070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41816/0 (socket says 172.21.15.119:41816) 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 -- 172.21.15.119:0/2829557361 learned_addr learned my addr 172.21.15.119:0/2829557361 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5aebfff640 1 --2- 172.21.15.119:0/2829557361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:37.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 -- 172.21.15.119:0/2829557361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 msgr2=0x7f5aec0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:37.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 --2- 172.21.15.119:0/2829557361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 -- 172.21.15.119:0/2829557361 >> v1:172.21.15.143:6789/0 conn(0x7f5aec1570c0 legacy=0x7f5aec06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:37.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5af15af640 1 -- 172.21.15.119:0/2829557361 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0c8e10 con 0x7f5aec0c9e30 2023-12-19T16:16:37.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.041+0000 7f5aeb7fe640 1 -- 172.21.15.119:0/2829557361 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170605707 0 0) 0x7f5aec0c9460 con 0x7f5aec1570c0 2023-12-19T16:16:37.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af15af640 1 --2- 172.21.15.119:0/2829557361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec070df0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009e50 tx=0x7f5ae401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c9df4edba05f2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:37.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5aeb7fe640 1 -- 172.21.15.119:0/2829557361 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40a5720 con 0x7f5aec0c9e30 2023-12-19T16:16:37.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5aeb7fe640 1 -- 172.21.15.119:0/2829557361 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae40a5880 con 0x7f5aec0c9e30 2023-12-19T16:16:37.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5aeb7fe640 1 -- 172.21.15.119:0/2829557361 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40a5c10 con 0x7f5aec0c9e30 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 -- 172.21.15.119:0/2829557361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 msgr2=0x7f5aec070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 --2- 172.21.15.119:0/2829557361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec070df0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009e50 tx=0x7f5ae401c950 comp rx=0 tx=0).stop 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 -- 172.21.15.119:0/2829557361 shutdown_connections 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 --2- 172.21.15.119:0/2829557361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec070df0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 --2- 172.21.15.119:0/2829557361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 -- 172.21.15.119:0/2829557361 >> 172.21.15.119:0/2829557361 conn(0x7f5aec06a3e0 msgr2=0x7f5aec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 -- 172.21.15.119:0/2829557361 shutdown_connections 2023-12-19T16:16:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 -- 172.21.15.119:0/2829557361 wait complete. 2023-12-19T16:16:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 Processor -- start 2023-12-19T16:16:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.045+0000 7f5af3012640 1 -- start start 2023-12-19T16:16:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec1f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aec1570c0 0x7f5aec157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec153fa0 con 0x7f5aec0c9e30 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec15a540 con 0x7f5aec1570c0 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0c87f0 con 0x7f5aec06c4f0 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec1f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec1f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41820/0 (socket says 172.21.15.119:41820) 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 -- 172.21.15.119:0/2348602186 learned_addr learned my addr 172.21.15.119:0/2348602186 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af0dae640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af15af640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aec1570c0 0x7f5aec157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 -- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 msgr2=0x7f5aec153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 -- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aec1570c0 msgr2=0x7f5aec157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aec1570c0 0x7f5aec157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 -- 172.21.15.119:0/2348602186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4009b30 con 0x7f5aec0c9e30 2023-12-19T16:16:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5aebfff640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec1f57c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800e870 tx=0x7f5ad800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8009510 con 0x7f5aec0c9e30 2023-12-19T16:16:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad800eec0 con 0x7f5aec0c9e30 2023-12-19T16:16:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec0adf30 con 0x7f5aec0c9e30 2023-12-19T16:16:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800cb40 con 0x7f5aec0c9e30 2023-12-19T16:16:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec159f80 con 0x7f5aec0c9e30 2023-12-19T16:16:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.049+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec0735b0 con 0x7f5aec0c9e30 2023-12-19T16:16:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.053+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5ad800ccc0 con 0x7f5aec0c9e30 2023-12-19T16:16:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.053+0000 7f5ae97fa640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ad0065a60 0x7f5ad0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.053+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5ad8083380 con 0x7f5aec0c9e30 2023-12-19T16:16:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.053+0000 7f5af0dae640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ad0065a60 0x7f5ad0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.053+0000 7f5af0dae640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ad0065a60 0x7f5ad0067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0c7d60 tx=0x7f5ae0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.057+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5ad8050fa0 con 0x7f5aec0c9e30 2023-12-19T16:16:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:37.217+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5aec04e000 con 0x7f5aec0c9e30 2023-12-19T16:16:38.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5ae97fa640 1 -- 172.21.15.119:0/2348602186 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ad80545c0 con 0x7f5aec0c9e30 2023-12-19T16:16:38.006 INFO:teuthology.orchestra.run.smithi119.stderr: removed all blocklist entries 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ad0065a60 msgr2=0x7f5ad0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ad0065a60 0x7f5ad0067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0c7d60 tx=0x7f5ae0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 msgr2=0x7f5aec1f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec1f57c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800e870 tx=0x7f5ad800ec70 comp rx=0 tx=0).stop 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 shutdown_connections 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5ad0065a60 0x7f5ad0067f20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5aec1570c0 0x7f5aec157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0c9e30 0x7f5aec1f57c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 --2- 172.21.15.119:0/2348602186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5aec06c4f0 0x7f5aec153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 >> 172.21.15.119:0/2348602186 conn(0x7f5aec06a3e0 msgr2=0x7f5aec15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 shutdown_connections 2023-12-19T16:16:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.001+0000 7f5af3012640 1 -- 172.21.15.119:0/2348602186 wait complete. 2023-12-19T16:16:38.028 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T16:16:38.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 Processor -- start 2023-12-19T16:16:38.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 -- start start 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2dec15a680 0x7f2dec15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2dec06fdb0 0x7f2dec070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec15f100 con 0x7f2dec0cac10 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec070780 con 0x7f2dec06fdb0 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df3a2d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0ca7d0 con 0x7f2dec15a680 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2dec06fdb0 0x7f2dec070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2dec06fdb0 0x7f2dec070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41826/0 (socket says 172.21.15.119:41826) 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 -- 172.21.15.119:0/2061448582 learned_addr learned my addr 172.21.15.119:0/2061448582 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df0fc8640 1 --1- 172.21.15.119:0/2061448582 >> v1:172.21.15.119:6789/0 conn(0x7f2dec0cac10 0x7f2dec15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52918/0 (socket says 172.21.15.119:52918) 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df17c9640 1 --2- 172.21.15.119:0/2061448582 >> v2:172.21.15.143:3300/0 conn(0x7f2dec15a680 0x7f2dec15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 -- 172.21.15.119:0/2061448582 >> v2:172.21.15.143:3300/0 conn(0x7f2dec15a680 msgr2=0x7f2dec15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 --2- 172.21.15.119:0/2061448582 >> v2:172.21.15.143:3300/0 conn(0x7f2dec15a680 0x7f2dec15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 -- 172.21.15.119:0/2061448582 >> v1:172.21.15.119:6789/0 conn(0x7f2dec0cac10 legacy=0x7f2dec15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2df1fca640 1 -- 172.21.15.119:0/2061448582 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec15e860 con 0x7f2dec06fdb0 2023-12-19T16:16:38.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.161+0000 7f2de3fff640 1 -- 172.21.15.119:0/2061448582 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344920710 0 0) 0x7f2dec15f100 con 0x7f2dec0cac10 2023-12-19T16:16:38.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df1fca640 1 --2- 172.21.15.119:0/2061448582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec06fdb0 0x7f2dec070240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e50 tx=0x7f2de401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3e58543d3c98c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2de3fff640 1 -- 172.21.15.119:0/2061448582 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40a5800 con 0x7f2dec06fdb0 2023-12-19T16:16:38.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2de3fff640 1 -- 172.21.15.119:0/2061448582 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40a5960 con 0x7f2dec06fdb0 2023-12-19T16:16:38.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2de3fff640 1 -- 172.21.15.119:0/2061448582 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40a5cf0 con 0x7f2dec06fdb0 2023-12-19T16:16:38.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 -- 172.21.15.119:0/2061448582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec06fdb0 msgr2=0x7f2dec070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/2061448582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec06fdb0 0x7f2dec070240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e50 tx=0x7f2de401c940 comp rx=0 tx=0).stop 2023-12-19T16:16:38.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 -- 172.21.15.119:0/2061448582 shutdown_connections 2023-12-19T16:16:38.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/2061448582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec06fdb0 0x7f2dec070240 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/2061448582 >> v2:172.21.15.143:3300/0 conn(0x7f2dec15a680 0x7f2dec15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 -- 172.21.15.119:0/2061448582 >> 172.21.15.119:0/2061448582 conn(0x7f2dec06a3e0 msgr2=0x7f2dec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 -- 172.21.15.119:0/2061448582 shutdown_connections 2023-12-19T16:16:38.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.165+0000 7f2df3a2d640 1 -- 172.21.15.119:0/2061448582 wait complete. 2023-12-19T16:16:38.175 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 Processor -- start 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 -- start start 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dec06fdb0 0x7f2dec15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dec0cac10 0x7f2dec153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 0x7f2dec155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec156290 con 0x7f2dec15a680 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec15c6f0 con 0x7f2dec06fdb0 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec15c9d0 con 0x7f2dec0cac10 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 0x7f2dec155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 0x7f2dec155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41832/0 (socket says 172.21.15.119:41832) 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 -- 172.21.15.119:0/1506174428 learned_addr learned my addr 172.21.15.119:0/1506174428 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 -- 172.21.15.119:0/1506174428 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dec0cac10 msgr2=0x7f2dec153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dec0cac10 0x7f2dec153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 -- 172.21.15.119:0/1506174428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dec06fdb0 msgr2=0x7f2dec15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dec06fdb0 0x7f2dec15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.176 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 -- 172.21.15.119:0/1506174428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4009b30 con 0x7f2dec15a680 2023-12-19T16:16:38.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df1fca640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 0x7f2dec155d50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e50 tx=0x7f2de40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40b8470 con 0x7f2dec15a680 2023-12-19T16:16:38.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40b85d0 con 0x7f2dec15a680 2023-12-19T16:16:38.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40b8940 con 0x7f2dec15a680 2023-12-19T16:16:38.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec15ccb0 con 0x7f2dec15a680 2023-12-19T16:16:38.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.169+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec0c3940 con 0x7f2dec15a680 2023-12-19T16:16:38.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.173+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec0735b0 con 0x7f2dec15a680 2023-12-19T16:16:38.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.173+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2de40b8aa0 con 0x7f2dec15a680 2023-12-19T16:16:38.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.173+0000 7f2de1ffb640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2dd0065a60 0x7f2dd0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.173+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2de411e290 con 0x7f2dec15a680 2023-12-19T16:16:38.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.173+0000 7f2df17c9640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2dd0065a60 0x7f2dd0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.173+0000 7f2df17c9640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2dd0065a60 0x7f2dd0067f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2de8006aa0 tx=0x7f2de8006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.177+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2de40ebe50 con 0x7f2dec15a680 2023-12-19T16:16:38.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2dec0c3ba0 con 0x7f2dec15a680 2023-12-19T16:16:38.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2de1ffb640 1 -- 172.21.15.119:0/1506174428 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2dec0c3ba0 con 0x7f2dec15a680 2023-12-19T16:16:38.383 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:38.383 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "auth_dump": [ 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.a", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlLDhBIhAA3Y+9H7uLr/4NWc6wXrLwjw==", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.b", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFleo5rLhAAJHoKLrFQzbYJ01cW5H58bg==", 2023-12-19T16:16:38.384 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.c", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlLLZzKRAA1mYEkFxnIMSc0nOQ5J3fZw==", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:16:38.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.d", 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlJUDtNRAAMkucPMR4CF+uFnPefHxzaw==", 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.386 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.0", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBgwYFlM246FhAATtFR0UPTG9iux5t4/pDT4A==", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.1", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBjwYFlq7HwHBAAk5181pBrEv1Fr0NWsopEMg==", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.387 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.2", 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBmwYFlny61IhAAwxFTN7IkHgUfv3YpUv9b2A==", 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.3", 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBpwYFlaACTKxAAxbB8vMqBTc8nqHXpm2ZCOw==", 2023-12-19T16:16:38.388 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.4", 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBvwYFlJwJNORAAiwNlC6En0K9K7KKMrKUJoA==", 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.5", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBzwYFltvhjBRAARAVX5jbCgshgh46xt/X71Q==", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.6", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB2wYFlwB8iDBAAripdVFJZJMdj7HCelaVNLQ==", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.7", 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB5wYFlcokUExAAQ/3tAfnmMJmp7ZTNpGoigA==", 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.0", 2023-12-19T16:16:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlxmL3ORAAUnxwWR6p21EpYQy5hfFh3w==", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.1", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBdwYFlnA8JCBAA7wql2Q+kIvfCR4WQlK58rA==", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:16:38.392 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.2", 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBdwYFly+dsBBAAV1uD8UkERj4vOKY6L1EshA==", 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.3", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBdwYFlF1wNDhAAlW/gPN5CFwwTxAfF964QeQ==", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.admin", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlZ2G5BhAAToqSgYfGBr80GT7W4sX3LQ==", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2023-12-19T16:16:38.394 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-mds", 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB/wYFl68qXFRAApZ1YzZWssEAL1OlxvEeI+Q==", 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB/wYFlJtWXFRAAFoSSnDZF9gbW6jLwEXQx7A==", 2023-12-19T16:16:38.395 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-osd", 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB/wYFlWN+XFRAAKIMqVu8fQkmxuAKz0p8R9Q==", 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB/wYFl3ueXFRAAFiwIl4JlIUle/fUS/IUutQ==", 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.396 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB/wYFljPCXFRAAQY1BbsTw8J6HRN869Bn3xQ==", 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB/wYFlafmXFRAAE3n9bUAU6rWH2NRjFKZm9g==", 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.397 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.x", 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlCU5jHhAAq425Kk2xzqJYbEG+KbnDZA==", 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.y", 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFl2BuDGhAA+Q9BVQ1he47GGTx/7eIoHw==", 2023-12-19T16:16:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2023-12-19T16:16:38.399 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2dd0065a60 msgr2=0x7f2dd0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2dd0065a60 0x7f2dd0067f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2de8006aa0 tx=0x7f2de8006a30 comp rx=0 tx=0).stop 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 msgr2=0x7f2dec155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 0x7f2dec155d50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e50 tx=0x7f2de40196e0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 shutdown_connections 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2dd0065a60 0x7f2dd0067f20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dec15a680 0x7f2dec155d50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dec0cac10 0x7f2dec153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 --2- 172.21.15.119:0/1506174428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dec06fdb0 0x7f2dec15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.377+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 >> 172.21.15.119:0/1506174428 conn(0x7f2dec06a3e0 msgr2=0x7f2dec0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.381+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 shutdown_connections 2023-12-19T16:16:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.381+0000 7f2df3a2d640 1 -- 172.21.15.119:0/1506174428 wait complete. 2023-12-19T16:16:38.404 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T16:16:38.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.537+0000 7fc500466640 1 Processor -- start 2023-12-19T16:16:38.544 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.537+0000 7fc500466640 1 -- start start 2023-12-19T16:16:38.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc500466640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f8160cc0 0x7fc4f80cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc500466640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4f80c1280 0x7fc4f80cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc500466640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4f80c17d0 0x7fc4f806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc500466640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f81654a0 con 0x7fc4f80c17d0 2023-12-19T16:16:38.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc500466640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f81610a0 con 0x7fc4f80c1280 2023-12-19T16:16:38.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc500466640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f806fdb0 con 0x7fc4f8160cc0 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4f80c17d0 0x7fc4f806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4f80c17d0 0x7fc4f806bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41844/0 (socket says 172.21.15.119:41844) 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 -- 172.21.15.119:0/1289612509 learned_addr learned my addr 172.21.15.119:0/1289612509 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fda01640 1 --2- 172.21.15.119:0/1289612509 >> v2:172.21.15.143:3300/0 conn(0x7fc4f80c1280 0x7fc4f80cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fe202640 1 --2- 172.21.15.119:0/1289612509 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f8160cc0 0x7fc4f80cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 -- 172.21.15.119:0/1289612509 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f8160cc0 msgr2=0x7fc4f80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 --2- 172.21.15.119:0/1289612509 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f8160cc0 0x7fc4f80cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 -- 172.21.15.119:0/1289612509 >> v2:172.21.15.143:3300/0 conn(0x7fc4f80c1280 msgr2=0x7fc4f80cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 --2- 172.21.15.119:0/1289612509 >> v2:172.21.15.143:3300/0 conn(0x7fc4f80c1280 0x7fc4f80cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 -- 172.21.15.119:0/1289612509 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80cb6b0 con 0x7fc4f80c17d0 2023-12-19T16:16:38.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.541+0000 7fc4fea03640 1 --2- 172.21.15.119:0/1289612509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f80c17d0 0x7fc4f806bde0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009e80 tx=0x7fc4f001c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8eea275722369 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc4fd200640 1 -- 172.21.15.119:0/1289612509 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00a64c0 con 0x7fc4f80c17d0 2023-12-19T16:16:38.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc4fd200640 1 -- 172.21.15.119:0/1289612509 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f00a6620 con 0x7fc4f80c17d0 2023-12-19T16:16:38.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc4fd200640 1 -- 172.21.15.119:0/1289612509 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00a69b0 con 0x7fc4f80c17d0 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 -- 172.21.15.119:0/1289612509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f80c17d0 msgr2=0x7fc4f806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 --2- 172.21.15.119:0/1289612509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f80c17d0 0x7fc4f806bde0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009e80 tx=0x7fc4f001c630 comp rx=0 tx=0).stop 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 -- 172.21.15.119:0/1289612509 shutdown_connections 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 --2- 172.21.15.119:0/1289612509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f80c17d0 0x7fc4f806bde0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 --2- 172.21.15.119:0/1289612509 >> v2:172.21.15.143:3300/0 conn(0x7fc4f80c1280 0x7fc4f80cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 --2- 172.21.15.119:0/1289612509 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f8160cc0 0x7fc4f80cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.550 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 -- 172.21.15.119:0/1289612509 >> 172.21.15.119:0/1289612509 conn(0x7fc4f806a3e0 msgr2=0x7fc4f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 -- 172.21.15.119:0/1289612509 shutdown_connections 2023-12-19T16:16:38.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 -- 172.21.15.119:0/1289612509 wait complete. 2023-12-19T16:16:38.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 Processor -- start 2023-12-19T16:16:38.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.545+0000 7fc500466640 1 -- start start 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f80c1280 0x7fc4f81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4f80c17d0 0x7fc4f80b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 0x7fc4f80b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8150de0 con 0x7fc4f8160cc0 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81531a0 con 0x7fc4f80c17d0 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8153480 con 0x7fc4f80c1280 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 0x7fc4f80b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fe202640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f80c1280 0x7fc4f81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 0x7fc4f80b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41858/0 (socket says 172.21.15.119:41858) 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 -- 172.21.15.119:0/2272105658 learned_addr learned my addr 172.21.15.119:0/2272105658 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fda01640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4f80c17d0 0x7fc4f80b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 -- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f80c1280 msgr2=0x7fc4f81508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f80c1280 0x7fc4f81508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 -- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4f80c17d0 msgr2=0x7fc4f80b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4f80c17d0 0x7fc4f80b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 -- 172.21.15.119:0/2272105658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009b30 con 0x7fc4f8160cc0 2023-12-19T16:16:38.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4fea03640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 0x7fc4f80b0f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc4f001ace0 tx=0x7fc4f00193d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00b4070 con 0x7fc4f8160cc0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0009150 con 0x7fc4f8160cc0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00a69b0 con 0x7fc4f8160cc0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f8153760 con 0x7fc4f8160cc0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f8153d20 con 0x7fc4f8160cc0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f80735b0 con 0x7fc4f8160cc0 2023-12-19T16:16:38.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.549+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4f00b8070 con 0x7fc4f8160cc0 2023-12-19T16:16:38.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.553+0000 7fc4eeffd640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4dc065a60 0x7fc4dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.553+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc4f00aa070 con 0x7fc4f8160cc0 2023-12-19T16:16:38.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.553+0000 7fc4fe202640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4dc065a60 0x7fc4dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.553+0000 7fc4fe202640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4dc065a60 0x7fc4dc067f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40079c0 tx=0x7fc4f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.561 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.557+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc4f00ea630 con 0x7fc4f8160cc0 2023-12-19T16:16:38.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.757+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc4f8153f10 con 0x7fc4f8160cc0 2023-12-19T16:16:38.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.761+0000 7fc4eeffd640 1 -- 172.21.15.119:0/2272105658 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc4f00edc50 con 0x7fc4f8160cc0 2023-12-19T16:16:38.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4dc065a60 msgr2=0x7fc4dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4dc065a60 0x7fc4dc067f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40079c0 tx=0x7fc4f4008040 comp rx=0 tx=0).stop 2023-12-19T16:16:38.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 msgr2=0x7fc4f80b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 0x7fc4f80b0f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc4f001ace0 tx=0x7fc4f00193d0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 shutdown_connections 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4dc065a60 0x7fc4dc067f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4f80c17d0 0x7fc4f80b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8160cc0 0x7fc4f80b0f00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 --2- 172.21.15.119:0/2272105658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4f80c1280 0x7fc4f81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 >> 172.21.15.119:0/2272105658 conn(0x7fc4f806a3e0 msgr2=0x7fc4f80707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 shutdown_connections 2023-12-19T16:16:38.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.765+0000 7fc500466640 1 -- 172.21.15.119:0/2272105658 wait complete. 2023-12-19T16:16:38.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T16:16:38.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55f4f9640 1 Processor -- start 2023-12-19T16:16:38.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55f4f9640 1 -- start start 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55f4f9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5580cdd40 0x7fe5580cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55f4f9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558160690 con 0x7fe55815c9d0 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55f4f9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5580b0d80 con 0x7fe55806fdb0 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55f4f9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5581603f0 con 0x7fe5580cdd40 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55ca94640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5580cdd40 0x7fe5580cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55ca94640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5580cdd40 0x7fe5580cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41860/0 (socket says 172.21.15.119:41860) 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55ca94640 1 -- 172.21.15.119:0/1107702133 learned_addr learned my addr 172.21.15.119:0/1107702133 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55ca94640 1 -- 172.21.15.119:0/1107702133 >> v1:172.21.15.143:6789/0 conn(0x7fe55806fdb0 legacy=0x7fe5580cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55ca94640 1 -- 172.21.15.119:0/1107702133 >> v1:172.21.15.119:6789/0 conn(0x7fe55815c9d0 legacy=0x7fe558160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.925+0000 7fe55ca94640 1 -- 172.21.15.119:0/1107702133 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580ccb00 con 0x7fe5580cdd40 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55ca94640 1 --2- 172.21.15.119:0/1107702133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5580cdd40 0x7fe5580cc400 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe548009870 tx=0x7fe54801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e5cb2eed68df58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe54ffff640 1 -- 172.21.15.119:0/1107702133 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480ab650 con 0x7fe5580cdd40 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe54ffff640 1 -- 172.21.15.119:0/1107702133 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480ab7b0 con 0x7fe5580cdd40 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe54ffff640 1 -- 172.21.15.119:0/1107702133 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480abb40 con 0x7fe5580cdd40 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1107702133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5580cdd40 msgr2=0x7fe5580cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1107702133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5580cdd40 0x7fe5580cc400 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe548009870 tx=0x7fe54801c540 comp rx=0 tx=0).stop 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1107702133 shutdown_connections 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1107702133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5580cdd40 0x7fe5580cc400 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1107702133 >> 172.21.15.119:0/1107702133 conn(0x7fe55806a3e0 msgr2=0x7fe5580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1107702133 shutdown_connections 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.929+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1107702133 wait complete. 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 Processor -- start 2023-12-19T16:16:38.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- start start 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 0x7fe558153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5580cdd40 0x7fe55815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe55815c9d0 0x7fe5580ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581543d0 con 0x7fe55806fdb0 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581546b0 con 0x7fe55815c9d0 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe558154990 con 0x7fe5580cdd40 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 0x7fe558153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 0x7fe558153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41868/0 (socket says 172.21.15.119:41868) 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 -- 172.21.15.119:0/1696366074 learned_addr learned my addr 172.21.15.119:0/1696366074 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55ca94640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5580cdd40 0x7fe55815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55da96640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe55815c9d0 0x7fe5580ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 -- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5580cdd40 msgr2=0x7fe55815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5580cdd40 0x7fe55815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 -- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe55815c9d0 msgr2=0x7fe5580ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe55815c9d0 0x7fe5580ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 -- 172.21.15.119:0/1696366074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480094d0 con 0x7fe55806fdb0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55d295640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 0x7fe558153a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c3c0 tx=0x7fe55400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540052d0 con 0x7fe55806fdb0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554005430 con 0x7fe55806fdb0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554003840 con 0x7fe55806fdb0 2023-12-19T16:16:38.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5581613b0 con 0x7fe55806fdb0 2023-12-19T16:16:38.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe558154f50 con 0x7fe55806fdb0 2023-12-19T16:16:38.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.933+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5580735b0 con 0x7fe55806fdb0 2023-12-19T16:16:38.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.937+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5540039a0 con 0x7fe55806fdb0 2023-12-19T16:16:38.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.937+0000 7fe54dffb640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe53c065a60 0x7fe53c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.937+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe554082420 con 0x7fe55806fdb0 2023-12-19T16:16:38.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.937+0000 7fe55ca94640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe53c065a60 0x7fe53c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.937+0000 7fe55ca94640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe53c065a60 0x7fe53c067f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe5480af000 tx=0x7fe5480b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:38.941+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe554050090 con 0x7fe55806fdb0 2023-12-19T16:16:39.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.141+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe558155140 con 0x7fe55806fdb0 2023-12-19T16:16:39.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.145+0000 7fe54dffb640 1 -- 172.21.15.119:0/1696366074 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5540536b0 con 0x7fe55806fdb0 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe53c065a60 msgr2=0x7fe53c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe53c065a60 0x7fe53c067f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe5480af000 tx=0x7fe5480b6040 comp rx=0 tx=0).stop 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 msgr2=0x7fe558153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 0x7fe558153a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c3c0 tx=0x7fe55400c880 comp rx=0 tx=0).stop 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 shutdown_connections 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe53c065a60 0x7fe53c067f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe55815c9d0 0x7fe5580ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5580cdd40 0x7fe55815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 --2- 172.21.15.119:0/1696366074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe55806fdb0 0x7fe558153a60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 >> 172.21.15.119:0/1696366074 conn(0x7fe55806a3e0 msgr2=0x7fe558160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:39.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 shutdown_connections 2023-12-19T16:16:39.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.149+0000 7fe55f4f9640 1 -- 172.21.15.119:0/1696366074 wait complete. 2023-12-19T16:16:39.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T16:16:39.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.305+0000 7f5fe5863640 1 Processor -- start 2023-12-19T16:16:39.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.305+0000 7f5fe5863640 1 -- start start 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.305+0000 7f5fe5863640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5fe00ce920 0x7f5fe00d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.305+0000 7f5fe5863640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00d1320 con 0x7f5fe0157080 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.305+0000 7f5fe5863640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00cc970 con 0x7f5fe00cd730 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.305+0000 7f5fe5863640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe0157460 con 0x7f5fe00ce920 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fdeffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5fe0157080 0x7f5fe00ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52938/0 (socket says 172.21.15.119:52938) 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fd67fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5fe00ce920 0x7f5fe00d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fdeffd640 1 -- 172.21.15.119:0/3056164477 learned_addr learned my addr 172.21.15.119:0/3056164477 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:39.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fd67fc640 1 -- 172.21.15.119:0/3056164477 >> v1:172.21.15.143:6789/0 conn(0x7f5fe00cd730 legacy=0x7f5fe00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:39.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fd67fc640 1 -- 172.21.15.119:0/3056164477 >> v1:172.21.15.119:6789/0 conn(0x7f5fe0157080 legacy=0x7f5fe00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fd67fc640 1 -- 172.21.15.119:0/3056164477 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00ccc50 con 0x7f5fe00ce920 2023-12-19T16:16:39.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fd67fc640 1 --2- 172.21.15.119:0/3056164477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00ce920 0x7f5fe00d05b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e529e190ae2c58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fde7fc640 1 -- 172.21.15.119:0/3056164477 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80a59a0 con 0x7f5fe00ce920 2023-12-19T16:16:39.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fde7fc640 1 -- 172.21.15.119:0/3056164477 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc80a5b00 con 0x7f5fe00ce920 2023-12-19T16:16:39.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.309+0000 7f5fde7fc640 1 -- 172.21.15.119:0/3056164477 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80a5e90 con 0x7f5fe00ce920 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- 172.21.15.119:0/3056164477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00ce920 msgr2=0x7f5fe00d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3056164477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00ce920 0x7f5fe00d05b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc801c8e0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- 172.21.15.119:0/3056164477 shutdown_connections 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3056164477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00ce920 0x7f5fe00d05b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- 172.21.15.119:0/3056164477 >> 172.21.15.119:0/3056164477 conn(0x7f5fe0069ca0 msgr2=0x7f5fe006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- 172.21.15.119:0/3056164477 shutdown_connections 2023-12-19T16:16:39.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- 172.21.15.119:0/3056164477 wait complete. 2023-12-19T16:16:39.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 Processor -- start 2023-12-19T16:16:39.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- start start 2023-12-19T16:16:39.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 0x7f5fe0155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00ce920 0x7f5fe01501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0157080 0x7f5fe0153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c7820 con 0x7f5fe00cd730 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01506e0 con 0x7f5fe0157080 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fe5863640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00ca0a0 con 0x7f5fe00ce920 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fdeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 0x7f5fe0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fdeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 0x7f5fe0155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41894/0 (socket says 172.21.15.119:41894) 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fdeffd640 1 -- 172.21.15.119:0/3749776402 learned_addr learned my addr 172.21.15.119:0/3749776402 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fd67fc640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00ce920 0x7f5fe01501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.313+0000 7f5fdf7fe640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0157080 0x7f5fe0153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdeffd640 1 -- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00ce920 msgr2=0x7f5fe01501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdeffd640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00ce920 0x7f5fe01501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdeffd640 1 -- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0157080 msgr2=0x7f5fe0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdeffd640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0157080 0x7f5fe0153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdeffd640 1 -- 172.21.15.119:0/3749776402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8009a70 con 0x7f5fe00cd730 2023-12-19T16:16:39.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdeffd640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 0x7f5fe0155750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c500 tx=0x7f5fd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0005cf0 con 0x7f5fe00cd730 2023-12-19T16:16:39.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0005e50 con 0x7f5fe00cd730 2023-12-19T16:16:39.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00ca380 con 0x7f5fe00cd730 2023-12-19T16:16:39.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00072f0 con 0x7f5fe00cd730 2023-12-19T16:16:39.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe006b130 con 0x7f5fe00cd730 2023-12-19T16:16:39.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe006b320 con 0x7f5fe00cd730 2023-12-19T16:16:39.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fd0007450 con 0x7f5fe00cd730 2023-12-19T16:16:39.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdcff9640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fc0065a90 0x7f5fc0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5fd0082430 con 0x7f5fe00cd730 2023-12-19T16:16:39.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.317+0000 7f5fd67fc640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fc0065a90 0x7f5fc0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.321+0000 7f5fd67fc640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fc0065a90 0x7f5fc0067f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80af000 tx=0x7f5fc80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.321+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5fd00500a0 con 0x7f5fe00cd730 2023-12-19T16:16:39.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.525+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5fe004e000 con 0x7f5fe00cd730 2023-12-19T16:16:39.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fdcff9640 1 -- 172.21.15.119:0/3749776402 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5fd00536c0 con 0x7f5fe00cd730 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fc0065a90 msgr2=0x7f5fc0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fc0065a90 0x7f5fc0067f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80af000 tx=0x7f5fc80a7070 comp rx=0 tx=0).stop 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 msgr2=0x7f5fe0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 0x7f5fe0155750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c500 tx=0x7f5fd000c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 shutdown_connections 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fc0065a90 0x7f5fc0067f50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0157080 0x7f5fe0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00ce920 0x7f5fe01501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 --2- 172.21.15.119:0/3749776402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe00cd730 0x7f5fe0155750 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 >> 172.21.15.119:0/3749776402 conn(0x7f5fe0069ca0 msgr2=0x7f5fe015e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 shutdown_connections 2023-12-19T16:16:39.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.529+0000 7f5fe5863640 1 -- 172.21.15.119:0/3749776402 wait complete. 2023-12-19T16:16:39.555 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T16:16:39.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446fba6640 1 Processor -- start 2023-12-19T16:16:39.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446fba6640 1 -- start start 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446fba6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680c1280 0x7f44680cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446fba6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446806fdb0 con 0x7f44680cb340 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446fba6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4468164820 con 0x7f4468160cc0 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446fba6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44681654a0 con 0x7f44680c1280 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446e143640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f44680cb340 0x7f44680cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52946/0 (socket says 172.21.15.119:52946) 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446e143640 1 -- 172.21.15.119:0/704025569 learned_addr learned my addr 172.21.15.119:0/704025569 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:39.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446d141640 1 --2- 172.21.15.119:0/704025569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680c1280 0x7f44680cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058686393 0 0) 0x7f446806fdb0 con 0x7f44680cb340 2023-12-19T16:16:39.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4454003530 con 0x7f44680cb340 2023-12-19T16:16:39.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976551526 0 0) 0x7f4468164820 con 0x7f4468160cc0 2023-12-19T16:16:39.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446806fdb0 con 0x7f4468160cc0 2023-12-19T16:16:39.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446d141640 1 -- 172.21.15.119:0/704025569 >> v1:172.21.15.143:6789/0 conn(0x7f4468160cc0 legacy=0x7f44680cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446d141640 1 -- 172.21.15.119:0/704025569 >> v1:172.21.15.119:6789/0 conn(0x7f44680cb340 legacy=0x7f44680cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260283420 0 0) 0x7f4454003530 con 0x7f44680cb340 2023-12-19T16:16:39.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.689+0000 7f446d141640 1 -- 172.21.15.119:0/704025569 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468164b00 con 0x7f44680c1280 2023-12-19T16:16:39.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446d141640 1 --2- 172.21.15.119:0/704025569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680c1280 0x7f44680cc400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4458009820 tx=0x7f445801c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8332d398ef2dcf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460001a00 con 0x7f44680c1280 2023-12-19T16:16:39.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44580a7050 con 0x7f44680c1280 2023-12-19T16:16:39.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446c940640 1 -- 172.21.15.119:0/704025569 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580ab400 con 0x7f44680c1280 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 -- 172.21.15.119:0/704025569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680c1280 msgr2=0x7f44680cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 --2- 172.21.15.119:0/704025569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680c1280 0x7f44680cc400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4458009820 tx=0x7f445801c2a0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 -- 172.21.15.119:0/704025569 shutdown_connections 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 --2- 172.21.15.119:0/704025569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680c1280 0x7f44680cc400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 -- 172.21.15.119:0/704025569 >> 172.21.15.119:0/704025569 conn(0x7f446806a3e0 msgr2=0x7f44680afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 -- 172.21.15.119:0/704025569 shutdown_connections 2023-12-19T16:16:39.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.693+0000 7f446fba6640 1 -- 172.21.15.119:0/704025569 wait complete. 2023-12-19T16:16:39.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 Processor -- start 2023-12-19T16:16:39.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 -- start start 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 0x7f4468161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680cb340 0x7f446815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4468160cc0 0x7f44680ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468155fb0 con 0x7f44680c1280 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446815d060 con 0x7f4468160cc0 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4468161a90 con 0x7f44680cb340 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 0x7f4468161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 0x7f4468161550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41908/0 (socket says 172.21.15.119:41908) 2023-12-19T16:16:39.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 -- 172.21.15.119:0/685717484 learned_addr learned my addr 172.21.15.119:0/685717484 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:39.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 -- 172.21.15.119:0/685717484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680cb340 msgr2=0x7f446815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680cb340 0x7f446815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 -- 172.21.15.119:0/685717484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4468160cc0 msgr2=0x7f44680ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4468160cc0 0x7f44680ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 -- 172.21.15.119:0/685717484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009420 con 0x7f44680c1280 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446d942640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 0x7f4468161550 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f446400c430 tx=0x7f446400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640052d0 con 0x7f44680c1280 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464005450 con 0x7f44680c1280 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464003840 con 0x7f44680c1280 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4468155610 con 0x7f44680c1280 2023-12-19T16:16:39.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.697+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4468155bd0 con 0x7f44680c1280 2023-12-19T16:16:39.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.701+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680735b0 con 0x7f44680c1280 2023-12-19T16:16:39.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.701+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f44640039a0 con 0x7f44680c1280 2023-12-19T16:16:39.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.701+0000 7f445e7fc640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f444c065a60 0x7f444c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.701+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4464082570 con 0x7f44680c1280 2023-12-19T16:16:39.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.701+0000 7f446d141640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f444c065a60 0x7f444c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.701+0000 7f446d141640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f444c065a60 0x7f444c067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44580ad000 tx=0x7f4458004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.705+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f44640501d0 con 0x7f44680c1280 2023-12-19T16:16:39.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.905+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f446804e000 con 0x7f44680c1280 2023-12-19T16:16:39.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f445e7fc640 1 -- 172.21.15.119:0/685717484 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f44640537f0 con 0x7f44680c1280 2023-12-19T16:16:39.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f444c065a60 msgr2=0x7f444c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f444c065a60 0x7f444c067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44580ad000 tx=0x7f4458004740 comp rx=0 tx=0).stop 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 msgr2=0x7f4468161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 0x7f4468161550 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f446400c430 tx=0x7f446400c8f0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 shutdown_connections 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f444c065a60 0x7f444c067f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4468160cc0 0x7f44680ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44680cb340 0x7f446815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 --2- 172.21.15.119:0/685717484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44680c1280 0x7f4468161550 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 >> 172.21.15.119:0/685717484 conn(0x7f446806a3e0 msgr2=0x7f44680cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 shutdown_connections 2023-12-19T16:16:39.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:39.913+0000 7f446fba6640 1 -- 172.21.15.119:0/685717484 wait complete. 2023-12-19T16:16:39.938 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T16:16:40.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36295bc640 1 Processor -- start 2023-12-19T16:16:40.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36295bc640 1 -- start start 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36295bc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f36241570c0 0x7f362406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36295bc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36240c9460 con 0x7f36240ca000 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36295bc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36241574a0 con 0x7f362406c320 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36295bc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362406c7a0 con 0x7f36241570c0 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36237fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f36240ca000 0x7f3624070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52960/0 (socket says 172.21.15.119:52960) 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f36237fe640 1 -- 172.21.15.119:0/324020351 learned_addr learned my addr 172.21.15.119:0/324020351 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3622ffd640 1 --2- 172.21.15.119:0/324020351 >> v2:172.21.15.143:3300/0 conn(0x7f36241570c0 0x7f362406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3621ffb640 1 -- 172.21.15.119:0/324020351 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039486157 0 0) 0x7f36240c9460 con 0x7f36240ca000 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3621ffb640 1 -- 172.21.15.119:0/324020351 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f360c003530 con 0x7f36240ca000 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3621ffb640 1 -- 172.21.15.119:0/324020351 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282464083 0 0) 0x7f360c003530 con 0x7f36240ca000 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3622ffd640 1 -- 172.21.15.119:0/324020351 >> v1:172.21.15.143:6789/0 conn(0x7f362406c320 legacy=0x7f36240c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3622ffd640 1 -- 172.21.15.119:0/324020351 >> v1:172.21.15.119:6789/0 conn(0x7f36240ca000 legacy=0x7f3624070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.073+0000 7f3622ffd640 1 -- 172.21.15.119:0/324020351 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240c8b30 con 0x7f36241570c0 2023-12-19T16:16:40.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f3622ffd640 1 --2- 172.21.15.119:0/324020351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f362406bde0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36140097c0 tx=0x7f361401c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb8ba6168c939a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f3621ffb640 1 -- 172.21.15.119:0/324020351 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c001a00 con 0x7f36241570c0 2023-12-19T16:16:40.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f3621ffb640 1 -- 172.21.15.119:0/324020351 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36140a7050 con 0x7f36241570c0 2023-12-19T16:16:40.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f3621ffb640 1 -- 172.21.15.119:0/324020351 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140ab620 con 0x7f36241570c0 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 -- 172.21.15.119:0/324020351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 msgr2=0x7f362406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 --2- 172.21.15.119:0/324020351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f362406bde0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36140097c0 tx=0x7f361401c190 comp rx=0 tx=0).stop 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 -- 172.21.15.119:0/324020351 shutdown_connections 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 --2- 172.21.15.119:0/324020351 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f362406bde0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 -- 172.21.15.119:0/324020351 >> 172.21.15.119:0/324020351 conn(0x7f362406a3e0 msgr2=0x7f36240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 -- 172.21.15.119:0/324020351 shutdown_connections 2023-12-19T16:16:40.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.077+0000 7f36295bc640 1 -- 172.21.15.119:0/324020351 wait complete. 2023-12-19T16:16:40.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 Processor -- start 2023-12-19T16:16:40.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- start start 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 0x7f3624148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36240ca000 0x7f36240cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f36240cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240ac740 con 0x7f362406c320 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240aca20 con 0x7f36241570c0 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36240acd00 con 0x7f36240ca000 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 0x7f3624148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 0x7f3624148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41914/0 (socket says 172.21.15.119:41914) 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 -- 172.21.15.119:0/2060505052 learned_addr learned my addr 172.21.15.119:0/2060505052 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36237fe640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f36240cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36227fc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36240ca000 0x7f36240cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 -- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36240ca000 msgr2=0x7f36240cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36240ca000 0x7f36240cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 -- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 msgr2=0x7f36240cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f36240cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 -- 172.21.15.119:0/2060505052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009420 con 0x7f362406c320 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f3622ffd640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 0x7f3624148e70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f36140097c0 tx=0x7f361401a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140abd80 con 0x7f362406c320 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614004020 con 0x7f362406c320 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36240acfe0 con 0x7f362406c320 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140043d0 con 0x7f362406c320 2023-12-19T16:16:40.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36240ac2b0 con 0x7f362406c320 2023-12-19T16:16:40.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.081+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36240735b0 con 0x7f362406c320 2023-12-19T16:16:40.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.085+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3614003620 con 0x7f362406c320 2023-12-19T16:16:40.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.085+0000 7f360b7fe640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3610065a60 0x7f3610067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.085+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f361411d7d0 con 0x7f362406c320 2023-12-19T16:16:40.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.085+0000 7f36227fc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3610065a60 0x7f3610067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.085+0000 7f36227fc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3610065a60 0x7f3610067f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f36241f86d0 tx=0x7f3618009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.094 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.089+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f36140eb4b0 con 0x7f362406c320 2023-12-19T16:16:40.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.293+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f36240c6630 con 0x7f362406c320 2023-12-19T16:16:40.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f360b7fe640 1 -- 172.21.15.119:0/2060505052 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f36140eead0 con 0x7f362406c320 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3610065a60 msgr2=0x7f3610067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3610065a60 0x7f3610067f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f36241f86d0 tx=0x7f3618009040 comp rx=0 tx=0).stop 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 msgr2=0x7f3624148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 0x7f3624148e70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f36140097c0 tx=0x7f361401a9d0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 shutdown_connections 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3610065a60 0x7f3610067f20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36241570c0 0x7f36240cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36240ca000 0x7f36240cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 --2- 172.21.15.119:0/2060505052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f362406c320 0x7f3624148e70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 >> 172.21.15.119:0/2060505052 conn(0x7f362406a3e0 msgr2=0x7f3624157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:40.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 shutdown_connections 2023-12-19T16:16:40.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.301+0000 7f36295bc640 1 -- 172.21.15.119:0/2060505052 wait complete. 2023-12-19T16:16:40.328 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T16:16:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 Processor -- start 2023-12-19T16:16:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 -- start start 2023-12-19T16:16:40.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 0x7f10600cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f10600cf7e0 0x7f10601668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600d11c0 con 0x7f10600ce3f0 2023-12-19T16:16:40.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600d0310 con 0x7f10600cf7e0 2023-12-19T16:16:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f1065895640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600d05b0 con 0x7f106015ca40 2023-12-19T16:16:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f105effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 0x7f10600cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f105f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f10600cf7e0 0x7f10601668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f105effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 0x7f10600cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:55888/0 (socket says 172.21.15.119:55888) 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.461+0000 7f105effd640 1 -- 172.21.15.119:0/2507948518 learned_addr learned my addr 172.21.15.119:0/2507948518 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105effd640 1 -- 172.21.15.119:0/2507948518 >> v2:172.21.15.143:3300/0 conn(0x7f10600cf7e0 msgr2=0x7f10601668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105effd640 1 --2- 172.21.15.119:0/2507948518 >> v2:172.21.15.143:3300/0 conn(0x7f10600cf7e0 0x7f10601668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105effd640 1 -- 172.21.15.119:0/2507948518 >> v1:172.21.15.143:6789/0 conn(0x7f10600ce3f0 legacy=0x7f10600cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105effd640 1 -- 172.21.15.119:0/2507948518 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600d0890 con 0x7f106015ca40 2023-12-19T16:16:40.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105f7fe640 1 --2- 172.21.15.119:0/2507948518 >> v2:172.21.15.143:3300/0 conn(0x7f10600cf7e0 0x7f10601668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105effd640 1 --2- 172.21.15.119:0/2507948518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 0x7f10600cdeb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1050006fd0 tx=0x7f105001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e699a79cc9334769 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105dffb640 1 -- 172.21.15.119:0/2507948518 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500aa680 con 0x7f106015ca40 2023-12-19T16:16:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105dffb640 1 -- 172.21.15.119:0/2507948518 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500aa7e0 con 0x7f106015ca40 2023-12-19T16:16:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.465+0000 7f105dffb640 1 -- 172.21.15.119:0/2507948518 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500aab70 con 0x7f106015ca40 2023-12-19T16:16:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- 172.21.15.119:0/2507948518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 msgr2=0x7f10600cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 --2- 172.21.15.119:0/2507948518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 0x7f10600cdeb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1050006fd0 tx=0x7f105001c520 comp rx=0 tx=0).stop 2023-12-19T16:16:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- 172.21.15.119:0/2507948518 shutdown_connections 2023-12-19T16:16:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 --2- 172.21.15.119:0/2507948518 >> v2:172.21.15.143:3300/0 conn(0x7f10600cf7e0 0x7f10601668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 --2- 172.21.15.119:0/2507948518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f106015ca40 0x7f10600cdeb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- 172.21.15.119:0/2507948518 >> 172.21.15.119:0/2507948518 conn(0x7f1060089fb0 msgr2=0x7f10600d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- 172.21.15.119:0/2507948518 shutdown_connections 2023-12-19T16:16:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- 172.21.15.119:0/2507948518 wait complete. 2023-12-19T16:16:40.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 Processor -- start 2023-12-19T16:16:40.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- start start 2023-12-19T16:16:40.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10600ce3f0 0x7f1060151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10600cf7e0 0x7f10600ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 0x7f106015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600cc090 con 0x7f106015ca40 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600cc520 con 0x7f10600cf7e0 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f1065895640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600cb480 con 0x7f10600ce3f0 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 0x7f106015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 0x7f106015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41930/0 (socket says 172.21.15.119:41930) 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 -- 172.21.15.119:0/4181372958 learned_addr learned my addr 172.21.15.119:0/4181372958 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105effd640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10600ce3f0 0x7f1060151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105e7fc640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10600cf7e0 0x7f10600ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 -- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10600ce3f0 msgr2=0x7f1060151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10600ce3f0 0x7f1060151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 -- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10600cf7e0 msgr2=0x7f10600ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10600cf7e0 0x7f10600ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.469+0000 7f105f7fe640 1 -- 172.21.15.119:0/4181372958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009a70 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f105f7fe640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 0x7f106015a4a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f105800efc0 tx=0x7f105800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058009cc0 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800f040 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580039a0 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1050009480 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600d17d0 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10600d1630 con 0x7f106015ca40 2023-12-19T16:16:40.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1058014480 con 0x7f106015ca40 2023-12-19T16:16:40.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1047fff640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f104c065a60 0x7f104c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1058083a70 con 0x7f106015ca40 2023-12-19T16:16:40.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.473+0000 7f105effd640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f104c065a60 0x7f104c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.477+0000 7f105effd640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f104c065a60 0x7f104c067f20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10500ae000 tx=0x7f10500b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.477+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f10600d1630 con 0x7f106015ca40 2023-12-19T16:16:40.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.681+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f10600d1630 con 0x7f106015ca40 2023-12-19T16:16:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1047fff640 1 -- 172.21.15.119:0/4181372958 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f10600d1630 con 0x7f106015ca40 2023-12-19T16:16:40.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f104c065a60 msgr2=0x7f104c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f104c065a60 0x7f104c067f20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10500ae000 tx=0x7f10500b5040 comp rx=0 tx=0).stop 2023-12-19T16:16:40.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 msgr2=0x7f106015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 0x7f106015a4a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f105800efc0 tx=0x7f105800c490 comp rx=0 tx=0).stop 2023-12-19T16:16:40.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 shutdown_connections 2023-12-19T16:16:40.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f104c065a60 0x7f104c067f20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10600cf7e0 0x7f10600ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f106015ca40 0x7f106015a4a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 --2- 172.21.15.119:0/4181372958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10600ce3f0 0x7f1060151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.689+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 >> 172.21.15.119:0/4181372958 conn(0x7f1060089fb0 msgr2=0x7f10600ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:40.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.693+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 shutdown_connections 2023-12-19T16:16:40.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.693+0000 7f1065895640 1 -- 172.21.15.119:0/4181372958 wait complete. 2023-12-19T16:16:40.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:40.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6d15ce640 1 Processor -- start 2023-12-19T16:16:40.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6d15ce640 1 -- start start 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6d15ce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe6cc0cefe0 0x7fe6cc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6d15ce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc15cf10 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6d15ce640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc15e000 con 0x7fe6cc15cb30 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6d15ce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc0cf960 con 0x7fe6cc0cefe0 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6cb7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe6cc15d2d0 0x7fe6cc15d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52976/0 (socket says 172.21.15.119:52976) 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6cb7fe640 1 -- 172.21.15.119:0/2260827434 learned_addr learned my addr 172.21.15.119:0/2260827434 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:40.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6ca7fc640 1 --2- 172.21.15.119:0/2260827434 >> v2:172.21.15.143:3300/0 conn(0x7fe6cc0cefe0 0x7fe6cc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6c9ffb640 1 -- 172.21.15.119:0/2260827434 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722876991 0 0) 0x7fe6cc15cf10 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6c9ffb640 1 -- 172.21.15.119:0/2260827434 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b4003530 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6ca7fc640 1 -- 172.21.15.119:0/2260827434 >> v1:172.21.15.143:6789/0 conn(0x7fe6cc15cb30 legacy=0x7fe6cc06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6ca7fc640 1 -- 172.21.15.119:0/2260827434 >> v1:172.21.15.119:6789/0 conn(0x7fe6cc15d2d0 legacy=0x7fe6cc15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.849+0000 7fe6ca7fc640 1 -- 172.21.15.119:0/2260827434 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc06ae40 con 0x7fe6cc0cefe0 2023-12-19T16:16:40.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6ca7fc640 1 --2- 172.21.15.119:0/2260827434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc0cefe0 0x7fe6cc0cf420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00097c0 tx=0x7fe6c001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1061c7d0c5b9a07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6c9ffb640 1 -- 172.21.15.119:0/2260827434 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00ab600 con 0x7fe6cc0cefe0 2023-12-19T16:16:40.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6c9ffb640 1 -- 172.21.15.119:0/2260827434 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c00a7050 con 0x7fe6cc0cefe0 2023-12-19T16:16:40.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6c9ffb640 1 -- 172.21.15.119:0/2260827434 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00ab960 con 0x7fe6cc0cefe0 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 -- 172.21.15.119:0/2260827434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc0cefe0 msgr2=0x7fe6cc0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/2260827434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc0cefe0 0x7fe6cc0cf420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00097c0 tx=0x7fe6c001c480 comp rx=0 tx=0).stop 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 -- 172.21.15.119:0/2260827434 shutdown_connections 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/2260827434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc0cefe0 0x7fe6cc0cf420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 -- 172.21.15.119:0/2260827434 >> 172.21.15.119:0/2260827434 conn(0x7fe6cc089fb0 msgr2=0x7fe6cc09b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 -- 172.21.15.119:0/2260827434 shutdown_connections 2023-12-19T16:16:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.853+0000 7fe6d15ce640 1 -- 172.21.15.119:0/2260827434 wait complete. 2023-12-19T16:16:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 Processor -- start 2023-12-19T16:16:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- start start 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6cc0cefe0 0x7fe6cc1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc15cb30 0x7fe6cc0b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 0x7fe6cc0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0cc000 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc1565f0 con 0x7fe6cc15cb30 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0cb480 con 0x7fe6cc0cefe0 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 0x7fe6cc0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 0x7fe6cc0b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41944/0 (socket says 172.21.15.119:41944) 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 -- 172.21.15.119:0/823091138 learned_addr learned my addr 172.21.15.119:0/823091138 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6caffd640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6cc0cefe0 0x7fe6cc1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6ca7fc640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc15cb30 0x7fe6cc0b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 -- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6cc0cefe0 msgr2=0x7fe6cc1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6cc0cefe0 0x7fe6cc1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 -- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc15cb30 msgr2=0x7fe6cc0b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc15cb30 0x7fe6cc0b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 -- 172.21.15.119:0/823091138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009420 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6cb7fe640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 0x7fe6cc0b2020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400caa0 tx=0x7fe6c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c400ac00 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c400ad60 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4012620 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc0cb760 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc0cbd20 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.857+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc06a7c0 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.861+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6c4007070 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.861+0000 7fe6b37fe640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe6b8065a60 0x7fe6b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.861+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe6c4082eb0 con 0x7fe6cc15d2d0 2023-12-19T16:16:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.861+0000 7fe6caffd640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe6b8065a60 0x7fe6b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.861+0000 7fe6caffd640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe6b8065a60 0x7fe6b8067f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0017e0 tx=0x7fe6bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:40.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:40.865+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe6c4050b20 con 0x7fe6cc15d2d0 2023-12-19T16:16:41.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.017+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6cc04e000 con 0x7fe6cc15d2d0 2023-12-19T16:16:41.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.017+0000 7fe6b37fe640 1 -- 172.21.15.119:0/823091138 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12642 (secure 0 0 0) 0x7fe6c4017020 con 0x7fe6cc15d2d0 2023-12-19T16:16:41.023 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:41.023 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":35,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:37.999723+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:41.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.017+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe6b8065a60 msgr2=0x7fe6b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.017+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe6b8065a60 0x7fe6b8067f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0017e0 tx=0x7fe6bc009040 comp rx=0 tx=0).stop 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.017+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 msgr2=0x7fe6cc0b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.017+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 0x7fe6cc0b2020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400caa0 tx=0x7fe6c400cf60 comp rx=0 tx=0).stop 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 shutdown_connections 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe6b8065a60 0x7fe6b8067f20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6cc15cb30 0x7fe6cc0b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc15d2d0 0x7fe6cc0b2020 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 --2- 172.21.15.119:0/823091138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6cc0cefe0 0x7fe6cc1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 >> 172.21.15.119:0/823091138 conn(0x7fe6cc089fb0 msgr2=0x7fe6cc0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 shutdown_connections 2023-12-19T16:16:41.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.021+0000 7fe6d15ce640 1 -- 172.21.15.119:0/823091138 wait complete. 2023-12-19T16:16:41.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:41.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:41.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.181+0000 7faf49afc640 1 Processor -- start 2023-12-19T16:16:41.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.181+0000 7faf49afc640 1 -- start start 2023-12-19T16:16:41.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf49afc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faf440ca410 0x7faf44159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf49afc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44159fb0 0x7faf44071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf49afc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf44071db0 0x7faf440cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf49afc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4415aab0 con 0x7faf440ca410 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf49afc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf44070df0 con 0x7faf44071db0 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf49afc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4415a4f0 con 0x7faf44159fb0 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faf440ca410 0x7faf44159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faf440ca410 0x7faf44159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41948/0 (socket says 172.21.15.119:41948) 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 -- 172.21.15.119:0/2000035343 learned_addr learned my addr 172.21.15.119:0/2000035343 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf3bfff640 1 --2- 172.21.15.119:0/2000035343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44159fb0 0x7faf44071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf43fff640 1 --2- 172.21.15.119:0/2000035343 >> v2:172.21.15.143:3300/0 conn(0x7faf44071db0 0x7faf440cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 -- 172.21.15.119:0/2000035343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44159fb0 msgr2=0x7faf44071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 --2- 172.21.15.119:0/2000035343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44159fb0 0x7faf44071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 -- 172.21.15.119:0/2000035343 >> v2:172.21.15.143:3300/0 conn(0x7faf44071db0 msgr2=0x7faf440cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 --2- 172.21.15.119:0/2000035343 >> v2:172.21.15.143:3300/0 conn(0x7faf44071db0 0x7faf440cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.185+0000 7faf437fe640 1 -- 172.21.15.119:0/2000035343 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4415a7d0 con 0x7faf440ca410 2023-12-19T16:16:41.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf437fe640 1 --2- 172.21.15.119:0/2000035343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440ca410 0x7faf44159a70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf440c8a00 tx=0x7faf3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c0e80b188377b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf42ffd640 1 -- 172.21.15.119:0/2000035343 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340ac600 con 0x7faf440ca410 2023-12-19T16:16:41.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf42ffd640 1 -- 172.21.15.119:0/2000035343 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf340a8050 con 0x7faf440ca410 2023-12-19T16:16:41.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf42ffd640 1 -- 172.21.15.119:0/2000035343 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340ac980 con 0x7faf440ca410 2023-12-19T16:16:41.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 -- 172.21.15.119:0/2000035343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440ca410 msgr2=0x7faf44159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 --2- 172.21.15.119:0/2000035343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440ca410 0x7faf44159a70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf440c8a00 tx=0x7faf3401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 -- 172.21.15.119:0/2000035343 shutdown_connections 2023-12-19T16:16:41.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 --2- 172.21.15.119:0/2000035343 >> v2:172.21.15.143:3300/0 conn(0x7faf44071db0 0x7faf440cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 --2- 172.21.15.119:0/2000035343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44159fb0 0x7faf44071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 --2- 172.21.15.119:0/2000035343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440ca410 0x7faf44159a70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 -- 172.21.15.119:0/2000035343 >> 172.21.15.119:0/2000035343 conn(0x7faf4406a2a0 msgr2=0x7faf440aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 -- 172.21.15.119:0/2000035343 shutdown_connections 2023-12-19T16:16:41.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 -- 172.21.15.119:0/2000035343 wait complete. 2023-12-19T16:16:41.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 Processor -- start 2023-12-19T16:16:41.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.189+0000 7faf49afc640 1 -- start start 2023-12-19T16:16:41.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44071db0 0x7faf440ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf440ca410 0x7faf44151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 0x7faf441547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44152d50 con 0x7faf44159fb0 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441520d0 con 0x7faf440ca410 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf441523b0 con 0x7faf44071db0 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 0x7faf441547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf437fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44071db0 0x7faf440ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf3bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf440ca410 0x7faf44151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 0x7faf441547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41962/0 (socket says 172.21.15.119:41962) 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf437fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44071db0 0x7faf440ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:55916/0 (socket says 172.21.15.119:55916) 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 -- 172.21.15.119:0/414283046 learned_addr learned my addr 172.21.15.119:0/414283046 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 -- 172.21.15.119:0/414283046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44071db0 msgr2=0x7faf440ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44071db0 0x7faf440ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 -- 172.21.15.119:0/414283046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf440ca410 msgr2=0x7faf44151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf440ca410 0x7faf44151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 -- 172.21.15.119:0/414283046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340094d0 con 0x7faf44159fb0 2023-12-19T16:16:41.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf43fff640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 0x7faf441547a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007e60 tx=0x7faf3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c014420 con 0x7faf44159fb0 2023-12-19T16:16:41.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0145a0 con 0x7faf44159fb0 2023-12-19T16:16:41.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c014950 con 0x7faf44159fb0 2023-12-19T16:16:41.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf44152690 con 0x7faf44159fb0 2023-12-19T16:16:41.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf44150b90 con 0x7faf44159fb0 2023-12-19T16:16:41.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4404e000 con 0x7faf44159fb0 2023-12-19T16:16:41.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.193+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faf3c014ab0 con 0x7faf44159fb0 2023-12-19T16:16:41.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.197+0000 7faf40ff9640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faf24065a60 0x7faf24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.197+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7faf3c083790 con 0x7faf44159fb0 2023-12-19T16:16:41.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.197+0000 7faf437fe640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faf24065a60 0x7faf24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.197+0000 7faf437fe640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faf24065a60 0x7faf24067f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf340ae000 tx=0x7faf340a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.201+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faf3c051400 con 0x7faf44159fb0 2023-12-19T16:16:41.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.349+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf440ad450 con 0x7faf44159fb0 2023-12-19T16:16:41.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.349+0000 7faf40ff9640 1 -- 172.21.15.119:0/414283046 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf3c054a20 con 0x7faf44159fb0 2023-12-19T16:16:41.355 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:16:41.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faf24065a60 msgr2=0x7faf24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faf24065a60 0x7faf24067f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf340ae000 tx=0x7faf340a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 msgr2=0x7faf441547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 0x7faf441547a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007e60 tx=0x7faf3c00e4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 shutdown_connections 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faf24065a60 0x7faf24067f20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf440ca410 0x7faf44151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf44159fb0 0x7faf441547a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 --2- 172.21.15.119:0/414283046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf44071db0 0x7faf440ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 >> 172.21.15.119:0/414283046 conn(0x7faf4406a2a0 msgr2=0x7faf44153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 shutdown_connections 2023-12-19T16:16:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.353+0000 7faf49afc640 1 -- 172.21.15.119:0/414283046 wait complete. 2023-12-19T16:16:41.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:16:41.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 Processor -- start 2023-12-19T16:16:41.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 -- start start 2023-12-19T16:16:41.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 0x7f24c00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24c00c9e30 0x7f24c0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00c9460 con 0x7f24c01570c0 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c01574a0 con 0x7f24c00c9e30 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c8073640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c8b30 con 0x7f24c006c4f0 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c5e0f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f24c01570c0 0x7f24c006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52984/0 (socket says 172.21.15.119:52984) 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c5e0f640 1 -- 172.21.15.119:0/2171626718 learned_addr learned my addr 172.21.15.119:0/2171626718 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c6610640 1 --2- 172.21.15.119:0/2171626718 >> v2:172.21.15.143:3300/0 conn(0x7f24c00c9e30 0x7f24c0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c560e640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 0x7f24c00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058675318 0 0) 0x7f24c00c9460 con 0x7f24c01570c0 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ac003530 con 0x7f24c01570c0 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945382019 0 0) 0x7f24ac003530 con 0x7f24c01570c0 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 msgr2=0x7f24c00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 0x7f24c00c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 >> v2:172.21.15.143:3300/0 conn(0x7f24c00c9e30 msgr2=0x7f24c0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 --2- 172.21.15.119:0/2171626718 >> v2:172.21.15.143:3300/0 conn(0x7f24c00c9e30 0x7f24c0070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00c8e10 con 0x7f24c01570c0 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f24bc001680 con 0x7f24c01570c0 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 >> v1:172.21.15.119:6789/0 conn(0x7f24c01570c0 legacy=0x7f24c006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24ac003980 0x7f24ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 0x7f24ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24ac004d10 0x7f24ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c01574a0 con 0x7f24ac004d10 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c8b30 con 0x7f24ac003980 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac00b990 con 0x7f24c006c4f0 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c6610640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24ac004d10 0x7f24ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c5e0f640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24ac003980 0x7f24ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.509+0000 7f24c560e640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 0x7f24ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 -- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 msgr2=0x7f24ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24c006c4f0 0x7f24ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 -- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24ac003980 msgr2=0x7f24ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24ac003980 0x7f24ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 -- 172.21.15.119:0/2171626718 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac003530 con 0x7f24ac004d10 2023-12-19T16:16:41.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24ac004d10 0x7f24ac005190 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009fa0 tx=0x7f24b801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bae794e08b4bc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80a5d30 con 0x7f24ac004d10 2023-12-19T16:16:41.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800f040 con 0x7f24ac004d10 2023-12-19T16:16:41.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c4e0d640 1 -- 172.21.15.119:0/2171626718 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80ad660 con 0x7f24ac004d10 2023-12-19T16:16:41.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c8073640 1 -- 172.21.15.119:0/2171626718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24ac004d10 msgr2=0x7f24ac005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c8073640 1 --2- 172.21.15.119:0/2171626718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24ac004d10 0x7f24ac005190 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009fa0 tx=0x7f24b801cc60 comp rx=0 tx=0).stop 2023-12-19T16:16:41.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c6610640 1 -- 172.21.15.119:0/2171626718 reap_dead start 2023-12-19T16:16:41.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c8073640 1 -- 172.21.15.119:0/2171626718 shutdown_connections 2023-12-19T16:16:41.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.513+0000 7f24c8073640 1 -- 172.21.15.119:0/2171626718 >> 172.21.15.119:0/2171626718 conn(0x7f24c006a3e0 msgr2=0x7f24c00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 -- 172.21.15.119:0/2171626718 shutdown_connections 2023-12-19T16:16:41.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 -- 172.21.15.119:0/2171626718 wait complete. 2023-12-19T16:16:41.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 Processor -- start 2023-12-19T16:16:41.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 -- start start 2023-12-19T16:16:41.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24ac004d10 0x7f24c0150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c00cd0a0 0x7f24c00c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 0x7f24c0071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00717b0 con 0x7f24c0070df0 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c5640 con 0x7f24c00cd0a0 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c8073640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c5920 con 0x7f24ac004d10 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 0x7f24c0071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 0x7f24c0071270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41988/0 (socket says 172.21.15.119:41988) 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 -- 172.21.15.119:0/876389431 learned_addr learned my addr 172.21.15.119:0/876389431 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c560e640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c00cd0a0 0x7f24c00c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c5e0f640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24ac004d10 0x7f24c0150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 -- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24ac004d10 msgr2=0x7f24c0150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24ac004d10 0x7f24c0150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 -- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c00cd0a0 msgr2=0x7f24c00c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c00cd0a0 0x7f24c00c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 -- 172.21.15.119:0/876389431 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00c5c00 con 0x7f24c0070df0 2023-12-19T16:16:41.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c5e0f640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24ac004d10 0x7f24c0150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:41.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24c6610640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 0x7f24c0071270 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b0040 tx=0x7f24b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.517+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80be070 con 0x7f24c0070df0 2023-12-19T16:16:41.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b80ad650 con 0x7f24c0070df0 2023-12-19T16:16:41.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80ad800 con 0x7f24c0070df0 2023-12-19T16:16:41.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00cc5c0 con 0x7f24c0070df0 2023-12-19T16:16:41.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c00ccb80 con 0x7f24c0070df0 2023-12-19T16:16:41.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00735b0 con 0x7f24c0070df0 2023-12-19T16:16:41.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24b80b4040 con 0x7f24c0070df0 2023-12-19T16:16:41.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24b67fc640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f24a40659f0 0x7f24a4067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f24b811d380 con 0x7f24c0070df0 2023-12-19T16:16:41.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24c5e0f640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f24a40659f0 0x7f24a4067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.521+0000 7f24c5e0f640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f24a40659f0 0x7f24a4067eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24bc001cc0 tx=0x7f24bc007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.525+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f24b80eafd0 con 0x7f24c0070df0 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.677+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f24c004e000 con 0x7f24c0070df0 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.677+0000 7f24b67fc640 1 -- 172.21.15.119:0/876389431 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f24b80ee5f0 con 0x7f24c0070df0 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:41.684 INFO:teuthology.orchestra.run.smithi119.stdout:] 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f24a40659f0 msgr2=0x7f24a4067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f24a40659f0 0x7f24a4067eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24bc001cc0 tx=0x7f24bc007900 comp rx=0 tx=0).stop 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 msgr2=0x7f24c0071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 0x7f24c0071270 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b0040 tx=0x7f24b8009750 comp rx=0 tx=0).stop 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 shutdown_connections 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f24a40659f0 0x7f24a4067eb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c00cd0a0 0x7f24c00c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c0070df0 0x7f24c0071270 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 --2- 172.21.15.119:0/876389431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24ac004d10 0x7f24c0150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 >> 172.21.15.119:0/876389431 conn(0x7f24c006a3e0 msgr2=0x7f24c0151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 shutdown_connections 2023-12-19T16:16:41.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.681+0000 7f24c8073640 1 -- 172.21.15.119:0/876389431 wait complete. 2023-12-19T16:16:41.705 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:16:41.705 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 Processor -- start 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 -- start start 2023-12-19T16:16:41.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c160e90 0x7fc54c165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc54c0c1a80 0x7fc54c0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0b20a0 con 0x7fc54c06be20 2023-12-19T16:16:41.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0b2380 con 0x7fc54c0c1a80 2023-12-19T16:16:41.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc553952640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0cc5b0 con 0x7fc54c160e90 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc551eef640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc54c0c1a80 0x7fc54c0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc5516ee640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c160e90 0x7fc54c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc551eef640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc54c0c1a80 0x7fc54c0cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:38084/0 (socket says 172.21.15.119:38084) 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.841+0000 7fc551eef640 1 -- 172.21.15.119:0/3400896093 learned_addr learned my addr 172.21.15.119:0/3400896093 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc551eef640 1 -- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c160e90 msgr2=0x7fc54c165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc551eef640 1 --2- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c160e90 0x7fc54c165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc551eef640 1 -- 172.21.15.119:0/3400896093 >> v1:172.21.15.143:6789/0 conn(0x7fc54c06be20 legacy=0x7fc54c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc551eef640 1 -- 172.21.15.119:0/3400896093 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0cc890 con 0x7fc54c0c1a80 2023-12-19T16:16:41.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc543fff640 1 -- 172.21.15.119:0/3400896093 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087565000 0 0) 0x7fc54c0b20a0 con 0x7fc54c06be20 2023-12-19T16:16:41.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc551eef640 1 --2- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c0cd090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc544009e50 tx=0x7fc54401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e544ccb47acb2dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc543fff640 1 -- 172.21.15.119:0/3400896093 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440a5770 con 0x7fc54c0c1a80 2023-12-19T16:16:41.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc543fff640 1 -- 172.21.15.119:0/3400896093 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440a58d0 con 0x7fc54c0c1a80 2023-12-19T16:16:41.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc543fff640 1 -- 172.21.15.119:0/3400896093 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440a5c60 con 0x7fc54c0c1a80 2023-12-19T16:16:41.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc553952640 1 -- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 msgr2=0x7fc54c0cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.845+0000 7fc553952640 1 --2- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c0cd090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc544009e50 tx=0x7fc54401ca10 comp rx=0 tx=0).stop 2023-12-19T16:16:41.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- 172.21.15.119:0/3400896093 shutdown_connections 2023-12-19T16:16:41.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 --2- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c0cd090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 --2- 172.21.15.119:0/3400896093 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c160e90 0x7fc54c165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- 172.21.15.119:0/3400896093 >> 172.21.15.119:0/3400896093 conn(0x7fc54c069e70 msgr2=0x7fc54c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- 172.21.15.119:0/3400896093 shutdown_connections 2023-12-19T16:16:41.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- 172.21.15.119:0/3400896093 wait complete. 2023-12-19T16:16:41.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 Processor -- start 2023-12-19T16:16:41.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- start start 2023-12-19T16:16:41.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c06be20 0x7fc54c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c1613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 0x7fc54c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c06d070 con 0x7fc54c160e90 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c159b10 con 0x7fc54c0c1a80 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc553952640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0c69a0 con 0x7fc54c06be20 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 0x7fc54c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc5516ee640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c06be20 0x7fc54c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc550eed640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c1613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc5516ee640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c06be20 0x7fc54c06cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:55956/0 (socket says 172.21.15.119:55956) 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 0x7fc54c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41994/0 (socket says 172.21.15.119:41994) 2023-12-19T16:16:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc5516ee640 1 -- 172.21.15.119:0/1765029028 learned_addr learned my addr 172.21.15.119:0/1765029028 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 -- 172.21.15.119:0/1765029028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c06be20 msgr2=0x7fc54c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c06be20 0x7fc54c06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 -- 172.21.15.119:0/1765029028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 msgr2=0x7fc54c1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c1613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.849+0000 7fc551eef640 1 -- 172.21.15.119:0/1765029028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009b30 con 0x7fc54c160e90 2023-12-19T16:16:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc551eef640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 0x7fc54c157770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc5440ab000 tx=0x7fc5440197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440bd070 con 0x7fc54c160e90 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440b8470 con 0x7fc54c160e90 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440b8840 con 0x7fc54c160e90 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c0c6c80 con 0x7fc54c160e90 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c1597a0 con 0x7fc54c160e90 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c04e070 con 0x7fc54c160e90 2023-12-19T16:16:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5440b89a0 con 0x7fc54c160e90 2023-12-19T16:16:41.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc541ffb640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc530065a60 0x7fc530067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc54411d990 con 0x7fc54c160e90 2023-12-19T16:16:41.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.853+0000 7fc5516ee640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc530065a60 0x7fc530067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.857+0000 7fc5516ee640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc530065a60 0x7fc530067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc54c158190 tx=0x7fc548009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:41.857+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc5440eb610 con 0x7fc54c160e90 2023-12-19T16:16:42.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.009+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc54c0720c0 con 0x7fc54c160e90 2023-12-19T16:16:42.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.317+0000 7fc541ffb640 1 -- 172.21.15.119:0/1765029028 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc5440eec30 con 0x7fc54c160e90 2023-12-19T16:16:42.324 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2023-12-19T16:16:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc530065a60 msgr2=0x7fc530067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:42.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc530065a60 0x7fc530067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc54c158190 tx=0x7fc548009190 comp rx=0 tx=0).stop 2023-12-19T16:16:42.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 msgr2=0x7fc54c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:42.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 0x7fc54c157770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc5440ab000 tx=0x7fc5440197b0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 shutdown_connections 2023-12-19T16:16:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc530065a60 0x7fc530067f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc54c0c1a80 0x7fc54c1613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c160e90 0x7fc54c157770 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 --2- 172.21.15.119:0/1765029028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc54c06be20 0x7fc54c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 >> 172.21.15.119:0/1765029028 conn(0x7fc54c069e70 msgr2=0x7fc54c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:42.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 shutdown_connections 2023-12-19T16:16:42.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.321+0000 7fc553952640 1 -- 172.21.15.119:0/1765029028 wait complete. 2023-12-19T16:16:42.350 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:16:42.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 Processor -- start 2023-12-19T16:16:42.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 -- start start 2023-12-19T16:16:42.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0c015ca40 0x7fc0c00658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:42.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0c0065e20 0x7fc0c006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:42.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c015ce20 con 0x7fc0c006ca20 2023-12-19T16:16:42.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00662b0 con 0x7fc0c0065e20 2023-12-19T16:16:42.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0c6df0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c0069e20 con 0x7fc0c015ca40 2023-12-19T16:16:42.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0c0065e20 0x7fc0c006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:42.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0c0065e20 0x7fc0c006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45266/0 (socket says 172.21.15.119:45266) 2023-12-19T16:16:42.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 -- 172.21.15.119:0/237862962 learned_addr learned my addr 172.21.15.119:0/237862962 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:42.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 -- 172.21.15.119:0/237862962 >> v2:172.21.15.143:3300/0 conn(0x7fc0c015ca40 msgr2=0x7fc0c00658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:42.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 --2- 172.21.15.119:0/237862962 >> v2:172.21.15.143:3300/0 conn(0x7fc0c015ca40 0x7fc0c00658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 -- 172.21.15.119:0/237862962 >> v1:172.21.15.119:6789/0 conn(0x7fc0c006ca20 legacy=0x7fc0c0160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:42.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.489+0000 7fc0b7fff640 1 -- 172.21.15.119:0/237862962 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c006a0e0 con 0x7fc0c0065e20 2023-12-19T16:16:42.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0b7fff640 1 --2- 172.21.15.119:0/237862962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c0065e20 0x7fc0c006c4e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0c006e680 tx=0x7fc0b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a8bdef3e15418 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:42.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0b77fe640 1 -- 172.21.15.119:0/237862962 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00aa430 con 0x7fc0c0065e20 2023-12-19T16:16:42.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0b77fe640 1 -- 172.21.15.119:0/237862962 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b00aa590 con 0x7fc0c0065e20 2023-12-19T16:16:42.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0b77fe640 1 -- 172.21.15.119:0/237862962 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00aa920 con 0x7fc0c0065e20 2023-12-19T16:16:42.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 -- 172.21.15.119:0/237862962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c0065e20 msgr2=0x7fc0c006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:42.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/237862962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c0065e20 0x7fc0c006c4e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0c006e680 tx=0x7fc0b001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 -- 172.21.15.119:0/237862962 shutdown_connections 2023-12-19T16:16:42.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/237862962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c0065e20 0x7fc0c006c4e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/237862962 >> v2:172.21.15.143:3300/0 conn(0x7fc0c015ca40 0x7fc0c00658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 -- 172.21.15.119:0/237862962 >> 172.21.15.119:0/237862962 conn(0x7fc0c00b08f0 msgr2=0x7fc0c00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:42.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 -- 172.21.15.119:0/237862962 shutdown_connections 2023-12-19T16:16:42.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.493+0000 7fc0c6df0640 1 -- 172.21.15.119:0/237862962 wait complete. 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 Processor -- start 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 -- start start 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0c0065e20 0x7fc0c0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0c006ca20 0x7fc0c015be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 0x7fc0c0150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c01515f0 con 0x7fc0c015ca40 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c01506d0 con 0x7fc0c006ca20 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0150bc0 con 0x7fc0c0065e20 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 0x7fc0c0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:42.506 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 0x7fc0c0150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45276/0 (socket says 172.21.15.119:45276) 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 -- 172.21.15.119:0/3139192543 learned_addr learned my addr 172.21.15.119:0/3139192543 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c4b8c640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0c0065e20 0x7fc0c0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0b7fff640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0c006ca20 0x7fc0c015be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 -- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0c0065e20 msgr2=0x7fc0c0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0c0065e20 0x7fc0c0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 -- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0c006ca20 msgr2=0x7fc0c015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0c006ca20 0x7fc0c015be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 -- 172.21.15.119:0/3139192543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00094d0 con 0x7fc0c015ca40 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c4b8c640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0c0065e20 0x7fc0c0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c538d640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 0x7fc0c0150190 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c770 tx=0x7fc0b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8003b80 con 0x7fc0c015ca40 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8003ce0 con 0x7fc0c015ca40 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c01508e0 con 0x7fc0c015ca40 2023-12-19T16:16:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b800aa90 con 0x7fc0c015ca40 2023-12-19T16:16:42.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.497+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c0151210 con 0x7fc0c015ca40 2023-12-19T16:16:42.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.501+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c0151730 con 0x7fc0c015ca40 2023-12-19T16:16:42.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.501+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0b800abf0 con 0x7fc0c015ca40 2023-12-19T16:16:42.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.501+0000 7fc0b57fa640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0ac065a60 0x7fc0ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:42.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.501+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fc0b8082f10 con 0x7fc0c015ca40 2023-12-19T16:16:42.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.501+0000 7fc0c4b8c640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0ac065a60 0x7fc0ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:42.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.501+0000 7fc0c4b8c640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0ac065a60 0x7fc0ac067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc006fd0 tx=0x7fc0bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:42.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.505+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0c0151730 con 0x7fc0c015ca40 2023-12-19T16:16:42.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:42.661+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc0c0151730 con 0x7fc0c015ca40 2023-12-19T16:16:43.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.325+0000 7fc0b57fa640 1 -- 172.21.15.119:0/3139192543 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc0c0151730 con 0x7fc0c015ca40 2023-12-19T16:16:43.334 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2023-12-19T16:16:43.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0ac065a60 msgr2=0x7fc0ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0ac065a60 0x7fc0ac067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc006fd0 tx=0x7fc0bc008040 comp rx=0 tx=0).stop 2023-12-19T16:16:43.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 msgr2=0x7fc0c0150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 0x7fc0c0150190 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c770 tx=0x7fc0b800cc30 comp rx=0 tx=0).stop 2023-12-19T16:16:43.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 shutdown_connections 2023-12-19T16:16:43.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0ac065a60 0x7fc0ac067f20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0c006ca20 0x7fc0c015be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0c015ca40 0x7fc0c0150190 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 --2- 172.21.15.119:0/3139192543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0c0065e20 0x7fc0c0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.337+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 >> 172.21.15.119:0/3139192543 conn(0x7fc0c00b08f0 msgr2=0x7fc0c0158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:43.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.341+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 shutdown_connections 2023-12-19T16:16:43.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.341+0000 7fc0c6df0640 1 -- 172.21.15.119:0/3139192543 wait complete. 2023-12-19T16:16:43.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:16:43.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe342709640 1 Processor -- start 2023-12-19T16:16:43.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe342709640 1 -- start start 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe342709640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe33c0b2780 0x7fe33c1610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe342709640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0ced90 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe342709640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0cf220 con 0x7fe33c15cbd0 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe342709640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c15cfb0 con 0x7fe33c0b2780 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe340ca6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe33c0cc7f0 0x7fe33c06b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46702/0 (socket says 172.21.15.119:46702) 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe340ca6640 1 -- 172.21.15.119:0/2792748053 learned_addr learned my addr 172.21.15.119:0/2792748053 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:43.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33b7fe640 1 --2- 172.21.15.119:0/2792748053 >> v2:172.21.15.143:3300/0 conn(0x7fe33c0b2780 0x7fe33c1610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528183689 0 0) 0x7fe33c0ced90 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe324003530 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365377352 0 0) 0x7fe33c0cf220 con 0x7fe33c15cbd0 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c0ced90 con 0x7fe33c15cbd0 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2792748053 >> v1:172.21.15.143:6789/0 conn(0x7fe33c15cbd0 legacy=0x7fe33c0b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281883861 0 0) 0x7fe324003530 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2792748053 >> v1:172.21.15.119:6789/0 conn(0x7fe33c0cc7f0 legacy=0x7fe33c06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.509+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2792748053 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0ce1c0 con 0x7fe33c0b2780 2023-12-19T16:16:43.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe33b7fe640 1 --2- 172.21.15.119:0/2792748053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c0b2780 0x7fe33c1610f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3300097c0 tx=0x7fe33001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c221d9d27042c452 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3300a4ea0 con 0x7fe33c0b2780 2023-12-19T16:16:43.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3300a7050 con 0x7fe33c0b2780 2023-12-19T16:16:43.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe33affd640 1 -- 172.21.15.119:0/2792748053 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334001a00 con 0x7fe33c0b2780 2023-12-19T16:16:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 -- 172.21.15.119:0/2792748053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c0b2780 msgr2=0x7fe33c1610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 --2- 172.21.15.119:0/2792748053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c0b2780 0x7fe33c1610f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3300097c0 tx=0x7fe33001c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 -- 172.21.15.119:0/2792748053 shutdown_connections 2023-12-19T16:16:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 --2- 172.21.15.119:0/2792748053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c0b2780 0x7fe33c1610f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 -- 172.21.15.119:0/2792748053 >> 172.21.15.119:0/2792748053 conn(0x7fe33c0cd070 msgr2=0x7fe33c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 -- 172.21.15.119:0/2792748053 shutdown_connections 2023-12-19T16:16:43.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.513+0000 7fe342709640 1 -- 172.21.15.119:0/2792748053 wait complete. 2023-12-19T16:16:43.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 Processor -- start 2023-12-19T16:16:43.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 -- start start 2023-12-19T16:16:43.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe33c0b2780 0x7fe33c0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 0x7fe33c0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c15cbd0 0x7fe33c1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0c8540 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0b3a40 con 0x7fe33c15cbd0 2023-12-19T16:16:43.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0b3d20 con 0x7fe33c0b2780 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 0x7fe33c0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 0x7fe33c0c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45290/0 (socket says 172.21.15.119:45290) 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2902912906 learned_addr learned my addr 172.21.15.119:0/2902912906 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33bfff640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe33c0b2780 0x7fe33c0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe340ca6640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c15cbd0 0x7fe33c1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe33c0b2780 msgr2=0x7fe33c0c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe33c0b2780 0x7fe33c0c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c15cbd0 msgr2=0x7fe33c1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c15cbd0 0x7fe33c1541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 -- 172.21.15.119:0/2902912906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009420 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe340ca6640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c15cbd0 0x7fe33c1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33bfff640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe33c0b2780 0x7fe33c0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe33b7fe640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 0x7fe33c0c6650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe33001c880 tx=0x7fe330019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330006e20 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330004020 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c0c7ca0 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3300043d0 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.517+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c0c8260 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.521+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c154dd0 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.521+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3300b2040 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.521+0000 7fe338ff9640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe328065a90 0x7fe328067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.521+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fe33011d3a0 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.521+0000 7fe33bfff640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe328065a90 0x7fe328067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.521+0000 7fe33bfff640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe328065a90 0x7fe328067f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe32c001240 tx=0x7fe32c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.531 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.525+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe3300eacf0 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.709+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe33c04e000 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.717+0000 7fe338ff9640 1 -- 172.21.15.119:0/2902912906 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe3300ee310 con 0x7fe33c0cc7f0 2023-12-19T16:16:43.721 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 5 and data pool 6 2023-12-19T16:16:43.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe328065a90 msgr2=0x7fe328067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe328065a90 0x7fe328067f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe32c001240 tx=0x7fe32c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:43.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 msgr2=0x7fe33c0c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 0x7fe33c0c6650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe33001c880 tx=0x7fe330019140 comp rx=0 tx=0).stop 2023-12-19T16:16:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 shutdown_connections 2023-12-19T16:16:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe328065a90 0x7fe328067f50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe33c15cbd0 0x7fe33c1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe33c0cc7f0 0x7fe33c0c6650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 --2- 172.21.15.119:0/2902912906 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe33c0b2780 0x7fe33c0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.721+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 >> 172.21.15.119:0/2902912906 conn(0x7fe33c0cd070 msgr2=0x7fe33c15fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:43.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.725+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 shutdown_connections 2023-12-19T16:16:43.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.729+0000 7fe342709640 1 -- 172.21.15.119:0/2902912906 wait complete. 2023-12-19T16:16:43.766 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:43.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.897+0000 7fb5fa5f0640 1 Processor -- start 2023-12-19T16:16:43.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.897+0000 7fb5fa5f0640 1 -- start start 2023-12-19T16:16:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.897+0000 7fb5fa5f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 0x7fb5f415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.897+0000 7fb5fa5f0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f415f100 con 0x7fb5f415a680 2023-12-19T16:16:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.897+0000 7fb5fa5f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f40ca7d0 con 0x7fb5f406fdb0 2023-12-19T16:16:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.897+0000 7fb5fa5f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f415e860 con 0x7fb5f40cac10 2023-12-19T16:16:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb5f415a680 0x7fb5f415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46704/0 (socket says 172.21.15.119:46704) 2023-12-19T16:16:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 -- 172.21.15.119:0/1284457536 learned_addr learned my addr 172.21.15.119:0/1284457536 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:43.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227426789 0 0) 0x7fb5f415f100 con 0x7fb5f415a680 2023-12-19T16:16:43.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f37fe640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 0x7fb5f415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5dc003530 con 0x7fb5f415a680 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3728123446 0 0) 0x7fb5dc003530 con 0x7fb5f415a680 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 msgr2=0x7fb5f415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 0x7fb5f415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 >> v1:172.21.15.143:6789/0 conn(0x7fb5f406fdb0 legacy=0x7fb5f40c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f415eb40 con 0x7fb5f415a680 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fb5e4001680 con 0x7fb5f415a680 2023-12-19T16:16:43.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 >> v1:172.21.15.119:6789/0 conn(0x7fb5f415a680 legacy=0x7fb5f415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 0x7fb5dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5dc004d10 0x7fb5dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f415e860 con 0x7fb5dc0039b0 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc00baf0 con 0x7fb5dc004d10 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc00bcb0 con 0x7fb5f40cac10 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f37fe640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 0x7fb5dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f8b8d640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5dc004d10 0x7fb5dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 -- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 msgr2=0x7fb5dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:43.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f40cac10 0x7fb5dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 -- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5dc004d10 msgr2=0x7fb5dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:43.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5dc004d10 0x7fb5dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.901+0000 7fb5f3fff640 1 -- 172.21.15.119:0/1284457536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc003530 con 0x7fb5dc0039b0 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c240 tx=0x7fb5e401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4c407bdf0deab9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4005ae0 con 0x7fb5dc0039b0 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4005c40 con 0x7fb5dc0039b0 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5f2ffd640 1 -- 172.21.15.119:0/1284457536 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40a5830 con 0x7fb5dc0039b0 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/1284457536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 msgr2=0x7fb5dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/1284457536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c240 tx=0x7fb5e401cb50 comp rx=0 tx=0).stop 2023-12-19T16:16:43.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5f8b8d640 1 -- 172.21.15.119:0/1284457536 reap_dead start 2023-12-19T16:16:43.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/1284457536 shutdown_connections 2023-12-19T16:16:43.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/1284457536 >> 172.21.15.119:0/1284457536 conn(0x7fb5f406a3e0 msgr2=0x7fb5f40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:43.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/1284457536 shutdown_connections 2023-12-19T16:16:43.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/1284457536 wait complete. 2023-12-19T16:16:43.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 Processor -- start 2023-12-19T16:16:43.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.905+0000 7fb5fa5f0640 1 -- start start 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5f414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5f4150510 0x7fb5f415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f4159250 0x7fb5f4159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4159c40 con 0x7fb5dc0039b0 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4150390 con 0x7fb5f4150510 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f415de60 con 0x7fb5f4159250 2023-12-19T16:16:43.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5f414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5f414fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45306/0 (socket says 172.21.15.119:45306) 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 -- 172.21.15.119:0/2788703441 learned_addr learned my addr 172.21.15.119:0/2788703441 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f8b8d640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f4159250 0x7fb5f4159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f37fe640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5f4150510 0x7fb5f415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 -- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f4159250 msgr2=0x7fb5f4159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f4159250 0x7fb5f4159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 -- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5f4150510 msgr2=0x7fb5f415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5f4150510 0x7fb5f415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 -- 172.21.15.119:0/2788703441 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f415c100 con 0x7fb5dc0039b0 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f3fff640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5f414fe50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb5e401c980 tx=0x7fb5dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40b4070 con 0x7fb5dc0039b0 2023-12-19T16:16:43.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4001440 con 0x7fb5dc0039b0 2023-12-19T16:16:43.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40a5830 con 0x7fb5dc0039b0 2023-12-19T16:16:43.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f415c3e0 con 0x7fb5dc0039b0 2023-12-19T16:16:43.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f415c9a0 con 0x7fb5dc0039b0 2023-12-19T16:16:43.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f40735b0 con 0x7fb5dc0039b0 2023-12-19T16:16:43.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.909+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5e40a59b0 con 0x7fb5dc0039b0 2023-12-19T16:16:43.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.913+0000 7fb5f0ff9640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5e0065a60 0x7fb5e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.913+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5e411cdb0 con 0x7fb5dc0039b0 2023-12-19T16:16:43.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.913+0000 7fb5f37fe640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5e0065a60 0x7fb5e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.913+0000 7fb5f37fe640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5e0065a60 0x7fb5e0067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40ae1c0 tx=0x7fb5e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:43.917+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb5e40ea640 con 0x7fb5dc0039b0 2023-12-19T16:16:44.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.065+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5f404e000 con 0x7fb5dc0039b0 2023-12-19T16:16:44.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5f0ff9640 1 -- 172.21.15.119:0/2788703441 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16367 (secure 0 0 0) 0x7fb5e40edc60 con 0x7fb5dc0039b0 2023-12-19T16:16:44.075 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:44.075 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":38,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:43.714175+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5e0065a60 msgr2=0x7fb5e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5e0065a60 0x7fb5e0067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40ae1c0 tx=0x7fb5e8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 msgr2=0x7fb5f414fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5f414fe50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb5e401c980 tx=0x7fb5dc005800 comp rx=0 tx=0).stop 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 shutdown_connections 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5e0065a60 0x7fb5e0067f20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5f4150510 0x7fb5f415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5f4159250 0x7fb5f4159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 --2- 172.21.15.119:0/2788703441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5dc0039b0 0x7fb5f414fe50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 >> 172.21.15.119:0/2788703441 conn(0x7fb5f406a3e0 msgr2=0x7fb5f40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 shutdown_connections 2023-12-19T16:16:44.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.069+0000 7fb5fa5f0640 1 -- 172.21.15.119:0/2788703441 wait complete. 2023-12-19T16:16:44.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 Processor -- start 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 -- start start 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c1c15ca40 0x7f2c1c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2c1c0ce3f0 0x7f2c1c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c0d11c0 con 0x7f2c1c0cf610 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0cfaa0 con 0x7f2c1c15ca40 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c226d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0d0310 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c1c15ca40 0x7f2c1c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c1c15ca40 0x7f2c1c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45308/0 (socket says 172.21.15.119:45308) 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 -- 172.21.15.119:0/1300038746 learned_addr learned my addr 172.21.15.119:0/1300038746 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 -- 172.21.15.119:0/1300038746 >> v2:172.21.15.143:3300/0 conn(0x7f2c1c0ce3f0 msgr2=0x7f2c1c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1b7fe640 1 --2- 172.21.15.119:0/1300038746 >> v2:172.21.15.143:3300/0 conn(0x7f2c1c0ce3f0 0x7f2c1c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 --2- 172.21.15.119:0/1300038746 >> v2:172.21.15.143:3300/0 conn(0x7f2c1c0ce3f0 0x7f2c1c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 -- 172.21.15.119:0/1300038746 >> v1:172.21.15.119:6789/0 conn(0x7f2c1c0cf610 legacy=0x7f2c1c1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1bfff640 1 -- 172.21.15.119:0/1300038746 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0d05b0 con 0x7f2c1c15ca40 2023-12-19T16:16:44.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.229+0000 7f2c1b7fe640 1 --2- 172.21.15.119:0/1300038746 >> v2:172.21.15.143:3300/0 conn(0x7f2c1c0ce3f0 0x7f2c1c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:44.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c1bfff640 1 --2- 172.21.15.119:0/1300038746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c0cdeb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0d26d0 tx=0x7f2c0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf109816b8a28cd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c1affd640 1 -- 172.21.15.119:0/1300038746 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0ab620 con 0x7f2c1c15ca40 2023-12-19T16:16:44.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c1affd640 1 -- 172.21.15.119:0/1300038746 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0ab780 con 0x7f2c1c15ca40 2023-12-19T16:16:44.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c1affd640 1 -- 172.21.15.119:0/1300038746 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0abb10 con 0x7f2c1c15ca40 2023-12-19T16:16:44.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 -- 172.21.15.119:0/1300038746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c15ca40 msgr2=0x7f2c1c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 --2- 172.21.15.119:0/1300038746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c0cdeb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0d26d0 tx=0x7f2c0c01c500 comp rx=0 tx=0).stop 2023-12-19T16:16:44.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 -- 172.21.15.119:0/1300038746 shutdown_connections 2023-12-19T16:16:44.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 --2- 172.21.15.119:0/1300038746 >> v2:172.21.15.143:3300/0 conn(0x7f2c1c0ce3f0 0x7f2c1c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 --2- 172.21.15.119:0/1300038746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c0cdeb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 -- 172.21.15.119:0/1300038746 >> 172.21.15.119:0/1300038746 conn(0x7f2c1c089fb0 msgr2=0x7f2c1c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 -- 172.21.15.119:0/1300038746 shutdown_connections 2023-12-19T16:16:44.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.233+0000 7f2c226d1640 1 -- 172.21.15.119:0/1300038746 wait complete. 2023-12-19T16:16:44.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 Processor -- start 2023-12-19T16:16:44.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- start start 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 0x7f2c1c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1c0cf610 0x7f2c1c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c1543b0 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c159eb0 con 0x7f2c1c15ca40 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0b1190 con 0x7f2c1c0cf610 2023-12-19T16:16:44.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 0x7f2c1c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 0x7f2c1c159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45320/0 (socket says 172.21.15.119:45320) 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 -- 172.21.15.119:0/2203632451 learned_addr learned my addr 172.21.15.119:0/2203632451 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1b7fe640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1c0cf610 0x7f2c1c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c20c6e640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 -- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1c0cf610 msgr2=0x7f2c1c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1c0cf610 0x7f2c1c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 -- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1c15ca40 msgr2=0x7f2c1c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 -- 172.21.15.119:0/2203632451 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009480 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c1bfff640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 0x7f2c1c159820 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c019110 tx=0x7f2c0c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0ab8f0 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0aba70 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0abe20 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c14e190 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c0b0eb0 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.237+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c04e000 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.241+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c0c003620 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.241+0000 7f2c18ff9640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2c08065a90 0x7f2c08067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.241+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c0c11d800 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.241+0000 7f2c1b7fe640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2c08065a90 0x7f2c08067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.241+0000 7f2c1b7fe640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2c08065a90 0x7f2c08067f50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0b07a0 tx=0x7f2c10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.245+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2c0c0eaff0 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.397+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c1c0cff10 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.397+0000 7f2c18ff9640 1 -- 172.21.15.119:0/2203632451 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f2c0c0ee610 con 0x7f2c1c0ce3f0 2023-12-19T16:16:44.403 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:44.404 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":38,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:43.714175+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:44.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2c08065a90 msgr2=0x7f2c08067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2c08065a90 0x7f2c08067f50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0b07a0 tx=0x7f2c10008040 comp rx=0 tx=0).stop 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 msgr2=0x7f2c1c159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 0x7f2c1c159820 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c019110 tx=0x7f2c0c0192a0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 shutdown_connections 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2c08065a90 0x7f2c08067f50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1c15ca40 0x7f2c1c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1c0cf610 0x7f2c1c154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 --2- 172.21.15.119:0/2203632451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c1c0ce3f0 0x7f2c1c159820 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 >> 172.21.15.119:0/2203632451 conn(0x7f2c1c089fb0 msgr2=0x7f2c1c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 shutdown_connections 2023-12-19T16:16:44.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.401+0000 7f2c226d1640 1 -- 172.21.15.119:0/2203632451 wait complete. 2023-12-19T16:16:44.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:16:44.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.557+0000 7f35af855640 1 Processor -- start 2023-12-19T16:16:44.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35af855640 1 -- start start 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35af855640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a81598d0 0x7f35a80ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35af855640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80c9730 con 0x7f35a80ce8d0 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35af855640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80c8e00 con 0x7f35a8153020 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35af855640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80ced60 con 0x7f35a81598d0 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35addf2640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f35a80ce8d0 0x7f35a8070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46722/0 (socket says 172.21.15.119:46722) 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35addf2640 1 -- 172.21.15.119:0/220859931 learned_addr learned my addr 172.21.15.119:0/220859931 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35acdf0640 1 --2- 172.21.15.119:0/220859931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a81598d0 0x7f35a80ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f359ffff640 1 -- 172.21.15.119:0/220859931 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558381509 0 0) 0x7f35a80c9730 con 0x7f35a80ce8d0 2023-12-19T16:16:44.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f359ffff640 1 -- 172.21.15.119:0/220859931 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3594003530 con 0x7f35a80ce8d0 2023-12-19T16:16:44.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f359ffff640 1 -- 172.21.15.119:0/220859931 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247271264 0 0) 0x7f35a80c8e00 con 0x7f35a8153020 2023-12-19T16:16:44.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35acdf0640 1 -- 172.21.15.119:0/220859931 >> v1:172.21.15.143:6789/0 conn(0x7f35a8153020 legacy=0x7f35a80c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35acdf0640 1 -- 172.21.15.119:0/220859931 >> v1:172.21.15.119:6789/0 conn(0x7f35a80ce8d0 legacy=0x7f35a8070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.561+0000 7f35acdf0640 1 -- 172.21.15.119:0/220859931 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a80c90e0 con 0x7f35a81598d0 2023-12-19T16:16:44.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35acdf0640 1 --2- 172.21.15.119:0/220859931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a81598d0 0x7f35a80ce390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f35980097f0 tx=0x7f359801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95fc16225a3472dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f359ffff640 1 -- 172.21.15.119:0/220859931 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980ab600 con 0x7f35a81598d0 2023-12-19T16:16:44.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f359ffff640 1 -- 172.21.15.119:0/220859931 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35980a7050 con 0x7f35a81598d0 2023-12-19T16:16:44.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f359ffff640 1 -- 172.21.15.119:0/220859931 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980ab980 con 0x7f35a81598d0 2023-12-19T16:16:44.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 -- 172.21.15.119:0/220859931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a81598d0 msgr2=0x7f35a80ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 --2- 172.21.15.119:0/220859931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a81598d0 0x7f35a80ce390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f35980097f0 tx=0x7f359801c370 comp rx=0 tx=0).stop 2023-12-19T16:16:44.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 -- 172.21.15.119:0/220859931 shutdown_connections 2023-12-19T16:16:44.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 --2- 172.21.15.119:0/220859931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a81598d0 0x7f35a80ce390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 -- 172.21.15.119:0/220859931 >> 172.21.15.119:0/220859931 conn(0x7f35a806a2a0 msgr2=0x7f35a80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 -- 172.21.15.119:0/220859931 shutdown_connections 2023-12-19T16:16:44.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 -- 172.21.15.119:0/220859931 wait complete. 2023-12-19T16:16:44.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.565+0000 7f35af855640 1 Processor -- start 2023-12-19T16:16:44.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- start start 2023-12-19T16:16:44.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a80ce8d0 0x7f35a8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35a8153020 0x7f35a8155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 0x7f35a8155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a815bef0 con 0x7f35a81598d0 2023-12-19T16:16:44.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a815bc10 con 0x7f35a8153020 2023-12-19T16:16:44.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a814a5d0 con 0x7f35a80ce8d0 2023-12-19T16:16:44.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 0x7f35a8155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 0x7f35a8155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45328/0 (socket says 172.21.15.119:45328) 2023-12-19T16:16:44.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 -- 172.21.15.119:0/1695644237 learned_addr learned my addr 172.21.15.119:0/1695644237 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:44.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35ad5f1640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a80ce8d0 0x7f35a8153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35acdf0640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35a8153020 0x7f35a8155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 -- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a80ce8d0 msgr2=0x7f35a8153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a80ce8d0 0x7f35a8153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 -- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35a8153020 msgr2=0x7f35a8155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35a8153020 0x7f35a8155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 -- 172.21.15.119:0/1695644237 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009420 con 0x7f35a81598d0 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35addf2640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 0x7f35a8155c60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f35a000caa0 tx=0x7f35a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000ac00 con 0x7f35a81598d0 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000ad60 con 0x7f35a81598d0 2023-12-19T16:16:44.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a814a8b0 con 0x7f35a81598d0 2023-12-19T16:16:44.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0012620 con 0x7f35a81598d0 2023-12-19T16:16:44.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a8153f40 con 0x7f35a81598d0 2023-12-19T16:16:44.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.569+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a80add70 con 0x7f35a81598d0 2023-12-19T16:16:44.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.573+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35a0007070 con 0x7f35a81598d0 2023-12-19T16:16:44.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.573+0000 7f359dffb640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f358c065a60 0x7f358c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.573+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f35a0083290 con 0x7f35a81598d0 2023-12-19T16:16:44.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.573+0000 7f35ad5f1640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f358c065a60 0x7f358c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.573+0000 7f35ad5f1640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f358c065a60 0x7f358c067f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007fd0 tx=0x7f35a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.577+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f35a0050b20 con 0x7f35a81598d0 2023-12-19T16:16:44.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:44.761+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35a814a430 con 0x7f35a81598d0 2023-12-19T16:16:45.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.721+0000 7f359dffb640 1 -- 172.21.15.119:0/1695644237 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f35a814a430 con 0x7f35a81598d0 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f358c065a60 msgr2=0x7f358c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f358c065a60 0x7f358c067f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007fd0 tx=0x7f35a4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 msgr2=0x7f35a8155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 0x7f35a8155c60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f35a000caa0 tx=0x7f35a000cf60 comp rx=0 tx=0).stop 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 shutdown_connections 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f358c065a60 0x7f358c067f20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35a8153020 0x7f35a8155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a81598d0 0x7f35a8155c60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 --2- 172.21.15.119:0/1695644237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35a80ce8d0 0x7f35a8153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 >> 172.21.15.119:0/1695644237 conn(0x7f35a806a2a0 msgr2=0x7f35a815cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:45.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 shutdown_connections 2023-12-19T16:16:45.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.725+0000 7f35af855640 1 -- 172.21.15.119:0/1695644237 wait complete. 2023-12-19T16:16:45.754 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:16:45.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:16:45.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 Processor -- start 2023-12-19T16:16:45.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 -- start start 2023-12-19T16:16:45.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7681598d0 0x7fc7680ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:45.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc7680ce8d0 0x7fc768070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:45.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680c9730 con 0x7fc768153020 2023-12-19T16:16:45.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680ced60 con 0x7fc7680ce8d0 2023-12-19T16:16:45.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76eb25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680c8e00 con 0x7fc7681598d0 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76d0c2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc7680ce8d0 0x7fc768070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76d0c2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc7680ce8d0 0x7fc768070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45340/0 (socket says 172.21.15.119:45340) 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.893+0000 7fc76d0c2640 1 -- 172.21.15.119:0/3254806478 learned_addr learned my addr 172.21.15.119:0/3254806478 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc75ffff640 1 --2- 172.21.15.119:0/3254806478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7681598d0 0x7fc7680ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76d0c2640 1 -- 172.21.15.119:0/3254806478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7681598d0 msgr2=0x7fc7680ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76d0c2640 1 --2- 172.21.15.119:0/3254806478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7681598d0 0x7fc7680ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76d0c2640 1 -- 172.21.15.119:0/3254806478 >> v1:172.21.15.143:6789/0 conn(0x7fc768153020 legacy=0x7fc7680c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:45.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76d0c2640 1 -- 172.21.15.119:0/3254806478 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680c90e0 con 0x7fc7680ce8d0 2023-12-19T16:16:45.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76d0c2640 1 --2- 172.21.15.119:0/3254806478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7680ce8d0 0x7fc768070590 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc760009e50 tx=0x7fc76001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2ede79b5662479 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:45.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc75f7fe640 1 -- 172.21.15.119:0/3254806478 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600a57a0 con 0x7fc7680ce8d0 2023-12-19T16:16:45.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc75f7fe640 1 -- 172.21.15.119:0/3254806478 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600a5900 con 0x7fc7680ce8d0 2023-12-19T16:16:45.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc75f7fe640 1 -- 172.21.15.119:0/3254806478 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600a5c90 con 0x7fc7680ce8d0 2023-12-19T16:16:45.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76eb25640 1 -- 172.21.15.119:0/3254806478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7680ce8d0 msgr2=0x7fc768070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:45.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76eb25640 1 --2- 172.21.15.119:0/3254806478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7680ce8d0 0x7fc768070590 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc760009e50 tx=0x7fc76001c8c0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76eb25640 1 -- 172.21.15.119:0/3254806478 shutdown_connections 2023-12-19T16:16:45.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76eb25640 1 --2- 172.21.15.119:0/3254806478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7680ce8d0 0x7fc768070590 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76eb25640 1 --2- 172.21.15.119:0/3254806478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7681598d0 0x7fc7680ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.897+0000 7fc76eb25640 1 -- 172.21.15.119:0/3254806478 >> 172.21.15.119:0/3254806478 conn(0x7fc76806a2a0 msgr2=0x7fc7680aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:45.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 -- 172.21.15.119:0/3254806478 shutdown_connections 2023-12-19T16:16:45.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 -- 172.21.15.119:0/3254806478 wait complete. 2023-12-19T16:16:45.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 Processor -- start 2023-12-19T16:16:45.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 -- start start 2023-12-19T16:16:45.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7680ce8d0 0x7fc7680c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:45.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc768153020 0x7fc7680c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:45.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 0x7fc768151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680c4b60 con 0x7fc7681598d0 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768152020 con 0x7fc768153020 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76eb25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680c6c10 con 0x7fc7680ce8d0 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 0x7fc768151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 0x7fc768151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45348/0 (socket says 172.21.15.119:45348) 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 -- 172.21.15.119:0/482873224 learned_addr learned my addr 172.21.15.119:0/482873224 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc75ffff640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc768153020 0x7fc7680c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76c8c1640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7680ce8d0 0x7fc7680c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 -- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7680ce8d0 msgr2=0x7fc7680c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7680ce8d0 0x7fc7680c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 -- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc768153020 msgr2=0x7fc7680c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc768153020 0x7fc7680c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:45.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 -- 172.21.15.119:0/482873224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760009b30 con 0x7fc7681598d0 2023-12-19T16:16:45.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.901+0000 7fc76d0c2640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 0x7fc768151ae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc7600af040 tx=0x7fc760019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:45.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600b8670 con 0x7fc7681598d0 2023-12-19T16:16:45.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600b87d0 con 0x7fc7681598d0 2023-12-19T16:16:45.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600b8b80 con 0x7fc7681598d0 2023-12-19T16:16:45.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7680c6ef0 con 0x7fc7681598d0 2023-12-19T16:16:45.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7680c74b0 con 0x7fc7681598d0 2023-12-19T16:16:45.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76804e000 con 0x7fc7681598d0 2023-12-19T16:16:45.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc7600b8ce0 con 0x7fc7681598d0 2023-12-19T16:16:45.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc75d7fa640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc754065a90 0x7fc754067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:45.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc76011e7e0 con 0x7fc7681598d0 2023-12-19T16:16:45.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc76c8c1640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc754065a90 0x7fc754067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:45.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.905+0000 7fc76c8c1640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc754065a90 0x7fc754067f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc764007fd0 tx=0x7fc764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:45.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:45.909+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc7600ec230 con 0x7fc7681598d0 2023-12-19T16:16:46.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.097+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7680cc600 con 0x7fc7681598d0 2023-12-19T16:16:46.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc75d7fa640 1 -- 172.21.15.119:0/482873224 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7600ef850 con 0x7fc7681598d0 2023-12-19T16:16:46.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc754065a90 msgr2=0x7fc754067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc754065a90 0x7fc754067f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc764007fd0 tx=0x7fc764009040 comp rx=0 tx=0).stop 2023-12-19T16:16:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 msgr2=0x7fc768151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 0x7fc768151ae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc7600af040 tx=0x7fc760019660 comp rx=0 tx=0).stop 2023-12-19T16:16:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 shutdown_connections 2023-12-19T16:16:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc754065a90 0x7fc754067f50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc768153020 0x7fc7680c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.725+0000 7fc76eb25640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7681598d0 0x7fc768151ae0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.729+0000 7fc76eb25640 1 --2- 172.21.15.119:0/482873224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7680ce8d0 0x7fc7680c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.729+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 >> 172.21.15.119:0/482873224 conn(0x7fc76806a2a0 msgr2=0x7fc7680aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.729+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 shutdown_connections 2023-12-19T16:16:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.729+0000 7fc76eb25640 1 -- 172.21.15.119:0/482873224 wait complete. 2023-12-19T16:16:46.752 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:16:46.753 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:46.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 Processor -- start 2023-12-19T16:16:46.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 -- start start 2023-12-19T16:16:46.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf5006bdd0 0x7fdf500c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:46.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf500ccf90 con 0x7fdf5006c1b0 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf500caa70 con 0x7fdf5006bdd0 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56c83640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500cd550 con 0x7fdf500cc970 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf5006bdd0 0x7fdf500c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf5006bdd0 0x7fdf500c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45352/0 (socket says 172.21.15.119:45352) 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 -- 172.21.15.119:0/612668971 learned_addr learned my addr 172.21.15.119:0/612668971 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf56482640 1 --2- 172.21.15.119:0/612668971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 -- 172.21.15.119:0/612668971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 msgr2=0x7fdf500c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 --2- 172.21.15.119:0/612668971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 -- 172.21.15.119:0/612668971 >> v1:172.21.15.143:6789/0 conn(0x7fdf5006c1b0 legacy=0x7fdf500cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:46.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.885+0000 7fdf55c81640 1 -- 172.21.15.119:0/612668971 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500cd270 con 0x7fdf5006bdd0 2023-12-19T16:16:46.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf55c81640 1 --2- 172.21.15.119:0/612668971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf500c45d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009870 tx=0x7fdf4c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188e513becb58a2f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:46.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf54c7f640 1 -- 172.21.15.119:0/612668971 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0ac410 con 0x7fdf5006bdd0 2023-12-19T16:16:46.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf54c7f640 1 -- 172.21.15.119:0/612668971 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0ac570 con 0x7fdf5006bdd0 2023-12-19T16:16:46.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf54c7f640 1 -- 172.21.15.119:0/612668971 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0ac900 con 0x7fdf5006bdd0 2023-12-19T16:16:46.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 -- 172.21.15.119:0/612668971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 msgr2=0x7fdf500c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 --2- 172.21.15.119:0/612668971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf500c45d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009870 tx=0x7fdf4c01c540 comp rx=0 tx=0).stop 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 -- 172.21.15.119:0/612668971 shutdown_connections 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 --2- 172.21.15.119:0/612668971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 --2- 172.21.15.119:0/612668971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf500c45d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 -- 172.21.15.119:0/612668971 >> 172.21.15.119:0/612668971 conn(0x7fdf500ce130 msgr2=0x7fdf500ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 -- 172.21.15.119:0/612668971 shutdown_connections 2023-12-19T16:16:46.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.889+0000 7fdf56c83640 1 -- 172.21.15.119:0/612668971 wait complete. 2023-12-19T16:16:46.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 Processor -- start 2023-12-19T16:16:46.897 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- start start 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf50135680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf5006c1b0 0x7fdf500cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5014fa50 con 0x7fdf5006bdd0 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5015cba0 con 0x7fdf5006c1b0 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5014f0b0 con 0x7fdf500cc970 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf50135680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf50135680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45354/0 (socket says 172.21.15.119:45354) 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 -- 172.21.15.119:0/973514163 learned_addr learned my addr 172.21.15.119:0/973514163 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55480640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf5006c1b0 0x7fdf500cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56482640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 -- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 msgr2=0x7fdf500cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:46.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 -- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf5006c1b0 msgr2=0x7fdf500cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf5006c1b0 0x7fdf500cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 -- 172.21.15.119:0/973514163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0094d0 con 0x7fdf5006bdd0 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf55c81640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf50135680 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0af040 tx=0x7fdf4c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0ac410 con 0x7fdf5006bdd0 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0b65f0 con 0x7fdf5006bdd0 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0b69a0 con 0x7fdf5006bdd0 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5014f390 con 0x7fdf5006bdd0 2023-12-19T16:16:46.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf50135bc0 con 0x7fdf5006bdd0 2023-12-19T16:16:46.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.893+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5004e850 con 0x7fdf5006bdd0 2023-12-19T16:16:46.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.897+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf4c0b6b00 con 0x7fdf5006bdd0 2023-12-19T16:16:46.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.897+0000 7fdf467fc640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdf34065a60 0x7fdf34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:46.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.897+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdf4c11dc50 con 0x7fdf5006bdd0 2023-12-19T16:16:46.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.897+0000 7fdf55480640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdf34065a60 0x7fdf34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:46.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.897+0000 7fdf55480640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdf34065a60 0x7fdf34067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf501f9930 tx=0x7fdf40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:46.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:46.901+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdf4c0eb690 con 0x7fdf5006bdd0 2023-12-19T16:16:47.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.081+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf5015d030 con 0x7fdf5006bdd0 2023-12-19T16:16:47.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.081+0000 7fdf467fc640 1 -- 172.21.15.119:0/973514163 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4706 (secure 0 0 0) 0x7fdf4c0b1090 con 0x7fdf5006bdd0 2023-12-19T16:16:47.089 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:47.089 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:46.726263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:47.090 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdf34065a60 msgr2=0x7fdf34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdf34065a60 0x7fdf34067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf501f9930 tx=0x7fdf40009040 comp rx=0 tx=0).stop 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 msgr2=0x7fdf50135680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf50135680 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0af040 tx=0x7fdf4c0192e0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 shutdown_connections 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdf34065a60 0x7fdf34067f20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf5006c1b0 0x7fdf500cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf500cc970 0x7fdf500cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 --2- 172.21.15.119:0/973514163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf5006bdd0 0x7fdf50135680 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 >> 172.21.15.119:0/973514163 conn(0x7fdf500ce130 msgr2=0x7fdf500c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:47.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 shutdown_connections 2023-12-19T16:16:47.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.085+0000 7fdf56c83640 1 -- 172.21.15.119:0/973514163 wait complete. 2023-12-19T16:16:47.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:47.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 Processor -- start 2023-12-19T16:16:47.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 -- start start 2023-12-19T16:16:47.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 0x7f9bac0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9bac0cb340 0x7f9bac0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac06fdb0 con 0x7f9bac160cc0 2023-12-19T16:16:47.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac1654a0 con 0x7f9bac0cb340 2023-12-19T16:16:47.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb3dce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1610a0 con 0x7f9bac0c1280 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 0x7f9bac0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb236b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9bac0cb340 0x7f9bac0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 0x7f9bac0cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:43476/0 (socket says 172.21.15.119:43476) 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1b6a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9bac160cc0 0x7f9bac0cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:53816/0 (socket says 172.21.15.119:53816) 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 -- 172.21.15.119:0/1008400745 learned_addr learned my addr 172.21.15.119:0/1008400745 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 -- 172.21.15.119:0/1008400745 >> v2:172.21.15.143:3300/0 conn(0x7f9bac0cb340 msgr2=0x7f9bac0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 --2- 172.21.15.119:0/1008400745 >> v2:172.21.15.143:3300/0 conn(0x7f9bac0cb340 0x7f9bac0cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 -- 172.21.15.119:0/1008400745 >> v1:172.21.15.143:6789/0 conn(0x7f9bac160cc0 legacy=0x7f9bac0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb1369640 1 -- 172.21.15.119:0/1008400745 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac164820 con 0x7f9bac0c1280 2023-12-19T16:16:47.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.241+0000 7f9bb0b68640 1 -- 172.21.15.119:0/1008400745 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116767898 0 0) 0x7f9bac06fdb0 con 0x7f9bac160cc0 2023-12-19T16:16:47.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb1369640 1 --2- 172.21.15.119:0/1008400745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 0x7f9bac0cc400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c3182945c23112e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb0b68640 1 -- 172.21.15.119:0/1008400745 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0ab600 con 0x7f9bac0c1280 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb0b68640 1 -- 172.21.15.119:0/1008400745 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0a7050 con 0x7f9bac0c1280 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb0b68640 1 -- 172.21.15.119:0/1008400745 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0ab980 con 0x7f9bac0c1280 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 -- 172.21.15.119:0/1008400745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 msgr2=0x7f9bac0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/1008400745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 0x7f9bac0cc400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c01c3d0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 -- 172.21.15.119:0/1008400745 shutdown_connections 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/1008400745 >> v2:172.21.15.143:3300/0 conn(0x7f9bac0cb340 0x7f9bac0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/1008400745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0c1280 0x7f9bac0cc400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 -- 172.21.15.119:0/1008400745 >> 172.21.15.119:0/1008400745 conn(0x7f9bac06a3e0 msgr2=0x7f9bac0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:47.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.245+0000 7f9bb3dce640 1 -- 172.21.15.119:0/1008400745 shutdown_connections 2023-12-19T16:16:47.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 -- 172.21.15.119:0/1008400745 wait complete. 2023-12-19T16:16:47.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 Processor -- start 2023-12-19T16:16:47.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 -- start start 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bac0c1280 0x7f9bac0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0cb340 0x7f9bac0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 0x7f9bac0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c8280 con 0x7f9bac160cc0 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c56d0 con 0x7f9bac0c1280 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c3550 con 0x7f9bac0cb340 2023-12-19T16:16:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 0x7f9bac0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 0x7f9bac0c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45358/0 (socket says 172.21.15.119:45358) 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 -- 172.21.15.119:0/3206959127 learned_addr learned my addr 172.21.15.119:0/3206959127 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb1369640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0cb340 0x7f9bac0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb1b6a640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bac0c1280 0x7f9bac0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 -- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0cb340 msgr2=0x7f9bac0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0cb340 0x7f9bac0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 -- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bac0c1280 msgr2=0x7f9bac0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bac0c1280 0x7f9bac0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 -- 172.21.15.119:0/3206959127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c0094d0 con 0x7f9bac160cc0 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb236b640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 0x7f9bac0c4ac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009dd0 tx=0x7f9ba400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4014480 con 0x7f9bac160cc0 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400f040 con 0x7f9bac160cc0 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.249+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac0c37c0 con 0x7f9bac160cc0 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4014840 con 0x7f9bac160cc0 2023-12-19T16:16:47.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac0c3d80 con 0x7f9bac160cc0 2023-12-19T16:16:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac0735b0 con 0x7f9bac160cc0 2023-12-19T16:16:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ba40149a0 con 0x7f9bac160cc0 2023-12-19T16:16:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9ba27fc640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9b90065a60 0x7f9b90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9ba4083d00 con 0x7f9bac160cc0 2023-12-19T16:16:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9bb1b6a640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9b90065a60 0x7f9b90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.253+0000 7f9bb1b6a640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9b90065a60 0x7f9b90067f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000f70 tx=0x7f9ba8007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.257+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9ba40516c0 con 0x7f9bac160cc0 2023-12-19T16:16:47.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.409+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bac04e000 con 0x7f9bac160cc0 2023-12-19T16:16:47.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9ba27fc640 1 -- 172.21.15.119:0/3206959127 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f9ba4054ce0 con 0x7f9bac160cc0 2023-12-19T16:16:47.418 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:47.418 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":39,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:44.717460+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9b90065a60 msgr2=0x7f9b90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9b90065a60 0x7f9b90067f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000f70 tx=0x7f9ba8007df0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 msgr2=0x7f9bac0c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 0x7f9bac0c4ac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009dd0 tx=0x7f9ba400c490 comp rx=0 tx=0).stop 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 shutdown_connections 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9b90065a60 0x7f9b90067f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bac160cc0 0x7f9bac0c4ac0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bac0cb340 0x7f9bac0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 --2- 172.21.15.119:0/3206959127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bac0c1280 0x7f9bac0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 >> 172.21.15.119:0/3206959127 conn(0x7f9bac06a3e0 msgr2=0x7f9bac0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 shutdown_connections 2023-12-19T16:16:47.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.413+0000 7f9bb3dce640 1 -- 172.21.15.119:0/3206959127 wait complete. 2023-12-19T16:16:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:16:47.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:47.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.569+0000 7f8ae9b96640 1 Processor -- start 2023-12-19T16:16:47.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.569+0000 7f8ae9b96640 1 -- start start 2023-12-19T16:16:47.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae9b96640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ae40cac10 0x7f8ae415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae9b96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae9b96640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae415f100 con 0x7f8ae415a680 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae9b96640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae4070780 con 0x7f8ae40cac10 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae9b96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40ca7d0 con 0x7f8ae406fdb0 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8ae415a680 0x7f8ae415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46736/0 (socket says 172.21.15.119:46736) 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae37fe640 1 -- 172.21.15.119:0/628988988 learned_addr learned my addr 172.21.15.119:0/628988988 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8adbfff640 1 --2- 172.21.15.119:0/628988988 >> v2:172.21.15.143:3300/0 conn(0x7f8ae40cac10 0x7f8ae415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae3fff640 1 --2- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae2ffd640 1 -- 172.21.15.119:0/628988988 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554411851 0 0) 0x7f8ae415f100 con 0x7f8ae415a680 2023-12-19T16:16:47.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae2ffd640 1 -- 172.21.15.119:0/628988988 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad0003530 con 0x7f8ae415a680 2023-12-19T16:16:47.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8adbfff640 1 -- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 msgr2=0x7f8ae4070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:47.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8adbfff640 1 --2- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae4070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8ae2ffd640 1 -- 172.21.15.119:0/628988988 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201012302 0 0) 0x7f8ad0003530 con 0x7f8ae415a680 2023-12-19T16:16:47.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8adbfff640 1 -- 172.21.15.119:0/628988988 >> v1:172.21.15.119:6789/0 conn(0x7f8ae415a680 legacy=0x7f8ae415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.573+0000 7f8adbfff640 1 -- 172.21.15.119:0/628988988 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae415e860 con 0x7f8ae40cac10 2023-12-19T16:16:47.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8adbfff640 1 --2- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae40cac10 0x7f8ae415e160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0097c0 tx=0x7f8acc01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acff7e303f6fc884 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae2ffd640 1 -- 172.21.15.119:0/628988988 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4001680 con 0x7f8ae40cac10 2023-12-19T16:16:47.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae2ffd640 1 -- 172.21.15.119:0/628988988 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0a7050 con 0x7f8ae40cac10 2023-12-19T16:16:47.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae2ffd640 1 -- 172.21.15.119:0/628988988 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0ab620 con 0x7f8ae40cac10 2023-12-19T16:16:47.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 -- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae40cac10 msgr2=0x7f8ae415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae40cac10 0x7f8ae415e160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0097c0 tx=0x7f8acc01c310 comp rx=0 tx=0).stop 2023-12-19T16:16:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 -- 172.21.15.119:0/628988988 shutdown_connections 2023-12-19T16:16:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/628988988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae40cac10 0x7f8ae415e160 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 -- 172.21.15.119:0/628988988 >> 172.21.15.119:0/628988988 conn(0x7f8ae406a3e0 msgr2=0x7f8ae40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 -- 172.21.15.119:0/628988988 shutdown_connections 2023-12-19T16:16:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 -- 172.21.15.119:0/628988988 wait complete. 2023-12-19T16:16:47.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 Processor -- start 2023-12-19T16:16:47.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.577+0000 7f8ae9b96640 1 -- start start 2023-12-19T16:16:47.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae40c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 0x7f8ae4163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae415a680 0x7f8ae40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4164110 con 0x7f8ae40cac10 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4070ba0 con 0x7f8ae415a680 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40c4a30 con 0x7f8ae406fdb0 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 0x7f8ae4163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 0x7f8ae4163bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45364/0 (socket says 172.21.15.119:45364) 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 -- 172.21.15.119:0/3057280662 learned_addr learned my addr 172.21.15.119:0/3057280662 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae3fff640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae415a680 0x7f8ae40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae37fe640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae40c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 -- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 msgr2=0x7f8ae40c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae40c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 -- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae415a680 msgr2=0x7f8ae40b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae415a680 0x7f8ae40b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 -- 172.21.15.119:0/3057280662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc009420 con 0x7f8ae40cac10 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae37fe640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae40c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8adbfff640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 0x7f8ae4163bd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0ae040 tx=0x7f8acc01ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b7450 con 0x7f8ae40cac10 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0b75d0 con 0x7f8ae40cac10 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae40c4d10 con 0x7f8ae40cac10 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b7980 con 0x7f8ae40cac10 2023-12-19T16:16:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae40c7870 con 0x7f8ae40cac10 2023-12-19T16:16:47.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.581+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae40735b0 con 0x7f8ae40cac10 2023-12-19T16:16:47.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.585+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8acc0b7ae0 con 0x7f8ae40cac10 2023-12-19T16:16:47.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.585+0000 7f8ae0ff9640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ac4065a60 0x7f8ac4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.585+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8acc11d840 con 0x7f8ae40cac10 2023-12-19T16:16:47.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.585+0000 7f8ae37fe640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ac4065a60 0x7f8ac4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.585+0000 7f8ae37fe640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ac4065a60 0x7f8ac4067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4001ec0 tx=0x7f8ad4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.589+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8acc0eb140 con 0x7f8ae40cac10 2023-12-19T16:16:47.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.737+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ae40c8e10 con 0x7f8ac4065a60 2023-12-19T16:16:47.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.745+0000 7f8ae0ff9640 1 -- 172.21.15.119:0/3057280662 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286117 (secure 0 0 0) 0x7f8ad40058e0 con 0x7f8ac4065a60 2023-12-19T16:16:47.754 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:47.756 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ac4065a60 msgr2=0x7f8ac4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ac4065a60 0x7f8ac4067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4001ec0 tx=0x7f8ad4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 msgr2=0x7f8ae4163bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 0x7f8ae4163bd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0ae040 tx=0x7f8acc01ab50 comp rx=0 tx=0).stop 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 shutdown_connections 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8ac4065a60 0x7f8ac4067f20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae415a680 0x7f8ae40b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40cac10 0x7f8ae4163bd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 --2- 172.21.15.119:0/3057280662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae406fdb0 0x7f8ae40c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 >> 172.21.15.119:0/3057280662 conn(0x7f8ae406a3e0 msgr2=0x7f8ae40aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:47.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 shutdown_connections 2023-12-19T16:16:47.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.749+0000 7f8ae9b96640 1 -- 172.21.15.119:0/3057280662 wait complete. 2023-12-19T16:16:47.774 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-19T16:16:46.466310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220032,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754688,"statfs":{"total":773094113280,"available":772868800512,"internally_reserved":0,"allocated":4521984,"data_stored":2588614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.145311"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338118+0000","last_change":"2023-12-19T16:16:43.338118+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338118+0000","last_undegraded":"2023-12-19T16:16:43.338118+0000","last_fullsized":"2023-12-19T16:16:43.338118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.457430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337559+0000","last_change":"2023-12-19T16:16:43.337559+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337559+0000","last_undegraded":"2023-12-19T16:16:43.337559+0000","last_fullsized":"2023-12-19T16:16:43.337559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339257+0000","last_change":"2023-12-19T16:16:43.339257+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339257+0000","last_undegraded":"2023-12-19T16:16:43.339257+0000","last_fullsized":"2023-12-19T16:16:43.339257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335769+0000","last_change":"2023-12-19T16:16:43.335769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335769+0000","last_undegraded":"2023-12-19T16:16:43.335769+0000","last_fullsized":"2023-12-19T16:16:43.335769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:47.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335614+0000","last_change":"2023-12-19T16:16:43.335614+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335614+0000","last_undegraded":"2023-12-19T16:16:43.335614+0000","last_fullsized":"2023-12-19T16:16:43.335614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:25.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338026+0000","last_change":"2023-12-19T16:16:43.338026+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338026+0000","last_undegraded":"2023-12-19T16:16:43.338026+0000","last_fullsized":"2023-12-19T16:16:43.338026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335944+0000","last_change":"2023-12-19T16:16:43.335944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335944+0000","last_undegraded":"2023-12-19T16:16:43.335944+0000","last_fullsized":"2023-12-19T16:16:43.335944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:59:06.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337835+0000","last_change":"2023-12-19T16:16:43.337835+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337835+0000","last_undegraded":"2023-12-19T16:16:43.337835+0000","last_fullsized":"2023-12-19T16:16:43.337835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:44.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341168+0000","last_change":"2023-12-19T16:16:43.341168+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341168+0000","last_undegraded":"2023-12-19T16:16:43.341168+0000","last_fullsized":"2023-12-19T16:16:43.341168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336369+0000","last_change":"2023-12-19T16:16:43.336369+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336369+0000","last_undegraded":"2023-12-19T16:16:43.336369+0000","last_fullsized":"2023-12-19T16:16:43.336369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335006+0000","last_change":"2023-12-19T16:16:43.335006+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335006+0000","last_undegraded":"2023-12-19T16:16:43.335006+0000","last_fullsized":"2023-12-19T16:16:43.335006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:28.808811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338899+0000","last_change":"2023-12-19T16:16:43.338899+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338899+0000","last_undegraded":"2023-12-19T16:16:43.338899+0000","last_fullsized":"2023-12-19T16:16:43.338899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:17:05.566170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335735+0000","last_change":"2023-12-19T16:16:43.335735+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335735+0000","last_undegraded":"2023-12-19T16:16:43.335735+0000","last_fullsized":"2023-12-19T16:16:43.335735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:15.147537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340837+0000","last_change":"2023-12-19T16:16:43.340837+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340837+0000","last_undegraded":"2023-12-19T16:16:43.340837+0000","last_fullsized":"2023-12-19T16:16:43.340837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335395+0000","last_change":"2023-12-19T16:16:43.335395+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335395+0000","last_undegraded":"2023-12-19T16:16:43.335395+0000","last_fullsized":"2023-12-19T16:16:43.335395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348688+0000","last_change":"2023-12-19T16:16:43.348688+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348688+0000","last_undegraded":"2023-12-19T16:16:43.348688+0000","last_fullsized":"2023-12-19T16:16:43.348688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:59.870736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.350099+0000","last_change":"2023-12-19T16:16:43.350099+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.350099+0000","last_undegraded":"2023-12-19T16:16:43.350099+0000","last_fullsized":"2023-12-19T16:16:43.350099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338925+0000","last_change":"2023-12-19T16:16:43.338925+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338925+0000","last_undegraded":"2023-12-19T16:16:43.338925+0000","last_fullsized":"2023-12-19T16:16:43.338925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338228+0000","last_change":"2023-12-19T16:16:43.338228+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338228+0000","last_undegraded":"2023-12-19T16:16:43.338228+0000","last_fullsized":"2023-12-19T16:16:43.338228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:30.632732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340185+0000","last_change":"2023-12-19T16:16:43.340185+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340185+0000","last_undegraded":"2023-12-19T16:16:43.340185+0000","last_fullsized":"2023-12-19T16:16:43.340185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335197+0000","last_change":"2023-12-19T16:16:43.335197+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335197+0000","last_undegraded":"2023-12-19T16:16:43.335197+0000","last_fullsized":"2023-12-19T16:16:43.335197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339777+0000","last_change":"2023-12-19T16:16:43.339777+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339777+0000","last_undegraded":"2023-12-19T16:16:43.339777+0000","last_fullsized":"2023-12-19T16:16:43.339777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347769+0000","last_change":"2023-12-19T16:16:43.347769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347769+0000","last_undegraded":"2023-12-19T16:16:43.347769+0000","last_fullsized":"2023-12-19T16:16:43.347769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336223+0000","last_change":"2023-12-19T16:16:43.336223+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336223+0000","last_undegraded":"2023-12-19T16:16:43.336223+0000","last_fullsized":"2023-12-19T16:16:43.336223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:00.102817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339775+0000","last_change":"2023-12-19T16:16:43.339775+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339775+0000","last_undegraded":"2023-12-19T16:16:43.339775+0000","last_fullsized":"2023-12-19T16:16:43.339775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338229+0000","last_change":"2023-12-19T16:16:43.338229+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338229+0000","last_undegraded":"2023-12-19T16:16:43.338229+0000","last_fullsized":"2023-12-19T16:16:43.338229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340668+0000","last_change":"2023-12-19T16:16:43.340668+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340668+0000","last_undegraded":"2023-12-19T16:16:43.340668+0000","last_fullsized":"2023-12-19T16:16:43.340668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:51.570844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334767+0000","last_change":"2023-12-19T16:16:43.334767+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334767+0000","last_undegraded":"2023-12-19T16:16:43.334767+0000","last_fullsized":"2023-12-19T16:16:43.334767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339584+0000","last_change":"2023-12-19T16:16:43.339584+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339584+0000","last_undegraded":"2023-12-19T16:16:43.339584+0000","last_fullsized":"2023-12-19T16:16:43.339584+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:53.457991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340792+0000","last_change":"2023-12-19T16:16:43.340792+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340792+0000","last_undegraded":"2023-12-19T16:16:43.340792+0000","last_fullsized":"2023-12-19T16:16:43.340792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:56.016247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347279+0000","last_change":"2023-12-19T16:16:43.347279+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347279+0000","last_undegraded":"2023-12-19T16:16:43.347279+0000","last_fullsized":"2023-12-19T16:16:43.347279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336623+0000","last_change":"2023-12-19T16:16:43.336623+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336623+0000","last_undegraded":"2023-12-19T16:16:43.336623+0000","last_fullsized":"2023-12-19T16:16:43.336623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:59:27.494042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346171+0000","last_change":"2023-12-19T16:16:43.346171+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346171+0000","last_undegraded":"2023-12-19T16:16:43.346171+0000","last_fullsized":"2023-12-19T16:16:43.346171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359067+0000","last_change":"2023-12-19T16:16:43.353262+0000","last_active":"2023-12-19T16:16:43.359067+0000","last_peered":"2023-12-19T16:16:43.359067+0000","last_clean":"2023-12-19T16:16:43.359067+0000","last_became_active":"2023-12-19T16:16:43.352978+0000","last_became_peered":"2023-12-19T16:16:43.352978+0000","last_unstale":"2023-12-19T16:16:43.359067+0000","last_undegraded":"2023-12-19T16:16:43.359067+0000","last_fullsized":"2023-12-19T16:16:43.359067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339356+0000","last_change":"2023-12-19T16:16:43.339356+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339356+0000","last_undegraded":"2023-12-19T16:16:43.339356+0000","last_fullsized":"2023-12-19T16:16:43.339356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359660+0000","last_change":"2023-12-19T16:16:43.356368+0000","last_active":"2023-12-19T16:16:43.359660+0000","last_peered":"2023-12-19T16:16:43.359660+0000","last_clean":"2023-12-19T16:16:43.359660+0000","last_became_active":"2023-12-19T16:16:43.355995+0000","last_became_peered":"2023-12-19T16:16:43.355995+0000","last_unstale":"2023-12-19T16:16:43.359660+0000","last_undegraded":"2023-12-19T16:16:43.359660+0000","last_fullsized":"2023-12-19T16:16:43.359660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341524+0000","last_change":"2023-12-19T16:16:43.341524+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341524+0000","last_undegraded":"2023-12-19T16:16:43.341524+0000","last_fullsized":"2023-12-19T16:16:43.341524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.357381+0000","last_change":"2023-12-19T16:16:43.354704+0000","last_active":"2023-12-19T16:16:43.357381+0000","last_peered":"2023-12-19T16:16:43.357381+0000","last_clean":"2023-12-19T16:16:43.357381+0000","last_became_active":"2023-12-19T16:16:43.354443+0000","last_became_peered":"2023-12-19T16:16:43.354443+0000","last_unstale":"2023-12-19T16:16:43.357381+0000","last_undegraded":"2023-12-19T16:16:43.357381+0000","last_fullsized":"2023-12-19T16:16:43.357381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338567+0000","last_change":"2023-12-19T16:16:43.338567+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338567+0000","last_undegraded":"2023-12-19T16:16:43.338567+0000","last_fullsized":"2023-12-19T16:16:43.338567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:42.986335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359349+0000","last_change":"2023-12-19T16:16:43.352896+0000","last_active":"2023-12-19T16:16:43.359349+0000","last_peered":"2023-12-19T16:16:43.359349+0000","last_clean":"2023-12-19T16:16:43.359349+0000","last_became_active":"2023-12-19T16:16:43.352492+0000","last_became_peered":"2023-12-19T16:16:43.352492+0000","last_unstale":"2023-12-19T16:16:43.359349+0000","last_undegraded":"2023-12-19T16:16:43.359349+0000","last_fullsized":"2023-12-19T16:16:43.359349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337686+0000","last_change":"2023-12-19T16:16:43.337686+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337686+0000","last_undegraded":"2023-12-19T16:16:43.337686+0000","last_fullsized":"2023-12-19T16:16:43.337686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358862+0000","last_change":"2023-12-19T16:16:43.354651+0000","last_active":"2023-12-19T16:16:43.358862+0000","last_peered":"2023-12-19T16:16:43.358862+0000","last_clean":"2023-12-19T16:16:43.358862+0000","last_became_active":"2023-12-19T16:16:43.354392+0000","last_became_peered":"2023-12-19T16:16:43.354392+0000","last_unstale":"2023-12-19T16:16:43.358862+0000","last_undegraded":"2023-12-19T16:16:43.358862+0000","last_fullsized":"2023-12-19T16:16:43.358862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.500035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333774+0000","last_change":"2023-12-19T16:16:43.333774+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333774+0000","last_undegraded":"2023-12-19T16:16:43.333774+0000","last_fullsized":"2023-12-19T16:16:43.333774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361527+0000","last_change":"2023-12-19T16:16:43.359797+0000","last_active":"2023-12-19T16:16:43.361527+0000","last_peered":"2023-12-19T16:16:43.361527+0000","last_clean":"2023-12-19T16:16:43.361527+0000","last_became_active":"2023-12-19T16:16:43.359535+0000","last_became_peered":"2023-12-19T16:16:43.359535+0000","last_unstale":"2023-12-19T16:16:43.361527+0000","last_undegraded":"2023-12-19T16:16:43.361527+0000","last_fullsized":"2023-12-19T16:16:43.361527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339230+0000","last_change":"2023-12-19T16:16:43.339230+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339230+0000","last_undegraded":"2023-12-19T16:16:43.339230+0000","last_fullsized":"2023-12-19T16:16:43.339230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355477+0000","last_change":"2023-12-19T16:16:43.350869+0000","last_active":"2023-12-19T16:16:43.355477+0000","last_peered":"2023-12-19T16:16:43.355477+0000","last_clean":"2023-12-19T16:16:43.355477+0000","last_became_active":"2023-12-19T16:16:43.350591+0000","last_became_peered":"2023-12-19T16:16:43.350591+0000","last_unstale":"2023-12-19T16:16:43.355477+0000","last_undegraded":"2023-12-19T16:16:43.355477+0000","last_fullsized":"2023-12-19T16:16:43.355477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339397+0000","last_change":"2023-12-19T16:16:43.339397+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339397+0000","last_undegraded":"2023-12-19T16:16:43.339397+0000","last_fullsized":"2023-12-19T16:16:43.339397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:04.059004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359272+0000","last_change":"2023-12-19T16:16:43.351126+0000","last_active":"2023-12-19T16:16:43.359272+0000","last_peered":"2023-12-19T16:16:43.359272+0000","last_clean":"2023-12-19T16:16:43.359272+0000","last_became_active":"2023-12-19T16:16:43.350844+0000","last_became_peered":"2023-12-19T16:16:43.350844+0000","last_unstale":"2023-12-19T16:16:43.359272+0000","last_undegraded":"2023-12-19T16:16:43.359272+0000","last_fullsized":"2023-12-19T16:16:43.359272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335055+0000","last_change":"2023-12-19T16:16:43.335055+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335055+0000","last_undegraded":"2023-12-19T16:16:43.335055+0000","last_fullsized":"2023-12-19T16:16:43.335055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:23.594948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353568+0000","last_change":"2023-12-19T16:16:43.348887+0000","last_active":"2023-12-19T16:16:43.353568+0000","last_peered":"2023-12-19T16:16:43.353568+0000","last_clean":"2023-12-19T16:16:43.353568+0000","last_became_active":"2023-12-19T16:16:43.348607+0000","last_became_peered":"2023-12-19T16:16:43.348607+0000","last_unstale":"2023-12-19T16:16:43.353568+0000","last_undegraded":"2023-12-19T16:16:43.353568+0000","last_fullsized":"2023-12-19T16:16:43.353568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:32.705972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347181+0000","last_change":"2023-12-19T16:16:43.347181+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347181+0000","last_undegraded":"2023-12-19T16:16:43.347181+0000","last_fullsized":"2023-12-19T16:16:43.347181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:41.285289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358700+0000","last_change":"2023-12-19T16:16:43.353196+0000","last_active":"2023-12-19T16:16:43.358700+0000","last_peered":"2023-12-19T16:16:43.358700+0000","last_clean":"2023-12-19T16:16:43.358700+0000","last_became_active":"2023-12-19T16:16:43.352913+0000","last_became_peered":"2023-12-19T16:16:43.352913+0000","last_unstale":"2023-12-19T16:16:43.358700+0000","last_undegraded":"2023-12-19T16:16:43.358700+0000","last_fullsized":"2023-12-19T16:16:43.358700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342135+0000","last_change":"2023-12-19T16:16:43.342135+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342135+0000","last_undegraded":"2023-12-19T16:16:43.342135+0000","last_fullsized":"2023-12-19T16:16:43.342135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:33.717463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356707+0000","last_change":"2023-12-19T16:16:43.349320+0000","last_active":"2023-12-19T16:16:43.356707+0000","last_peered":"2023-12-19T16:16:43.356707+0000","last_clean":"2023-12-19T16:16:43.356707+0000","last_became_active":"2023-12-19T16:16:43.348855+0000","last_became_peered":"2023-12-19T16:16:43.348855+0000","last_unstale":"2023-12-19T16:16:43.356707+0000","last_undegraded":"2023-12-19T16:16:43.356707+0000","last_fullsized":"2023-12-19T16:16:43.356707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.343896+0000","last_change":"2023-12-19T16:16:43.343896+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.343896+0000","last_undegraded":"2023-12-19T16:16:43.343896+0000","last_fullsized":"2023-12-19T16:16:43.343896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359701+0000","last_change":"2023-12-19T16:16:43.356135+0000","last_active":"2023-12-19T16:16:43.359701+0000","last_peered":"2023-12-19T16:16:43.359701+0000","last_clean":"2023-12-19T16:16:43.359701+0000","last_became_active":"2023-12-19T16:16:43.355836+0000","last_became_peered":"2023-12-19T16:16:43.355836+0000","last_unstale":"2023-12-19T16:16:43.359701+0000","last_undegraded":"2023-12-19T16:16:43.359701+0000","last_fullsized":"2023-12-19T16:16:43.359701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:22.459861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337262+0000","last_change":"2023-12-19T16:16:43.337262+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337262+0000","last_undegraded":"2023-12-19T16:16:43.337262+0000","last_fullsized":"2023-12-19T16:16:43.337262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.354176+0000","last_change":"2023-12-19T16:16:43.352367+0000","last_active":"2023-12-19T16:16:43.354176+0000","last_peered":"2023-12-19T16:16:43.354176+0000","last_clean":"2023-12-19T16:16:43.354176+0000","last_became_active":"2023-12-19T16:16:43.351864+0000","last_became_peered":"2023-12-19T16:16:43.351864+0000","last_unstale":"2023-12-19T16:16:43.354176+0000","last_undegraded":"2023-12-19T16:16:43.354176+0000","last_fullsized":"2023-12-19T16:16:43.354176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:08.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337025+0000","last_change":"2023-12-19T16:16:43.337025+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337025+0000","last_undegraded":"2023-12-19T16:16:43.337025+0000","last_fullsized":"2023-12-19T16:16:43.337025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:09.818826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355298+0000","last_change":"2023-12-19T16:16:43.351147+0000","last_active":"2023-12-19T16:16:43.355298+0000","last_peered":"2023-12-19T16:16:43.355298+0000","last_clean":"2023-12-19T16:16:43.355298+0000","last_became_active":"2023-12-19T16:16:43.350898+0000","last_became_peered":"2023-12-19T16:16:43.350898+0000","last_unstale":"2023-12-19T16:16:43.355298+0000","last_undegraded":"2023-12-19T16:16:43.355298+0000","last_fullsized":"2023-12-19T16:16:43.355298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.349392+0000","last_change":"2023-12-19T16:16:43.349392+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.349392+0000","last_undegraded":"2023-12-19T16:16:43.349392+0000","last_fullsized":"2023-12-19T16:16:43.349392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359130+0000","last_change":"2023-12-19T16:16:43.353579+0000","last_active":"2023-12-19T16:16:43.359130+0000","last_peered":"2023-12-19T16:16:43.359130+0000","last_clean":"2023-12-19T16:16:43.359130+0000","last_became_active":"2023-12-19T16:16:43.353312+0000","last_became_peered":"2023-12-19T16:16:43.353312+0000","last_unstale":"2023-12-19T16:16:43.359130+0000","last_undegraded":"2023-12-19T16:16:43.359130+0000","last_fullsized":"2023-12-19T16:16:43.359130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338944+0000","last_change":"2023-12-19T16:16:43.338944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338944+0000","last_undegraded":"2023-12-19T16:16:43.338944+0000","last_fullsized":"2023-12-19T16:16:43.338944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:25:50.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361587+0000","last_change":"2023-12-19T16:16:43.360259+0000","last_active":"2023-12-19T16:16:43.361587+0000","last_peered":"2023-12-19T16:16:43.361587+0000","last_clean":"2023-12-19T16:16:43.361587+0000","last_became_active":"2023-12-19T16:16:43.359966+0000","last_became_peered":"2023-12-19T16:16:43.359966+0000","last_unstale":"2023-12-19T16:16:43.361587+0000","last_undegraded":"2023-12-19T16:16:43.361587+0000","last_fullsized":"2023-12-19T16:16:43.361587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337472+0000","last_change":"2023-12-19T16:16:43.337472+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337472+0000","last_undegraded":"2023-12-19T16:16:43.337472+0000","last_fullsized":"2023-12-19T16:16:43.337472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:38.947784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358958+0000","last_change":"2023-12-19T16:16:43.355248+0000","last_active":"2023-12-19T16:16:43.358958+0000","last_peered":"2023-12-19T16:16:43.358958+0000","last_clean":"2023-12-19T16:16:43.358958+0000","last_became_active":"2023-12-19T16:16:43.353926+0000","last_became_peered":"2023-12-19T16:16:43.353926+0000","last_unstale":"2023-12-19T16:16:43.358958+0000","last_undegraded":"2023-12-19T16:16:43.358958+0000","last_fullsized":"2023-12-19T16:16:43.358958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333995+0000","last_change":"2023-12-19T16:16:43.333995+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333995+0000","last_undegraded":"2023-12-19T16:16:43.333995+0000","last_fullsized":"2023-12-19T16:16:43.333995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359426+0000","last_change":"2023-12-19T16:16:43.353818+0000","last_active":"2023-12-19T16:16:43.359426+0000","last_peered":"2023-12-19T16:16:43.359426+0000","last_clean":"2023-12-19T16:16:43.359426+0000","last_became_active":"2023-12-19T16:16:43.351904+0000","last_became_peered":"2023-12-19T16:16:43.351904+0000","last_unstale":"2023-12-19T16:16:43.359426+0000","last_undegraded":"2023-12-19T16:16:43.359426+0000","last_fullsized":"2023-12-19T16:16:43.359426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:15.707442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342077+0000","last_change":"2023-12-19T16:16:43.342077+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342077+0000","last_undegraded":"2023-12-19T16:16:43.342077+0000","last_fullsized":"2023-12-19T16:16:43.342077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359875+0000","last_change":"2023-12-19T16:16:43.357129+0000","last_active":"2023-12-19T16:16:43.359875+0000","last_peered":"2023-12-19T16:16:43.359875+0000","last_clean":"2023-12-19T16:16:43.359875+0000","last_became_active":"2023-12-19T16:16:43.356522+0000","last_became_peered":"2023-12-19T16:16:43.356522+0000","last_unstale":"2023-12-19T16:16:43.359875+0000","last_undegraded":"2023-12-19T16:16:43.359875+0000","last_fullsized":"2023-12-19T16:16:43.359875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:19.245588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334915+0000","last_change":"2023-12-19T16:16:43.334915+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334915+0000","last_undegraded":"2023-12-19T16:16:43.334915+0000","last_fullsized":"2023-12-19T16:16:43.334915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:18.596989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356906+0000","last_change":"2023-12-19T16:16:43.353520+0000","last_active":"2023-12-19T16:16:43.356906+0000","last_peered":"2023-12-19T16:16:43.356906+0000","last_clean":"2023-12-19T16:16:43.356906+0000","last_became_active":"2023-12-19T16:16:43.353269+0000","last_became_peered":"2023-12-19T16:16:43.353269+0000","last_unstale":"2023-12-19T16:16:43.356906+0000","last_undegraded":"2023-12-19T16:16:43.356906+0000","last_fullsized":"2023-12-19T16:16:43.356906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348260+0000","last_change":"2023-12-19T16:16:43.348260+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348260+0000","last_undegraded":"2023-12-19T16:16:43.348260+0000","last_fullsized":"2023-12-19T16:16:43.348260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.730523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352107+0000","last_change":"2023-12-19T16:16:43.346989+0000","last_active":"2023-12-19T16:16:43.352107+0000","last_peered":"2023-12-19T16:16:43.352107+0000","last_clean":"2023-12-19T16:16:43.352107+0000","last_became_active":"2023-12-19T16:16:43.346727+0000","last_became_peered":"2023-12-19T16:16:43.346727+0000","last_unstale":"2023-12-19T16:16:43.352107+0000","last_undegraded":"2023-12-19T16:16:43.352107+0000","last_fullsized":"2023-12-19T16:16:43.352107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:24.447700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335519+0000","last_change":"2023-12-19T16:16:43.335519+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335519+0000","last_undegraded":"2023-12-19T16:16:43.335519+0000","last_fullsized":"2023-12-19T16:16:43.335519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352805+0000","last_change":"2023-12-19T16:16:43.350085+0000","last_active":"2023-12-19T16:16:43.352805+0000","last_peered":"2023-12-19T16:16:43.352805+0000","last_clean":"2023-12-19T16:16:43.352805+0000","last_became_active":"2023-12-19T16:16:43.349811+0000","last_became_peered":"2023-12-19T16:16:43.349811+0000","last_unstale":"2023-12-19T16:16:43.352805+0000","last_undegraded":"2023-12-19T16:16:43.352805+0000","last_fullsized":"2023-12-19T16:16:43.352805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:17.741131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334176+0000","last_change":"2023-12-19T16:16:43.334176+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334176+0000","last_undegraded":"2023-12-19T16:16:43.334176+0000","last_fullsized":"2023-12-19T16:16:43.334176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:43.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361584+0000","last_change":"2023-12-19T16:16:43.360103+0000","last_active":"2023-12-19T16:16:43.361584+0000","last_peered":"2023-12-19T16:16:43.361584+0000","last_clean":"2023-12-19T16:16:43.361584+0000","last_became_active":"2023-12-19T16:16:43.359838+0000","last_became_peered":"2023-12-19T16:16:43.359838+0000","last_unstale":"2023-12-19T16:16:43.361584+0000","last_undegraded":"2023-12-19T16:16:43.361584+0000","last_fullsized":"2023-12-19T16:16:43.361584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:06.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338447+0000","last_change":"2023-12-19T16:16:43.338447+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338447+0000","last_undegraded":"2023-12-19T16:16:43.338447+0000","last_fullsized":"2023-12-19T16:16:43.338447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:04:18.438411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.350123+0000","last_change":"2023-12-19T16:16:43.345454+0000","last_active":"2023-12-19T16:16:43.350123+0000","last_peered":"2023-12-19T16:16:43.350123+0000","last_clean":"2023-12-19T16:16:43.350123+0000","last_became_active":"2023-12-19T16:16:43.344871+0000","last_became_peered":"2023-12-19T16:16:43.344871+0000","last_unstale":"2023-12-19T16:16:43.350123+0000","last_undegraded":"2023-12-19T16:16:43.350123+0000","last_fullsized":"2023-12-19T16:16:43.350123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:18:53.082616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337703+0000","last_change":"2023-12-19T16:16:43.337703+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337703+0000","last_undegraded":"2023-12-19T16:16:43.337703+0000","last_fullsized":"2023-12-19T16:16:43.337703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356645+0000","last_change":"2023-12-19T16:16:43.348383+0000","last_active":"2023-12-19T16:16:43.356645+0000","last_peered":"2023-12-19T16:16:43.356645+0000","last_clean":"2023-12-19T16:16:43.356645+0000","last_became_active":"2023-12-19T16:16:43.348021+0000","last_became_peered":"2023-12-19T16:16:43.348021+0000","last_unstale":"2023-12-19T16:16:43.356645+0000","last_undegraded":"2023-12-19T16:16:43.356645+0000","last_fullsized":"2023-12-19T16:16:43.356645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346713+0000","last_change":"2023-12-19T16:16:43.346713+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346713+0000","last_undegraded":"2023-12-19T16:16:43.346713+0000","last_fullsized":"2023-12-19T16:16:43.346713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.511527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353054+0000","last_change":"2023-12-19T16:16:43.349882+0000","last_active":"2023-12-19T16:16:43.353054+0000","last_peered":"2023-12-19T16:16:43.353054+0000","last_clean":"2023-12-19T16:16:43.353054+0000","last_became_active":"2023-12-19T16:16:43.349600+0000","last_became_peered":"2023-12-19T16:16:43.349600+0000","last_unstale":"2023-12-19T16:16:43.353054+0000","last_undegraded":"2023-12-19T16:16:43.353054+0000","last_fullsized":"2023-12-19T16:16:43.353054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:43:50.507030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337054+0000","last_change":"2023-12-19T16:16:43.337054+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337054+0000","last_undegraded":"2023-12-19T16:16:43.337054+0000","last_fullsized":"2023-12-19T16:16:43.337054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:06:54.423721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353522+0000","last_change":"2023-12-19T16:16:43.348488+0000","last_active":"2023-12-19T16:16:43.353522+0000","last_peered":"2023-12-19T16:16:43.353522+0000","last_clean":"2023-12-19T16:16:43.353522+0000","last_became_active":"2023-12-19T16:16:43.348144+0000","last_became_peered":"2023-12-19T16:16:43.348144+0000","last_unstale":"2023-12-19T16:16:43.353522+0000","last_undegraded":"2023-12-19T16:16:43.353522+0000","last_fullsized":"2023-12-19T16:16:43.353522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336758+0000","last_change":"2023-12-19T16:16:43.336758+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336758+0000","last_undegraded":"2023-12-19T16:16:43.336758+0000","last_fullsized":"2023-12-19T16:16:43.336758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353530+0000","last_change":"2023-12-19T16:16:43.346209+0000","last_active":"2023-12-19T16:16:43.353530+0000","last_peered":"2023-12-19T16:16:43.353530+0000","last_clean":"2023-12-19T16:16:43.353530+0000","last_became_active":"2023-12-19T16:16:43.345183+0000","last_became_peered":"2023-12-19T16:16:43.345183+0000","last_unstale":"2023-12-19T16:16:43.353530+0000","last_undegraded":"2023-12-19T16:16:43.353530+0000","last_fullsized":"2023-12-19T16:16:43.353530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:52.446500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336956+0000","last_change":"2023-12-19T16:16:43.336956+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336956+0000","last_undegraded":"2023-12-19T16:16:43.336956+0000","last_fullsized":"2023-12-19T16:16:43.336956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359157+0000","last_change":"2023-12-19T16:16:43.355011+0000","last_active":"2023-12-19T16:16:43.359157+0000","last_peered":"2023-12-19T16:16:43.359157+0000","last_clean":"2023-12-19T16:16:43.359157+0000","last_became_active":"2023-12-19T16:16:43.352649+0000","last_became_peered":"2023-12-19T16:16:43.352649+0000","last_unstale":"2023-12-19T16:16:43.359157+0000","last_undegraded":"2023-12-19T16:16:43.359157+0000","last_fullsized":"2023-12-19T16:16:43.359157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:17.585498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340344+0000","last_change":"2023-12-19T16:16:43.340344+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340344+0000","last_undegraded":"2023-12-19T16:16:43.340344+0000","last_fullsized":"2023-12-19T16:16:43.340344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355857+0000","last_change":"2023-12-19T16:16:43.347544+0000","last_active":"2023-12-19T16:16:43.355857+0000","last_peered":"2023-12-19T16:16:43.355857+0000","last_clean":"2023-12-19T16:16:43.355857+0000","last_became_active":"2023-12-19T16:16:43.347259+0000","last_became_peered":"2023-12-19T16:16:43.347259+0000","last_unstale":"2023-12-19T16:16:43.355857+0000","last_undegraded":"2023-12-19T16:16:43.355857+0000","last_fullsized":"2023-12-19T16:16:43.355857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:56.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.345062+0000","last_change":"2023-12-19T16:16:43.345062+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.345062+0000","last_undegraded":"2023-12-19T16:16:43.345062+0000","last_fullsized":"2023-12-19T16:16:43.345062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:44.359529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353827+0000","last_change":"2023-12-19T16:16:43.349535+0000","last_active":"2023-12-19T16:16:43.353827+0000","last_peered":"2023-12-19T16:16:43.353827+0000","last_clean":"2023-12-19T16:16:43.353827+0000","last_became_active":"2023-12-19T16:16:43.349097+0000","last_became_peered":"2023-12-19T16:16:43.349097+0000","last_unstale":"2023-12-19T16:16:43.353827+0000","last_undegraded":"2023-12-19T16:16:43.353827+0000","last_fullsized":"2023-12-19T16:16:43.353827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:35.320757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334304+0000","last_change":"2023-12-19T16:16:43.334304+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334304+0000","last_undegraded":"2023-12-19T16:16:43.334304+0000","last_fullsized":"2023-12-19T16:16:43.334304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.360874+0000","last_change":"2023-12-19T16:16:43.358272+0000","last_active":"2023-12-19T16:16:43.360874+0000","last_peered":"2023-12-19T16:16:43.360874+0000","last_clean":"2023-12-19T16:16:43.360874+0000","last_became_active":"2023-12-19T16:16:43.358010+0000","last_became_peered":"2023-12-19T16:16:43.358010+0000","last_unstale":"2023-12-19T16:16:43.360874+0000","last_undegraded":"2023-12-19T16:16:43.360874+0000","last_fullsized":"2023-12-19T16:16:43.360874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:28.970063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:42.328795+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:16:42.328795+0000","last_peered":"2023-12-19T16:16:42.328795+0000","last_clean":"2023-12-19T16:16:42.328795+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:16:42.328795+0000","last_undegraded":"2023-12-19T16:16:42.328795+0000","last_fullsized":"2023-12-19T16:16:42.328795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.499},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.499},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.1559999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.746},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.753}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.379}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.307},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.1259999999999994,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.68300000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.627}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.752},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.437}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495}]},{"osd":4,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97799999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.62},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.47199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:47.780 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:47.802 INFO:tasks.ceph.mds.b.smithi143.stderr:2023-12-19T16:16:47.797+0000 7f9d19dec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:16:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc015f6d640 1 Processor -- start 2023-12-19T16:16:47.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc015f6d640 1 -- start start 2023-12-19T16:16:47.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc015f6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0101570c0 0x7fc01006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc015f6d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0100c9460 con 0x7fc01006c320 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc015f6d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0101574a0 con 0x7fc0100ca000 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc015f6d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01006c7a0 con 0x7fc0101570c0 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc00f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0101570c0 0x7fc01006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc00f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0101570c0 0x7fc01006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45380/0 (socket says 172.21.15.119:45380) 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc00f7fe640 1 -- 172.21.15.119:0/2448951146 learned_addr learned my addr 172.21.15.119:0/2448951146 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:47.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc00f7fe640 1 -- 172.21.15.119:0/2448951146 >> v1:172.21.15.143:6789/0 conn(0x7fc0100ca000 legacy=0x7fc010070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc00f7fe640 1 -- 172.21.15.119:0/2448951146 >> v1:172.21.15.119:6789/0 conn(0x7fc01006c320 legacy=0x7fc0100c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.953+0000 7fc00f7fe640 1 -- 172.21.15.119:0/2448951146 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100c8b30 con 0x7fc0101570c0 2023-12-19T16:16:47.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc00f7fe640 1 --2- 172.21.15.119:0/2448951146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc01006bde0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc000009870 tx=0x7fc00001e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2019c8727940dfc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc00e7fc640 1 -- 172.21.15.119:0/2448951146 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000a8660 con 0x7fc0101570c0 2023-12-19T16:16:47.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc00e7fc640 1 -- 172.21.15.119:0/2448951146 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0000a87c0 con 0x7fc0101570c0 2023-12-19T16:16:47.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc00e7fc640 1 -- 172.21.15.119:0/2448951146 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000a8b50 con 0x7fc0101570c0 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 -- 172.21.15.119:0/2448951146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 msgr2=0x7fc01006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 --2- 172.21.15.119:0/2448951146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc01006bde0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc000009870 tx=0x7fc00001e690 comp rx=0 tx=0).stop 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 -- 172.21.15.119:0/2448951146 shutdown_connections 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 --2- 172.21.15.119:0/2448951146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc01006bde0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 -- 172.21.15.119:0/2448951146 >> 172.21.15.119:0/2448951146 conn(0x7fc01006a3e0 msgr2=0x7fc0100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 -- 172.21.15.119:0/2448951146 shutdown_connections 2023-12-19T16:16:47.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 -- 172.21.15.119:0/2448951146 wait complete. 2023-12-19T16:16:47.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 Processor -- start 2023-12-19T16:16:47.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.957+0000 7fc015f6d640 1 -- start start 2023-12-19T16:16:47.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc01006c320 0x7fc0100c0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0100ca000 0x7fc0100c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc0100c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0101459b0 con 0x7fc0101570c0 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100c45d0 con 0x7fc0100ca000 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100c0e80 con 0x7fc01006c320 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc0100c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0100ca000 0x7fc0100c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc0100c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45386/0 (socket says 172.21.15.119:45386) 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 -- 172.21.15.119:0/1894972277 learned_addr learned my addr 172.21.15.119:0/1894972277 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00f7fe640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc01006c320 0x7fc0100c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 -- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc01006c320 msgr2=0x7fc0100c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc01006c320 0x7fc0100c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 -- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0100ca000 msgr2=0x7fc0100c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0100ca000 0x7fc0100c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 -- 172.21.15.119:0/1894972277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000094d0 con 0x7fc0101570c0 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc00ffff640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc0100c7300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc00800c730 tx=0x7fc00800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008003b80 con 0x7fc0101570c0 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008003ce0 con 0x7fc0101570c0 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800aa30 con 0x7fc0101570c0 2023-12-19T16:16:47.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0100c39c0 con 0x7fc0101570c0 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0100c3f80 con 0x7fc0101570c0 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.961+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0100735b0 con 0x7fc0101570c0 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.965+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc00800ab90 con 0x7fc0101570c0 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.965+0000 7fbff7fff640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbffc065a90 0x7fbffc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.965+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc008082e30 con 0x7fc0101570c0 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.965+0000 7fc00f7fe640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbffc065a90 0x7fbffc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:47.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.965+0000 7fc00f7fe640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbffc065a90 0x7fbffc067f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc0000b1000 tx=0x7fc0000a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:47.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:47.969+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0080507f0 con 0x7fc0101570c0 2023-12-19T16:16:48.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.113+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0100ca8a0 con 0x7fbffc065a90 2023-12-19T16:16:48.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.121+0000 7fbff7fff640 1 -- 172.21.15.119:0/1894972277 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286117 (secure 0 0 0) 0x7fc00000e1d0 con 0x7fbffc065a90 2023-12-19T16:16:48.131 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:48.132 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:16:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbffc065a90 msgr2=0x7fbffc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbffc065a90 0x7fbffc067f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc0000b1000 tx=0x7fc0000a9000 comp rx=0 tx=0).stop 2023-12-19T16:16:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 msgr2=0x7fc0100c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc0100c7300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc00800c730 tx=0x7fc00800cbf0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 shutdown_connections 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbffc065a90 0x7fbffc067f50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0100ca000 0x7fc0100c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0101570c0 0x7fc0100c7300 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 --2- 172.21.15.119:0/1894972277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc01006c320 0x7fc0100c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 >> 172.21.15.119:0/1894972277 conn(0x7fc01006a3e0 msgr2=0x7fc0100aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 shutdown_connections 2023-12-19T16:16:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.125+0000 7fc015f6d640 1 -- 172.21.15.119:0/1894972277 wait complete. 2023-12-19T16:16:48.151 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-19T16:16:46.466310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220032,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754688,"statfs":{"total":773094113280,"available":772868800512,"internally_reserved":0,"allocated":4521984,"data_stored":2588614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.145311"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338118+0000","last_change":"2023-12-19T16:16:43.338118+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338118+0000","last_undegraded":"2023-12-19T16:16:43.338118+0000","last_fullsized":"2023-12-19T16:16:43.338118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.457430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337559+0000","last_change":"2023-12-19T16:16:43.337559+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337559+0000","last_undegraded":"2023-12-19T16:16:43.337559+0000","last_fullsized":"2023-12-19T16:16:43.337559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339257+0000","last_change":"2023-12-19T16:16:43.339257+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339257+0000","last_undegraded":"2023-12-19T16:16:43.339257+0000","last_fullsized":"2023-12-19T16:16:43.339257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335769+0000","last_change":"2023-12-19T16:16:43.335769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335769+0000","last_undegraded":"2023-12-19T16:16:43.335769+0000","last_fullsized":"2023-12-19T16:16:43.335769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:47.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335614+0000","last_change":"2023-12-19T16:16:43.335614+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335614+0000","last_undegraded":"2023-12-19T16:16:43.335614+0000","last_fullsized":"2023-12-19T16:16:43.335614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:25.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338026+0000","last_change":"2023-12-19T16:16:43.338026+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338026+0000","last_undegraded":"2023-12-19T16:16:43.338026+0000","last_fullsized":"2023-12-19T16:16:43.338026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335944+0000","last_change":"2023-12-19T16:16:43.335944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335944+0000","last_undegraded":"2023-12-19T16:16:43.335944+0000","last_fullsized":"2023-12-19T16:16:43.335944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:59:06.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337835+0000","last_change":"2023-12-19T16:16:43.337835+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337835+0000","last_undegraded":"2023-12-19T16:16:43.337835+0000","last_fullsized":"2023-12-19T16:16:43.337835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:44.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341168+0000","last_change":"2023-12-19T16:16:43.341168+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341168+0000","last_undegraded":"2023-12-19T16:16:43.341168+0000","last_fullsized":"2023-12-19T16:16:43.341168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336369+0000","last_change":"2023-12-19T16:16:43.336369+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336369+0000","last_undegraded":"2023-12-19T16:16:43.336369+0000","last_fullsized":"2023-12-19T16:16:43.336369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335006+0000","last_change":"2023-12-19T16:16:43.335006+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335006+0000","last_undegraded":"2023-12-19T16:16:43.335006+0000","last_fullsized":"2023-12-19T16:16:43.335006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:28.808811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338899+0000","last_change":"2023-12-19T16:16:43.338899+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338899+0000","last_undegraded":"2023-12-19T16:16:43.338899+0000","last_fullsized":"2023-12-19T16:16:43.338899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:17:05.566170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335735+0000","last_change":"2023-12-19T16:16:43.335735+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335735+0000","last_undegraded":"2023-12-19T16:16:43.335735+0000","last_fullsized":"2023-12-19T16:16:43.335735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:15.147537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340837+0000","last_change":"2023-12-19T16:16:43.340837+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340837+0000","last_undegraded":"2023-12-19T16:16:43.340837+0000","last_fullsized":"2023-12-19T16:16:43.340837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335395+0000","last_change":"2023-12-19T16:16:43.335395+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335395+0000","last_undegraded":"2023-12-19T16:16:43.335395+0000","last_fullsized":"2023-12-19T16:16:43.335395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348688+0000","last_change":"2023-12-19T16:16:43.348688+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348688+0000","last_undegraded":"2023-12-19T16:16:43.348688+0000","last_fullsized":"2023-12-19T16:16:43.348688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:59.870736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.350099+0000","last_change":"2023-12-19T16:16:43.350099+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.350099+0000","last_undegraded":"2023-12-19T16:16:43.350099+0000","last_fullsized":"2023-12-19T16:16:43.350099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338925+0000","last_change":"2023-12-19T16:16:43.338925+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338925+0000","last_undegraded":"2023-12-19T16:16:43.338925+0000","last_fullsized":"2023-12-19T16:16:43.338925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338228+0000","last_change":"2023-12-19T16:16:43.338228+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338228+0000","last_undegraded":"2023-12-19T16:16:43.338228+0000","last_fullsized":"2023-12-19T16:16:43.338228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:30.632732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340185+0000","last_change":"2023-12-19T16:16:43.340185+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340185+0000","last_undegraded":"2023-12-19T16:16:43.340185+0000","last_fullsized":"2023-12-19T16:16:43.340185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335197+0000","last_change":"2023-12-19T16:16:43.335197+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335197+0000","last_undegraded":"2023-12-19T16:16:43.335197+0000","last_fullsized":"2023-12-19T16:16:43.335197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339777+0000","last_change":"2023-12-19T16:16:43.339777+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339777+0000","last_undegraded":"2023-12-19T16:16:43.339777+0000","last_fullsized":"2023-12-19T16:16:43.339777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347769+0000","last_change":"2023-12-19T16:16:43.347769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347769+0000","last_undegraded":"2023-12-19T16:16:43.347769+0000","last_fullsized":"2023-12-19T16:16:43.347769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336223+0000","last_change":"2023-12-19T16:16:43.336223+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336223+0000","last_undegraded":"2023-12-19T16:16:43.336223+0000","last_fullsized":"2023-12-19T16:16:43.336223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:00.102817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339775+0000","last_change":"2023-12-19T16:16:43.339775+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339775+0000","last_undegraded":"2023-12-19T16:16:43.339775+0000","last_fullsized":"2023-12-19T16:16:43.339775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338229+0000","last_change":"2023-12-19T16:16:43.338229+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338229+0000","last_undegraded":"2023-12-19T16:16:43.338229+0000","last_fullsized":"2023-12-19T16:16:43.338229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340668+0000","last_change":"2023-12-19T16:16:43.340668+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340668+0000","last_undegraded":"2023-12-19T16:16:43.340668+0000","last_fullsized":"2023-12-19T16:16:43.340668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:51.570844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334767+0000","last_change":"2023-12-19T16:16:43.334767+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334767+0000","last_undegraded":"2023-12-19T16:16:43.334767+0000","last_fullsized":"2023-12-19T16:16:43.334767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339584+0000","last_change":"2023-12-19T16:16:43.339584+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339584+0000","last_undegraded":"2023-12-19T16:16:43.339584+0000","last_fullsized":"2023-12-19T16:16:43.339584+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:53.457991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340792+0000","last_change":"2023-12-19T16:16:43.340792+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340792+0000","last_undegraded":"2023-12-19T16:16:43.340792+0000","last_fullsized":"2023-12-19T16:16:43.340792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:56.016247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347279+0000","last_change":"2023-12-19T16:16:43.347279+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347279+0000","last_undegraded":"2023-12-19T16:16:43.347279+0000","last_fullsized":"2023-12-19T16:16:43.347279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336623+0000","last_change":"2023-12-19T16:16:43.336623+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336623+0000","last_undegraded":"2023-12-19T16:16:43.336623+0000","last_fullsized":"2023-12-19T16:16:43.336623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:59:27.494042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346171+0000","last_change":"2023-12-19T16:16:43.346171+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346171+0000","last_undegraded":"2023-12-19T16:16:43.346171+0000","last_fullsized":"2023-12-19T16:16:43.346171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359067+0000","last_change":"2023-12-19T16:16:43.353262+0000","last_active":"2023-12-19T16:16:43.359067+0000","last_peered":"2023-12-19T16:16:43.359067+0000","last_clean":"2023-12-19T16:16:43.359067+0000","last_became_active":"2023-12-19T16:16:43.352978+0000","last_became_peered":"2023-12-19T16:16:43.352978+0000","last_unstale":"2023-12-19T16:16:43.359067+0000","last_undegraded":"2023-12-19T16:16:43.359067+0000","last_fullsized":"2023-12-19T16:16:43.359067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339356+0000","last_change":"2023-12-19T16:16:43.339356+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339356+0000","last_undegraded":"2023-12-19T16:16:43.339356+0000","last_fullsized":"2023-12-19T16:16:43.339356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359660+0000","last_change":"2023-12-19T16:16:43.356368+0000","last_active":"2023-12-19T16:16:43.359660+0000","last_peered":"2023-12-19T16:16:43.359660+0000","last_clean":"2023-12-19T16:16:43.359660+0000","last_became_active":"2023-12-19T16:16:43.355995+0000","last_became_peered":"2023-12-19T16:16:43.355995+0000","last_unstale":"2023-12-19T16:16:43.359660+0000","last_undegraded":"2023-12-19T16:16:43.359660+0000","last_fullsized":"2023-12-19T16:16:43.359660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341524+0000","last_change":"2023-12-19T16:16:43.341524+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341524+0000","last_undegraded":"2023-12-19T16:16:43.341524+0000","last_fullsized":"2023-12-19T16:16:43.341524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.357381+0000","last_change":"2023-12-19T16:16:43.354704+0000","last_active":"2023-12-19T16:16:43.357381+0000","last_peered":"2023-12-19T16:16:43.357381+0000","last_clean":"2023-12-19T16:16:43.357381+0000","last_became_active":"2023-12-19T16:16:43.354443+0000","last_became_peered":"2023-12-19T16:16:43.354443+0000","last_unstale":"2023-12-19T16:16:43.357381+0000","last_undegraded":"2023-12-19T16:16:43.357381+0000","last_fullsized":"2023-12-19T16:16:43.357381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338567+0000","last_change":"2023-12-19T16:16:43.338567+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338567+0000","last_undegraded":"2023-12-19T16:16:43.338567+0000","last_fullsized":"2023-12-19T16:16:43.338567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:42.986335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359349+0000","last_change":"2023-12-19T16:16:43.352896+0000","last_active":"2023-12-19T16:16:43.359349+0000","last_peered":"2023-12-19T16:16:43.359349+0000","last_clean":"2023-12-19T16:16:43.359349+0000","last_became_active":"2023-12-19T16:16:43.352492+0000","last_became_peered":"2023-12-19T16:16:43.352492+0000","last_unstale":"2023-12-19T16:16:43.359349+0000","last_undegraded":"2023-12-19T16:16:43.359349+0000","last_fullsized":"2023-12-19T16:16:43.359349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337686+0000","last_change":"2023-12-19T16:16:43.337686+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337686+0000","last_undegraded":"2023-12-19T16:16:43.337686+0000","last_fullsized":"2023-12-19T16:16:43.337686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358862+0000","last_change":"2023-12-19T16:16:43.354651+0000","last_active":"2023-12-19T16:16:43.358862+0000","last_peered":"2023-12-19T16:16:43.358862+0000","last_clean":"2023-12-19T16:16:43.358862+0000","last_became_active":"2023-12-19T16:16:43.354392+0000","last_became_peered":"2023-12-19T16:16:43.354392+0000","last_unstale":"2023-12-19T16:16:43.358862+0000","last_undegraded":"2023-12-19T16:16:43.358862+0000","last_fullsized":"2023-12-19T16:16:43.358862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.500035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333774+0000","last_change":"2023-12-19T16:16:43.333774+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333774+0000","last_undegraded":"2023-12-19T16:16:43.333774+0000","last_fullsized":"2023-12-19T16:16:43.333774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361527+0000","last_change":"2023-12-19T16:16:43.359797+0000","last_active":"2023-12-19T16:16:43.361527+0000","last_peered":"2023-12-19T16:16:43.361527+0000","last_clean":"2023-12-19T16:16:43.361527+0000","last_became_active":"2023-12-19T16:16:43.359535+0000","last_became_peered":"2023-12-19T16:16:43.359535+0000","last_unstale":"2023-12-19T16:16:43.361527+0000","last_undegraded":"2023-12-19T16:16:43.361527+0000","last_fullsized":"2023-12-19T16:16:43.361527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339230+0000","last_change":"2023-12-19T16:16:43.339230+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339230+0000","last_undegraded":"2023-12-19T16:16:43.339230+0000","last_fullsized":"2023-12-19T16:16:43.339230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355477+0000","last_change":"2023-12-19T16:16:43.350869+0000","last_active":"2023-12-19T16:16:43.355477+0000","last_peered":"2023-12-19T16:16:43.355477+0000","last_clean":"2023-12-19T16:16:43.355477+0000","last_became_active":"2023-12-19T16:16:43.350591+0000","last_became_peered":"2023-12-19T16:16:43.350591+0000","last_unstale":"2023-12-19T16:16:43.355477+0000","last_undegraded":"2023-12-19T16:16:43.355477+0000","last_fullsized":"2023-12-19T16:16:43.355477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339397+0000","last_change":"2023-12-19T16:16:43.339397+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339397+0000","last_undegraded":"2023-12-19T16:16:43.339397+0000","last_fullsized":"2023-12-19T16:16:43.339397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:04.059004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359272+0000","last_change":"2023-12-19T16:16:43.351126+0000","last_active":"2023-12-19T16:16:43.359272+0000","last_peered":"2023-12-19T16:16:43.359272+0000","last_clean":"2023-12-19T16:16:43.359272+0000","last_became_active":"2023-12-19T16:16:43.350844+0000","last_became_peered":"2023-12-19T16:16:43.350844+0000","last_unstale":"2023-12-19T16:16:43.359272+0000","last_undegraded":"2023-12-19T16:16:43.359272+0000","last_fullsized":"2023-12-19T16:16:43.359272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335055+0000","last_change":"2023-12-19T16:16:43.335055+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335055+0000","last_undegraded":"2023-12-19T16:16:43.335055+0000","last_fullsized":"2023-12-19T16:16:43.335055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:23.594948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353568+0000","last_change":"2023-12-19T16:16:43.348887+0000","last_active":"2023-12-19T16:16:43.353568+0000","last_peered":"2023-12-19T16:16:43.353568+0000","last_clean":"2023-12-19T16:16:43.353568+0000","last_became_active":"2023-12-19T16:16:43.348607+0000","last_became_peered":"2023-12-19T16:16:43.348607+0000","last_unstale":"2023-12-19T16:16:43.353568+0000","last_undegraded":"2023-12-19T16:16:43.353568+0000","last_fullsized":"2023-12-19T16:16:43.353568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:32.705972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347181+0000","last_change":"2023-12-19T16:16:43.347181+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347181+0000","last_undegraded":"2023-12-19T16:16:43.347181+0000","last_fullsized":"2023-12-19T16:16:43.347181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:41.285289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358700+0000","last_change":"2023-12-19T16:16:43.353196+0000","last_active":"2023-12-19T16:16:43.358700+0000","last_peered":"2023-12-19T16:16:43.358700+0000","last_clean":"2023-12-19T16:16:43.358700+0000","last_became_active":"2023-12-19T16:16:43.352913+0000","last_became_peered":"2023-12-19T16:16:43.352913+0000","last_unstale":"2023-12-19T16:16:43.358700+0000","last_undegraded":"2023-12-19T16:16:43.358700+0000","last_fullsized":"2023-12-19T16:16:43.358700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342135+0000","last_change":"2023-12-19T16:16:43.342135+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342135+0000","last_undegraded":"2023-12-19T16:16:43.342135+0000","last_fullsized":"2023-12-19T16:16:43.342135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:33.717463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356707+0000","last_change":"2023-12-19T16:16:43.349320+0000","last_active":"2023-12-19T16:16:43.356707+0000","last_peered":"2023-12-19T16:16:43.356707+0000","last_clean":"2023-12-19T16:16:43.356707+0000","last_became_active":"2023-12-19T16:16:43.348855+0000","last_became_peered":"2023-12-19T16:16:43.348855+0000","last_unstale":"2023-12-19T16:16:43.356707+0000","last_undegraded":"2023-12-19T16:16:43.356707+0000","last_fullsized":"2023-12-19T16:16:43.356707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.343896+0000","last_change":"2023-12-19T16:16:43.343896+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.343896+0000","last_undegraded":"2023-12-19T16:16:43.343896+0000","last_fullsized":"2023-12-19T16:16:43.343896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359701+0000","last_change":"2023-12-19T16:16:43.356135+0000","last_active":"2023-12-19T16:16:43.359701+0000","last_peered":"2023-12-19T16:16:43.359701+0000","last_clean":"2023-12-19T16:16:43.359701+0000","last_became_active":"2023-12-19T16:16:43.355836+0000","last_became_peered":"2023-12-19T16:16:43.355836+0000","last_unstale":"2023-12-19T16:16:43.359701+0000","last_undegraded":"2023-12-19T16:16:43.359701+0000","last_fullsized":"2023-12-19T16:16:43.359701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:22.459861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337262+0000","last_change":"2023-12-19T16:16:43.337262+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337262+0000","last_undegraded":"2023-12-19T16:16:43.337262+0000","last_fullsized":"2023-12-19T16:16:43.337262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.354176+0000","last_change":"2023-12-19T16:16:43.352367+0000","last_active":"2023-12-19T16:16:43.354176+0000","last_peered":"2023-12-19T16:16:43.354176+0000","last_clean":"2023-12-19T16:16:43.354176+0000","last_became_active":"2023-12-19T16:16:43.351864+0000","last_became_peered":"2023-12-19T16:16:43.351864+0000","last_unstale":"2023-12-19T16:16:43.354176+0000","last_undegraded":"2023-12-19T16:16:43.354176+0000","last_fullsized":"2023-12-19T16:16:43.354176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:08.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337025+0000","last_change":"2023-12-19T16:16:43.337025+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337025+0000","last_undegraded":"2023-12-19T16:16:43.337025+0000","last_fullsized":"2023-12-19T16:16:43.337025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:09.818826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355298+0000","last_change":"2023-12-19T16:16:43.351147+0000","last_active":"2023-12-19T16:16:43.355298+0000","last_peered":"2023-12-19T16:16:43.355298+0000","last_clean":"2023-12-19T16:16:43.355298+0000","last_became_active":"2023-12-19T16:16:43.350898+0000","last_became_peered":"2023-12-19T16:16:43.350898+0000","last_unstale":"2023-12-19T16:16:43.355298+0000","last_undegraded":"2023-12-19T16:16:43.355298+0000","last_fullsized":"2023-12-19T16:16:43.355298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.349392+0000","last_change":"2023-12-19T16:16:43.349392+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.349392+0000","last_undegraded":"2023-12-19T16:16:43.349392+0000","last_fullsized":"2023-12-19T16:16:43.349392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359130+0000","last_change":"2023-12-19T16:16:43.353579+0000","last_active":"2023-12-19T16:16:43.359130+0000","last_peered":"2023-12-19T16:16:43.359130+0000","last_clean":"2023-12-19T16:16:43.359130+0000","last_became_active":"2023-12-19T16:16:43.353312+0000","last_became_peered":"2023-12-19T16:16:43.353312+0000","last_unstale":"2023-12-19T16:16:43.359130+0000","last_undegraded":"2023-12-19T16:16:43.359130+0000","last_fullsized":"2023-12-19T16:16:43.359130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338944+0000","last_change":"2023-12-19T16:16:43.338944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338944+0000","last_undegraded":"2023-12-19T16:16:43.338944+0000","last_fullsized":"2023-12-19T16:16:43.338944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:25:50.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361587+0000","last_change":"2023-12-19T16:16:43.360259+0000","last_active":"2023-12-19T16:16:43.361587+0000","last_peered":"2023-12-19T16:16:43.361587+0000","last_clean":"2023-12-19T16:16:43.361587+0000","last_became_active":"2023-12-19T16:16:43.359966+0000","last_became_peered":"2023-12-19T16:16:43.359966+0000","last_unstale":"2023-12-19T16:16:43.361587+0000","last_undegraded":"2023-12-19T16:16:43.361587+0000","last_fullsized":"2023-12-19T16:16:43.361587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337472+0000","last_change":"2023-12-19T16:16:43.337472+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337472+0000","last_undegraded":"2023-12-19T16:16:43.337472+0000","last_fullsized":"2023-12-19T16:16:43.337472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:38.947784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358958+0000","last_change":"2023-12-19T16:16:43.355248+0000","last_active":"2023-12-19T16:16:43.358958+0000","last_peered":"2023-12-19T16:16:43.358958+0000","last_clean":"2023-12-19T16:16:43.358958+0000","last_became_active":"2023-12-19T16:16:43.353926+0000","last_became_peered":"2023-12-19T16:16:43.353926+0000","last_unstale":"2023-12-19T16:16:43.358958+0000","last_undegraded":"2023-12-19T16:16:43.358958+0000","last_fullsized":"2023-12-19T16:16:43.358958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333995+0000","last_change":"2023-12-19T16:16:43.333995+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333995+0000","last_undegraded":"2023-12-19T16:16:43.333995+0000","last_fullsized":"2023-12-19T16:16:43.333995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359426+0000","last_change":"2023-12-19T16:16:43.353818+0000","last_active":"2023-12-19T16:16:43.359426+0000","last_peered":"2023-12-19T16:16:43.359426+0000","last_clean":"2023-12-19T16:16:43.359426+0000","last_became_active":"2023-12-19T16:16:43.351904+0000","last_became_peered":"2023-12-19T16:16:43.351904+0000","last_unstale":"2023-12-19T16:16:43.359426+0000","last_undegraded":"2023-12-19T16:16:43.359426+0000","last_fullsized":"2023-12-19T16:16:43.359426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:15.707442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342077+0000","last_change":"2023-12-19T16:16:43.342077+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342077+0000","last_undegraded":"2023-12-19T16:16:43.342077+0000","last_fullsized":"2023-12-19T16:16:43.342077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359875+0000","last_change":"2023-12-19T16:16:43.357129+0000","last_active":"2023-12-19T16:16:43.359875+0000","last_peered":"2023-12-19T16:16:43.359875+0000","last_clean":"2023-12-19T16:16:43.359875+0000","last_became_active":"2023-12-19T16:16:43.356522+0000","last_became_peered":"2023-12-19T16:16:43.356522+0000","last_unstale":"2023-12-19T16:16:43.359875+0000","last_undegraded":"2023-12-19T16:16:43.359875+0000","last_fullsized":"2023-12-19T16:16:43.359875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:19.245588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334915+0000","last_change":"2023-12-19T16:16:43.334915+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334915+0000","last_undegraded":"2023-12-19T16:16:43.334915+0000","last_fullsized":"2023-12-19T16:16:43.334915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:18.596989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356906+0000","last_change":"2023-12-19T16:16:43.353520+0000","last_active":"2023-12-19T16:16:43.356906+0000","last_peered":"2023-12-19T16:16:43.356906+0000","last_clean":"2023-12-19T16:16:43.356906+0000","last_became_active":"2023-12-19T16:16:43.353269+0000","last_became_peered":"2023-12-19T16:16:43.353269+0000","last_unstale":"2023-12-19T16:16:43.356906+0000","last_undegraded":"2023-12-19T16:16:43.356906+0000","last_fullsized":"2023-12-19T16:16:43.356906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348260+0000","last_change":"2023-12-19T16:16:43.348260+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348260+0000","last_undegraded":"2023-12-19T16:16:43.348260+0000","last_fullsized":"2023-12-19T16:16:43.348260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.730523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352107+0000","last_change":"2023-12-19T16:16:43.346989+0000","last_active":"2023-12-19T16:16:43.352107+0000","last_peered":"2023-12-19T16:16:43.352107+0000","last_clean":"2023-12-19T16:16:43.352107+0000","last_became_active":"2023-12-19T16:16:43.346727+0000","last_became_peered":"2023-12-19T16:16:43.346727+0000","last_unstale":"2023-12-19T16:16:43.352107+0000","last_undegraded":"2023-12-19T16:16:43.352107+0000","last_fullsized":"2023-12-19T16:16:43.352107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:24.447700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335519+0000","last_change":"2023-12-19T16:16:43.335519+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335519+0000","last_undegraded":"2023-12-19T16:16:43.335519+0000","last_fullsized":"2023-12-19T16:16:43.335519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352805+0000","last_change":"2023-12-19T16:16:43.350085+0000","last_active":"2023-12-19T16:16:43.352805+0000","last_peered":"2023-12-19T16:16:43.352805+0000","last_clean":"2023-12-19T16:16:43.352805+0000","last_became_active":"2023-12-19T16:16:43.349811+0000","last_became_peered":"2023-12-19T16:16:43.349811+0000","last_unstale":"2023-12-19T16:16:43.352805+0000","last_undegraded":"2023-12-19T16:16:43.352805+0000","last_fullsized":"2023-12-19T16:16:43.352805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:17.741131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334176+0000","last_change":"2023-12-19T16:16:43.334176+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334176+0000","last_undegraded":"2023-12-19T16:16:43.334176+0000","last_fullsized":"2023-12-19T16:16:43.334176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:43.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361584+0000","last_change":"2023-12-19T16:16:43.360103+0000","last_active":"2023-12-19T16:16:43.361584+0000","last_peered":"2023-12-19T16:16:43.361584+0000","last_clean":"2023-12-19T16:16:43.361584+0000","last_became_active":"2023-12-19T16:16:43.359838+0000","last_became_peered":"2023-12-19T16:16:43.359838+0000","last_unstale":"2023-12-19T16:16:43.361584+0000","last_undegraded":"2023-12-19T16:16:43.361584+0000","last_fullsized":"2023-12-19T16:16:43.361584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:06.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338447+0000","last_change":"2023-12-19T16:16:43.338447+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338447+0000","last_undegraded":"2023-12-19T16:16:43.338447+0000","last_fullsized":"2023-12-19T16:16:43.338447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:04:18.438411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.350123+0000","last_change":"2023-12-19T16:16:43.345454+0000","last_active":"2023-12-19T16:16:43.350123+0000","last_peered":"2023-12-19T16:16:43.350123+0000","last_clean":"2023-12-19T16:16:43.350123+0000","last_became_active":"2023-12-19T16:16:43.344871+0000","last_became_peered":"2023-12-19T16:16:43.344871+0000","last_unstale":"2023-12-19T16:16:43.350123+0000","last_undegraded":"2023-12-19T16:16:43.350123+0000","last_fullsized":"2023-12-19T16:16:43.350123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:18:53.082616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337703+0000","last_change":"2023-12-19T16:16:43.337703+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337703+0000","last_undegraded":"2023-12-19T16:16:43.337703+0000","last_fullsized":"2023-12-19T16:16:43.337703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356645+0000","last_change":"2023-12-19T16:16:43.348383+0000","last_active":"2023-12-19T16:16:43.356645+0000","last_peered":"2023-12-19T16:16:43.356645+0000","last_clean":"2023-12-19T16:16:43.356645+0000","last_became_active":"2023-12-19T16:16:43.348021+0000","last_became_peered":"2023-12-19T16:16:43.348021+0000","last_unstale":"2023-12-19T16:16:43.356645+0000","last_undegraded":"2023-12-19T16:16:43.356645+0000","last_fullsized":"2023-12-19T16:16:43.356645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346713+0000","last_change":"2023-12-19T16:16:43.346713+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346713+0000","last_undegraded":"2023-12-19T16:16:43.346713+0000","last_fullsized":"2023-12-19T16:16:43.346713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.511527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353054+0000","last_change":"2023-12-19T16:16:43.349882+0000","last_active":"2023-12-19T16:16:43.353054+0000","last_peered":"2023-12-19T16:16:43.353054+0000","last_clean":"2023-12-19T16:16:43.353054+0000","last_became_active":"2023-12-19T16:16:43.349600+0000","last_became_peered":"2023-12-19T16:16:43.349600+0000","last_unstale":"2023-12-19T16:16:43.353054+0000","last_undegraded":"2023-12-19T16:16:43.353054+0000","last_fullsized":"2023-12-19T16:16:43.353054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:43:50.507030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337054+0000","last_change":"2023-12-19T16:16:43.337054+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337054+0000","last_undegraded":"2023-12-19T16:16:43.337054+0000","last_fullsized":"2023-12-19T16:16:43.337054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:06:54.423721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353522+0000","last_change":"2023-12-19T16:16:43.348488+0000","last_active":"2023-12-19T16:16:43.353522+0000","last_peered":"2023-12-19T16:16:43.353522+0000","last_clean":"2023-12-19T16:16:43.353522+0000","last_became_active":"2023-12-19T16:16:43.348144+0000","last_became_peered":"2023-12-19T16:16:43.348144+0000","last_unstale":"2023-12-19T16:16:43.353522+0000","last_undegraded":"2023-12-19T16:16:43.353522+0000","last_fullsized":"2023-12-19T16:16:43.353522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336758+0000","last_change":"2023-12-19T16:16:43.336758+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336758+0000","last_undegraded":"2023-12-19T16:16:43.336758+0000","last_fullsized":"2023-12-19T16:16:43.336758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353530+0000","last_change":"2023-12-19T16:16:43.346209+0000","last_active":"2023-12-19T16:16:43.353530+0000","last_peered":"2023-12-19T16:16:43.353530+0000","last_clean":"2023-12-19T16:16:43.353530+0000","last_became_active":"2023-12-19T16:16:43.345183+0000","last_became_peered":"2023-12-19T16:16:43.345183+0000","last_unstale":"2023-12-19T16:16:43.353530+0000","last_undegraded":"2023-12-19T16:16:43.353530+0000","last_fullsized":"2023-12-19T16:16:43.353530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:52.446500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336956+0000","last_change":"2023-12-19T16:16:43.336956+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336956+0000","last_undegraded":"2023-12-19T16:16:43.336956+0000","last_fullsized":"2023-12-19T16:16:43.336956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359157+0000","last_change":"2023-12-19T16:16:43.355011+0000","last_active":"2023-12-19T16:16:43.359157+0000","last_peered":"2023-12-19T16:16:43.359157+0000","last_clean":"2023-12-19T16:16:43.359157+0000","last_became_active":"2023-12-19T16:16:43.352649+0000","last_became_peered":"2023-12-19T16:16:43.352649+0000","last_unstale":"2023-12-19T16:16:43.359157+0000","last_undegraded":"2023-12-19T16:16:43.359157+0000","last_fullsized":"2023-12-19T16:16:43.359157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:17.585498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340344+0000","last_change":"2023-12-19T16:16:43.340344+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340344+0000","last_undegraded":"2023-12-19T16:16:43.340344+0000","last_fullsized":"2023-12-19T16:16:43.340344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355857+0000","last_change":"2023-12-19T16:16:43.347544+0000","last_active":"2023-12-19T16:16:43.355857+0000","last_peered":"2023-12-19T16:16:43.355857+0000","last_clean":"2023-12-19T16:16:43.355857+0000","last_became_active":"2023-12-19T16:16:43.347259+0000","last_became_peered":"2023-12-19T16:16:43.347259+0000","last_unstale":"2023-12-19T16:16:43.355857+0000","last_undegraded":"2023-12-19T16:16:43.355857+0000","last_fullsized":"2023-12-19T16:16:43.355857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:56.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.345062+0000","last_change":"2023-12-19T16:16:43.345062+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.345062+0000","last_undegraded":"2023-12-19T16:16:43.345062+0000","last_fullsized":"2023-12-19T16:16:43.345062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:44.359529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353827+0000","last_change":"2023-12-19T16:16:43.349535+0000","last_active":"2023-12-19T16:16:43.353827+0000","last_peered":"2023-12-19T16:16:43.353827+0000","last_clean":"2023-12-19T16:16:43.353827+0000","last_became_active":"2023-12-19T16:16:43.349097+0000","last_became_peered":"2023-12-19T16:16:43.349097+0000","last_unstale":"2023-12-19T16:16:43.353827+0000","last_undegraded":"2023-12-19T16:16:43.353827+0000","last_fullsized":"2023-12-19T16:16:43.353827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:35.320757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334304+0000","last_change":"2023-12-19T16:16:43.334304+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334304+0000","last_undegraded":"2023-12-19T16:16:43.334304+0000","last_fullsized":"2023-12-19T16:16:43.334304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.360874+0000","last_change":"2023-12-19T16:16:43.358272+0000","last_active":"2023-12-19T16:16:43.360874+0000","last_peered":"2023-12-19T16:16:43.360874+0000","last_clean":"2023-12-19T16:16:43.360874+0000","last_became_active":"2023-12-19T16:16:43.358010+0000","last_became_peered":"2023-12-19T16:16:43.358010+0000","last_unstale":"2023-12-19T16:16:43.360874+0000","last_undegraded":"2023-12-19T16:16:43.360874+0000","last_fullsized":"2023-12-19T16:16:43.360874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:28.970063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:42.328795+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:16:42.328795+0000","last_peered":"2023-12-19T16:16:42.328795+0000","last_clean":"2023-12-19T16:16:42.328795+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:16:42.328795+0000","last_undegraded":"2023-12-19T16:16:42.328795+0000","last_fullsized":"2023-12-19T16:16:42.328795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.499},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.499},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.1559999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.746},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.753}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.379}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.307},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.1259999999999994,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.68300000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.627}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.752},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.437}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495}]},{"osd":4,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97799999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.62},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.47199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:48.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:48.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 Processor -- start 2023-12-19T16:16:48.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 -- start start 2023-12-19T16:16:48.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5840cf0d0 0x7fe5840cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5841648d0 0x7fe584166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5840cfa70 con 0x7fe58415ca40 2023-12-19T16:16:48.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840d11c0 con 0x7fe5840cf0d0 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58c5bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840d0310 con 0x7fe5841648d0 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5840cf0d0 0x7fe5840cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5840cf0d0 0x7fe5840cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45400/0 (socket says 172.21.15.119:45400) 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 -- 172.21.15.119:0/2017275762 learned_addr learned my addr 172.21.15.119:0/2017275762 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58ab59640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5841648d0 0x7fe584166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 -- 172.21.15.119:0/2017275762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5841648d0 msgr2=0x7fe584166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5841648d0 0x7fe584166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 -- 172.21.15.119:0/2017275762 >> v1:172.21.15.143:6789/0 conn(0x7fe58415ca40 legacy=0x7fe5840cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe589b57640 1 -- 172.21.15.119:0/2017275762 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840d05b0 con 0x7fe5840cf0d0 2023-12-19T16:16:48.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.329+0000 7fe58ab59640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5841648d0 0x7fe584166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:48.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe589b57640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5840cf0d0 0x7fe5840cf530 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe574006fd0 tx=0x7fe57401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca11acd974b43b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:48.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe589356640 1 -- 172.21.15.119:0/2017275762 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740aa650 con 0x7fe5840cf0d0 2023-12-19T16:16:48.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe589356640 1 -- 172.21.15.119:0/2017275762 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740aa7b0 con 0x7fe5840cf0d0 2023-12-19T16:16:48.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe589356640 1 -- 172.21.15.119:0/2017275762 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740aab40 con 0x7fe5840cf0d0 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 -- 172.21.15.119:0/2017275762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5840cf0d0 msgr2=0x7fe5840cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5840cf0d0 0x7fe5840cf530 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe574006fd0 tx=0x7fe57401c4f0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 -- 172.21.15.119:0/2017275762 shutdown_connections 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5841648d0 0x7fe584166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/2017275762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5840cf0d0 0x7fe5840cf530 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 -- 172.21.15.119:0/2017275762 >> 172.21.15.119:0/2017275762 conn(0x7fe584089fb0 msgr2=0x7fe5840d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:48.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 -- 172.21.15.119:0/2017275762 shutdown_connections 2023-12-19T16:16:48.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.333+0000 7fe58c5bc640 1 -- 172.21.15.119:0/2017275762 wait complete. 2023-12-19T16:16:48.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 Processor -- start 2023-12-19T16:16:48.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 -- start start 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5840cf0d0 0x7fe58414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe58415ca40 0x7fe5840af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 0x7fe58414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58414c7d0 con 0x7fe5841648d0 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840afb40 con 0x7fe5840cf0d0 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840afe20 con 0x7fe58415ca40 2023-12-19T16:16:48.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 0x7fe58414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 0x7fe58414c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45414/0 (socket says 172.21.15.119:45414) 2023-12-19T16:16:48.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 -- 172.21.15.119:0/3845246915 learned_addr learned my addr 172.21.15.119:0/3845246915 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:48.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe589b57640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe58415ca40 0x7fe5840af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58a358640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5840cf0d0 0x7fe58414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 -- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe58415ca40 msgr2=0x7fe5840af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe58415ca40 0x7fe5840af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 -- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5840cf0d0 msgr2=0x7fe58414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5840cf0d0 0x7fe58414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 -- 172.21.15.119:0/3845246915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009480 con 0x7fe5841648d0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58ab59640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 0x7fe58414c980 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00cdd0 tx=0x7fe57c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00d840 con 0x7fe5841648d0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00d9a0 con 0x7fe5841648d0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5840b0100 con 0x7fe5841648d0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00dd50 con 0x7fe5841648d0 2023-12-19T16:16:48.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.337+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5840b06c0 con 0x7fe5841648d0 2023-12-19T16:16:48.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.341+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5840b08e0 con 0x7fe5841648d0 2023-12-19T16:16:48.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.341+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe57c01e3b0 con 0x7fe5841648d0 2023-12-19T16:16:48.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.341+0000 7fe57affd640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe568065a90 0x7fe568067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.341+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe57c083bb0 con 0x7fe5841648d0 2023-12-19T16:16:48.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.341+0000 7fe58a358640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe568065a90 0x7fe568067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.341+0000 7fe58a358640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe568065a90 0x7fe568067f50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe580000fc0 tx=0x7fe580009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:48.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.345+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe57c0514d0 con 0x7fe5841648d0 2023-12-19T16:16:48.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.493+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe58415ce20 con 0x7fe568065a90 2023-12-19T16:16:48.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.501+0000 7fe57affd640 1 -- 172.21.15.119:0/3845246915 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286117 (secure 0 0 0) 0x7fe580001500 con 0x7fe568065a90 2023-12-19T16:16:48.511 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:48.513 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe568065a90 msgr2=0x7fe568067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe568065a90 0x7fe568067f50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe580000fc0 tx=0x7fe580009040 comp rx=0 tx=0).stop 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 msgr2=0x7fe58414c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 0x7fe58414c980 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00cdd0 tx=0x7fe57c00a710 comp rx=0 tx=0).stop 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 shutdown_connections 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe568065a90 0x7fe568067f50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5841648d0 0x7fe58414c980 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe58415ca40 0x7fe5840af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 --2- 172.21.15.119:0/3845246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5840cf0d0 0x7fe58414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 >> 172.21.15.119:0/3845246915 conn(0x7fe584089fb0 msgr2=0x7fe5840b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 shutdown_connections 2023-12-19T16:16:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.505+0000 7fe58c5bc640 1 -- 172.21.15.119:0/3845246915 wait complete. 2023-12-19T16:16:48.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:48.518 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:48.531 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-12-19T16:16:48.466646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220032,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754688,"statfs":{"total":773094113280,"available":772868800512,"internally_reserved":0,"allocated":4521984,"data_stored":2588614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000948"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338118+0000","last_change":"2023-12-19T16:16:43.338118+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338118+0000","last_undegraded":"2023-12-19T16:16:43.338118+0000","last_fullsized":"2023-12-19T16:16:43.338118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.457430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337559+0000","last_change":"2023-12-19T16:16:43.337559+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337559+0000","last_undegraded":"2023-12-19T16:16:43.337559+0000","last_fullsized":"2023-12-19T16:16:43.337559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339257+0000","last_change":"2023-12-19T16:16:43.339257+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339257+0000","last_undegraded":"2023-12-19T16:16:43.339257+0000","last_fullsized":"2023-12-19T16:16:43.339257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335769+0000","last_change":"2023-12-19T16:16:43.335769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335769+0000","last_undegraded":"2023-12-19T16:16:43.335769+0000","last_fullsized":"2023-12-19T16:16:43.335769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:47.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335614+0000","last_change":"2023-12-19T16:16:43.335614+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335614+0000","last_undegraded":"2023-12-19T16:16:43.335614+0000","last_fullsized":"2023-12-19T16:16:43.335614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:25.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338026+0000","last_change":"2023-12-19T16:16:43.338026+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338026+0000","last_undegraded":"2023-12-19T16:16:43.338026+0000","last_fullsized":"2023-12-19T16:16:43.338026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335944+0000","last_change":"2023-12-19T16:16:43.335944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335944+0000","last_undegraded":"2023-12-19T16:16:43.335944+0000","last_fullsized":"2023-12-19T16:16:43.335944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:59:06.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337835+0000","last_change":"2023-12-19T16:16:43.337835+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337835+0000","last_undegraded":"2023-12-19T16:16:43.337835+0000","last_fullsized":"2023-12-19T16:16:43.337835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:44.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341168+0000","last_change":"2023-12-19T16:16:43.341168+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341168+0000","last_undegraded":"2023-12-19T16:16:43.341168+0000","last_fullsized":"2023-12-19T16:16:43.341168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336369+0000","last_change":"2023-12-19T16:16:43.336369+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336369+0000","last_undegraded":"2023-12-19T16:16:43.336369+0000","last_fullsized":"2023-12-19T16:16:43.336369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335006+0000","last_change":"2023-12-19T16:16:43.335006+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335006+0000","last_undegraded":"2023-12-19T16:16:43.335006+0000","last_fullsized":"2023-12-19T16:16:43.335006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:28.808811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338899+0000","last_change":"2023-12-19T16:16:43.338899+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338899+0000","last_undegraded":"2023-12-19T16:16:43.338899+0000","last_fullsized":"2023-12-19T16:16:43.338899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:17:05.566170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335735+0000","last_change":"2023-12-19T16:16:43.335735+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335735+0000","last_undegraded":"2023-12-19T16:16:43.335735+0000","last_fullsized":"2023-12-19T16:16:43.335735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:15.147537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340837+0000","last_change":"2023-12-19T16:16:43.340837+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340837+0000","last_undegraded":"2023-12-19T16:16:43.340837+0000","last_fullsized":"2023-12-19T16:16:43.340837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335395+0000","last_change":"2023-12-19T16:16:43.335395+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335395+0000","last_undegraded":"2023-12-19T16:16:43.335395+0000","last_fullsized":"2023-12-19T16:16:43.335395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348688+0000","last_change":"2023-12-19T16:16:43.348688+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348688+0000","last_undegraded":"2023-12-19T16:16:43.348688+0000","last_fullsized":"2023-12-19T16:16:43.348688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:59.870736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.350099+0000","last_change":"2023-12-19T16:16:43.350099+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.350099+0000","last_undegraded":"2023-12-19T16:16:43.350099+0000","last_fullsized":"2023-12-19T16:16:43.350099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338925+0000","last_change":"2023-12-19T16:16:43.338925+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338925+0000","last_undegraded":"2023-12-19T16:16:43.338925+0000","last_fullsized":"2023-12-19T16:16:43.338925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338228+0000","last_change":"2023-12-19T16:16:43.338228+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338228+0000","last_undegraded":"2023-12-19T16:16:43.338228+0000","last_fullsized":"2023-12-19T16:16:43.338228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:30.632732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340185+0000","last_change":"2023-12-19T16:16:43.340185+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340185+0000","last_undegraded":"2023-12-19T16:16:43.340185+0000","last_fullsized":"2023-12-19T16:16:43.340185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335197+0000","last_change":"2023-12-19T16:16:43.335197+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335197+0000","last_undegraded":"2023-12-19T16:16:43.335197+0000","last_fullsized":"2023-12-19T16:16:43.335197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339777+0000","last_change":"2023-12-19T16:16:43.339777+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339777+0000","last_undegraded":"2023-12-19T16:16:43.339777+0000","last_fullsized":"2023-12-19T16:16:43.339777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347769+0000","last_change":"2023-12-19T16:16:43.347769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347769+0000","last_undegraded":"2023-12-19T16:16:43.347769+0000","last_fullsized":"2023-12-19T16:16:43.347769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336223+0000","last_change":"2023-12-19T16:16:43.336223+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336223+0000","last_undegraded":"2023-12-19T16:16:43.336223+0000","last_fullsized":"2023-12-19T16:16:43.336223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:00.102817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339775+0000","last_change":"2023-12-19T16:16:43.339775+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339775+0000","last_undegraded":"2023-12-19T16:16:43.339775+0000","last_fullsized":"2023-12-19T16:16:43.339775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338229+0000","last_change":"2023-12-19T16:16:43.338229+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338229+0000","last_undegraded":"2023-12-19T16:16:43.338229+0000","last_fullsized":"2023-12-19T16:16:43.338229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340668+0000","last_change":"2023-12-19T16:16:43.340668+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340668+0000","last_undegraded":"2023-12-19T16:16:43.340668+0000","last_fullsized":"2023-12-19T16:16:43.340668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:51.570844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334767+0000","last_change":"2023-12-19T16:16:43.334767+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334767+0000","last_undegraded":"2023-12-19T16:16:43.334767+0000","last_fullsized":"2023-12-19T16:16:43.334767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339584+0000","last_change":"2023-12-19T16:16:43.339584+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339584+0000","last_undegraded":"2023-12-19T16:16:43.339584+0000","last_fullsized":"2023-12-19T16:16:43.339584+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:53.457991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340792+0000","last_change":"2023-12-19T16:16:43.340792+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340792+0000","last_undegraded":"2023-12-19T16:16:43.340792+0000","last_fullsized":"2023-12-19T16:16:43.340792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:56.016247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347279+0000","last_change":"2023-12-19T16:16:43.347279+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347279+0000","last_undegraded":"2023-12-19T16:16:43.347279+0000","last_fullsized":"2023-12-19T16:16:43.347279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336623+0000","last_change":"2023-12-19T16:16:43.336623+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336623+0000","last_undegraded":"2023-12-19T16:16:43.336623+0000","last_fullsized":"2023-12-19T16:16:43.336623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:59:27.494042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346171+0000","last_change":"2023-12-19T16:16:43.346171+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346171+0000","last_undegraded":"2023-12-19T16:16:43.346171+0000","last_fullsized":"2023-12-19T16:16:43.346171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359067+0000","last_change":"2023-12-19T16:16:43.353262+0000","last_active":"2023-12-19T16:16:43.359067+0000","last_peered":"2023-12-19T16:16:43.359067+0000","last_clean":"2023-12-19T16:16:43.359067+0000","last_became_active":"2023-12-19T16:16:43.352978+0000","last_became_peered":"2023-12-19T16:16:43.352978+0000","last_unstale":"2023-12-19T16:16:43.359067+0000","last_undegraded":"2023-12-19T16:16:43.359067+0000","last_fullsized":"2023-12-19T16:16:43.359067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339356+0000","last_change":"2023-12-19T16:16:43.339356+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339356+0000","last_undegraded":"2023-12-19T16:16:43.339356+0000","last_fullsized":"2023-12-19T16:16:43.339356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359660+0000","last_change":"2023-12-19T16:16:43.356368+0000","last_active":"2023-12-19T16:16:43.359660+0000","last_peered":"2023-12-19T16:16:43.359660+0000","last_clean":"2023-12-19T16:16:43.359660+0000","last_became_active":"2023-12-19T16:16:43.355995+0000","last_became_peered":"2023-12-19T16:16:43.355995+0000","last_unstale":"2023-12-19T16:16:43.359660+0000","last_undegraded":"2023-12-19T16:16:43.359660+0000","last_fullsized":"2023-12-19T16:16:43.359660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341524+0000","last_change":"2023-12-19T16:16:43.341524+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341524+0000","last_undegraded":"2023-12-19T16:16:43.341524+0000","last_fullsized":"2023-12-19T16:16:43.341524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.357381+0000","last_change":"2023-12-19T16:16:43.354704+0000","last_active":"2023-12-19T16:16:43.357381+0000","last_peered":"2023-12-19T16:16:43.357381+0000","last_clean":"2023-12-19T16:16:43.357381+0000","last_became_active":"2023-12-19T16:16:43.354443+0000","last_became_peered":"2023-12-19T16:16:43.354443+0000","last_unstale":"2023-12-19T16:16:43.357381+0000","last_undegraded":"2023-12-19T16:16:43.357381+0000","last_fullsized":"2023-12-19T16:16:43.357381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338567+0000","last_change":"2023-12-19T16:16:43.338567+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338567+0000","last_undegraded":"2023-12-19T16:16:43.338567+0000","last_fullsized":"2023-12-19T16:16:43.338567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:42.986335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359349+0000","last_change":"2023-12-19T16:16:43.352896+0000","last_active":"2023-12-19T16:16:43.359349+0000","last_peered":"2023-12-19T16:16:43.359349+0000","last_clean":"2023-12-19T16:16:43.359349+0000","last_became_active":"2023-12-19T16:16:43.352492+0000","last_became_peered":"2023-12-19T16:16:43.352492+0000","last_unstale":"2023-12-19T16:16:43.359349+0000","last_undegraded":"2023-12-19T16:16:43.359349+0000","last_fullsized":"2023-12-19T16:16:43.359349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337686+0000","last_change":"2023-12-19T16:16:43.337686+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337686+0000","last_undegraded":"2023-12-19T16:16:43.337686+0000","last_fullsized":"2023-12-19T16:16:43.337686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358862+0000","last_change":"2023-12-19T16:16:43.354651+0000","last_active":"2023-12-19T16:16:43.358862+0000","last_peered":"2023-12-19T16:16:43.358862+0000","last_clean":"2023-12-19T16:16:43.358862+0000","last_became_active":"2023-12-19T16:16:43.354392+0000","last_became_peered":"2023-12-19T16:16:43.354392+0000","last_unstale":"2023-12-19T16:16:43.358862+0000","last_undegraded":"2023-12-19T16:16:43.358862+0000","last_fullsized":"2023-12-19T16:16:43.358862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.500035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333774+0000","last_change":"2023-12-19T16:16:43.333774+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333774+0000","last_undegraded":"2023-12-19T16:16:43.333774+0000","last_fullsized":"2023-12-19T16:16:43.333774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361527+0000","last_change":"2023-12-19T16:16:43.359797+0000","last_active":"2023-12-19T16:16:43.361527+0000","last_peered":"2023-12-19T16:16:43.361527+0000","last_clean":"2023-12-19T16:16:43.361527+0000","last_became_active":"2023-12-19T16:16:43.359535+0000","last_became_peered":"2023-12-19T16:16:43.359535+0000","last_unstale":"2023-12-19T16:16:43.361527+0000","last_undegraded":"2023-12-19T16:16:43.361527+0000","last_fullsized":"2023-12-19T16:16:43.361527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339230+0000","last_change":"2023-12-19T16:16:43.339230+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339230+0000","last_undegraded":"2023-12-19T16:16:43.339230+0000","last_fullsized":"2023-12-19T16:16:43.339230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355477+0000","last_change":"2023-12-19T16:16:43.350869+0000","last_active":"2023-12-19T16:16:43.355477+0000","last_peered":"2023-12-19T16:16:43.355477+0000","last_clean":"2023-12-19T16:16:43.355477+0000","last_became_active":"2023-12-19T16:16:43.350591+0000","last_became_peered":"2023-12-19T16:16:43.350591+0000","last_unstale":"2023-12-19T16:16:43.355477+0000","last_undegraded":"2023-12-19T16:16:43.355477+0000","last_fullsized":"2023-12-19T16:16:43.355477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339397+0000","last_change":"2023-12-19T16:16:43.339397+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339397+0000","last_undegraded":"2023-12-19T16:16:43.339397+0000","last_fullsized":"2023-12-19T16:16:43.339397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:04.059004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359272+0000","last_change":"2023-12-19T16:16:43.351126+0000","last_active":"2023-12-19T16:16:43.359272+0000","last_peered":"2023-12-19T16:16:43.359272+0000","last_clean":"2023-12-19T16:16:43.359272+0000","last_became_active":"2023-12-19T16:16:43.350844+0000","last_became_peered":"2023-12-19T16:16:43.350844+0000","last_unstale":"2023-12-19T16:16:43.359272+0000","last_undegraded":"2023-12-19T16:16:43.359272+0000","last_fullsized":"2023-12-19T16:16:43.359272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335055+0000","last_change":"2023-12-19T16:16:43.335055+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335055+0000","last_undegraded":"2023-12-19T16:16:43.335055+0000","last_fullsized":"2023-12-19T16:16:43.335055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:23.594948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353568+0000","last_change":"2023-12-19T16:16:43.348887+0000","last_active":"2023-12-19T16:16:43.353568+0000","last_peered":"2023-12-19T16:16:43.353568+0000","last_clean":"2023-12-19T16:16:43.353568+0000","last_became_active":"2023-12-19T16:16:43.348607+0000","last_became_peered":"2023-12-19T16:16:43.348607+0000","last_unstale":"2023-12-19T16:16:43.353568+0000","last_undegraded":"2023-12-19T16:16:43.353568+0000","last_fullsized":"2023-12-19T16:16:43.353568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:32.705972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347181+0000","last_change":"2023-12-19T16:16:43.347181+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347181+0000","last_undegraded":"2023-12-19T16:16:43.347181+0000","last_fullsized":"2023-12-19T16:16:43.347181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:41.285289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358700+0000","last_change":"2023-12-19T16:16:43.353196+0000","last_active":"2023-12-19T16:16:43.358700+0000","last_peered":"2023-12-19T16:16:43.358700+0000","last_clean":"2023-12-19T16:16:43.358700+0000","last_became_active":"2023-12-19T16:16:43.352913+0000","last_became_peered":"2023-12-19T16:16:43.352913+0000","last_unstale":"2023-12-19T16:16:43.358700+0000","last_undegraded":"2023-12-19T16:16:43.358700+0000","last_fullsized":"2023-12-19T16:16:43.358700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342135+0000","last_change":"2023-12-19T16:16:43.342135+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342135+0000","last_undegraded":"2023-12-19T16:16:43.342135+0000","last_fullsized":"2023-12-19T16:16:43.342135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:33.717463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356707+0000","last_change":"2023-12-19T16:16:43.349320+0000","last_active":"2023-12-19T16:16:43.356707+0000","last_peered":"2023-12-19T16:16:43.356707+0000","last_clean":"2023-12-19T16:16:43.356707+0000","last_became_active":"2023-12-19T16:16:43.348855+0000","last_became_peered":"2023-12-19T16:16:43.348855+0000","last_unstale":"2023-12-19T16:16:43.356707+0000","last_undegraded":"2023-12-19T16:16:43.356707+0000","last_fullsized":"2023-12-19T16:16:43.356707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.343896+0000","last_change":"2023-12-19T16:16:43.343896+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.343896+0000","last_undegraded":"2023-12-19T16:16:43.343896+0000","last_fullsized":"2023-12-19T16:16:43.343896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359701+0000","last_change":"2023-12-19T16:16:43.356135+0000","last_active":"2023-12-19T16:16:43.359701+0000","last_peered":"2023-12-19T16:16:43.359701+0000","last_clean":"2023-12-19T16:16:43.359701+0000","last_became_active":"2023-12-19T16:16:43.355836+0000","last_became_peered":"2023-12-19T16:16:43.355836+0000","last_unstale":"2023-12-19T16:16:43.359701+0000","last_undegraded":"2023-12-19T16:16:43.359701+0000","last_fullsized":"2023-12-19T16:16:43.359701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:22.459861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337262+0000","last_change":"2023-12-19T16:16:43.337262+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337262+0000","last_undegraded":"2023-12-19T16:16:43.337262+0000","last_fullsized":"2023-12-19T16:16:43.337262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.354176+0000","last_change":"2023-12-19T16:16:43.352367+0000","last_active":"2023-12-19T16:16:43.354176+0000","last_peered":"2023-12-19T16:16:43.354176+0000","last_clean":"2023-12-19T16:16:43.354176+0000","last_became_active":"2023-12-19T16:16:43.351864+0000","last_became_peered":"2023-12-19T16:16:43.351864+0000","last_unstale":"2023-12-19T16:16:43.354176+0000","last_undegraded":"2023-12-19T16:16:43.354176+0000","last_fullsized":"2023-12-19T16:16:43.354176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:08.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337025+0000","last_change":"2023-12-19T16:16:43.337025+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337025+0000","last_undegraded":"2023-12-19T16:16:43.337025+0000","last_fullsized":"2023-12-19T16:16:43.337025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:09.818826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355298+0000","last_change":"2023-12-19T16:16:43.351147+0000","last_active":"2023-12-19T16:16:43.355298+0000","last_peered":"2023-12-19T16:16:43.355298+0000","last_clean":"2023-12-19T16:16:43.355298+0000","last_became_active":"2023-12-19T16:16:43.350898+0000","last_became_peered":"2023-12-19T16:16:43.350898+0000","last_unstale":"2023-12-19T16:16:43.355298+0000","last_undegraded":"2023-12-19T16:16:43.355298+0000","last_fullsized":"2023-12-19T16:16:43.355298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.349392+0000","last_change":"2023-12-19T16:16:43.349392+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.349392+0000","last_undegraded":"2023-12-19T16:16:43.349392+0000","last_fullsized":"2023-12-19T16:16:43.349392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359130+0000","last_change":"2023-12-19T16:16:43.353579+0000","last_active":"2023-12-19T16:16:43.359130+0000","last_peered":"2023-12-19T16:16:43.359130+0000","last_clean":"2023-12-19T16:16:43.359130+0000","last_became_active":"2023-12-19T16:16:43.353312+0000","last_became_peered":"2023-12-19T16:16:43.353312+0000","last_unstale":"2023-12-19T16:16:43.359130+0000","last_undegraded":"2023-12-19T16:16:43.359130+0000","last_fullsized":"2023-12-19T16:16:43.359130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338944+0000","last_change":"2023-12-19T16:16:43.338944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338944+0000","last_undegraded":"2023-12-19T16:16:43.338944+0000","last_fullsized":"2023-12-19T16:16:43.338944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:25:50.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361587+0000","last_change":"2023-12-19T16:16:43.360259+0000","last_active":"2023-12-19T16:16:43.361587+0000","last_peered":"2023-12-19T16:16:43.361587+0000","last_clean":"2023-12-19T16:16:43.361587+0000","last_became_active":"2023-12-19T16:16:43.359966+0000","last_became_peered":"2023-12-19T16:16:43.359966+0000","last_unstale":"2023-12-19T16:16:43.361587+0000","last_undegraded":"2023-12-19T16:16:43.361587+0000","last_fullsized":"2023-12-19T16:16:43.361587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337472+0000","last_change":"2023-12-19T16:16:43.337472+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337472+0000","last_undegraded":"2023-12-19T16:16:43.337472+0000","last_fullsized":"2023-12-19T16:16:43.337472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:38.947784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358958+0000","last_change":"2023-12-19T16:16:43.355248+0000","last_active":"2023-12-19T16:16:43.358958+0000","last_peered":"2023-12-19T16:16:43.358958+0000","last_clean":"2023-12-19T16:16:43.358958+0000","last_became_active":"2023-12-19T16:16:43.353926+0000","last_became_peered":"2023-12-19T16:16:43.353926+0000","last_unstale":"2023-12-19T16:16:43.358958+0000","last_undegraded":"2023-12-19T16:16:43.358958+0000","last_fullsized":"2023-12-19T16:16:43.358958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333995+0000","last_change":"2023-12-19T16:16:43.333995+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333995+0000","last_undegraded":"2023-12-19T16:16:43.333995+0000","last_fullsized":"2023-12-19T16:16:43.333995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359426+0000","last_change":"2023-12-19T16:16:43.353818+0000","last_active":"2023-12-19T16:16:43.359426+0000","last_peered":"2023-12-19T16:16:43.359426+0000","last_clean":"2023-12-19T16:16:43.359426+0000","last_became_active":"2023-12-19T16:16:43.351904+0000","last_became_peered":"2023-12-19T16:16:43.351904+0000","last_unstale":"2023-12-19T16:16:43.359426+0000","last_undegraded":"2023-12-19T16:16:43.359426+0000","last_fullsized":"2023-12-19T16:16:43.359426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:15.707442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342077+0000","last_change":"2023-12-19T16:16:43.342077+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342077+0000","last_undegraded":"2023-12-19T16:16:43.342077+0000","last_fullsized":"2023-12-19T16:16:43.342077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359875+0000","last_change":"2023-12-19T16:16:43.357129+0000","last_active":"2023-12-19T16:16:43.359875+0000","last_peered":"2023-12-19T16:16:43.359875+0000","last_clean":"2023-12-19T16:16:43.359875+0000","last_became_active":"2023-12-19T16:16:43.356522+0000","last_became_peered":"2023-12-19T16:16:43.356522+0000","last_unstale":"2023-12-19T16:16:43.359875+0000","last_undegraded":"2023-12-19T16:16:43.359875+0000","last_fullsized":"2023-12-19T16:16:43.359875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:19.245588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334915+0000","last_change":"2023-12-19T16:16:43.334915+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334915+0000","last_undegraded":"2023-12-19T16:16:43.334915+0000","last_fullsized":"2023-12-19T16:16:43.334915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:18.596989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356906+0000","last_change":"2023-12-19T16:16:43.353520+0000","last_active":"2023-12-19T16:16:43.356906+0000","last_peered":"2023-12-19T16:16:43.356906+0000","last_clean":"2023-12-19T16:16:43.356906+0000","last_became_active":"2023-12-19T16:16:43.353269+0000","last_became_peered":"2023-12-19T16:16:43.353269+0000","last_unstale":"2023-12-19T16:16:43.356906+0000","last_undegraded":"2023-12-19T16:16:43.356906+0000","last_fullsized":"2023-12-19T16:16:43.356906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348260+0000","last_change":"2023-12-19T16:16:43.348260+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348260+0000","last_undegraded":"2023-12-19T16:16:43.348260+0000","last_fullsized":"2023-12-19T16:16:43.348260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.730523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352107+0000","last_change":"2023-12-19T16:16:43.346989+0000","last_active":"2023-12-19T16:16:43.352107+0000","last_peered":"2023-12-19T16:16:43.352107+0000","last_clean":"2023-12-19T16:16:43.352107+0000","last_became_active":"2023-12-19T16:16:43.346727+0000","last_became_peered":"2023-12-19T16:16:43.346727+0000","last_unstale":"2023-12-19T16:16:43.352107+0000","last_undegraded":"2023-12-19T16:16:43.352107+0000","last_fullsized":"2023-12-19T16:16:43.352107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:24.447700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335519+0000","last_change":"2023-12-19T16:16:43.335519+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335519+0000","last_undegraded":"2023-12-19T16:16:43.335519+0000","last_fullsized":"2023-12-19T16:16:43.335519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352805+0000","last_change":"2023-12-19T16:16:43.350085+0000","last_active":"2023-12-19T16:16:43.352805+0000","last_peered":"2023-12-19T16:16:43.352805+0000","last_clean":"2023-12-19T16:16:43.352805+0000","last_became_active":"2023-12-19T16:16:43.349811+0000","last_became_peered":"2023-12-19T16:16:43.349811+0000","last_unstale":"2023-12-19T16:16:43.352805+0000","last_undegraded":"2023-12-19T16:16:43.352805+0000","last_fullsized":"2023-12-19T16:16:43.352805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:17.741131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334176+0000","last_change":"2023-12-19T16:16:43.334176+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334176+0000","last_undegraded":"2023-12-19T16:16:43.334176+0000","last_fullsized":"2023-12-19T16:16:43.334176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:43.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361584+0000","last_change":"2023-12-19T16:16:43.360103+0000","last_active":"2023-12-19T16:16:43.361584+0000","last_peered":"2023-12-19T16:16:43.361584+0000","last_clean":"2023-12-19T16:16:43.361584+0000","last_became_active":"2023-12-19T16:16:43.359838+0000","last_became_peered":"2023-12-19T16:16:43.359838+0000","last_unstale":"2023-12-19T16:16:43.361584+0000","last_undegraded":"2023-12-19T16:16:43.361584+0000","last_fullsized":"2023-12-19T16:16:43.361584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:06.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338447+0000","last_change":"2023-12-19T16:16:43.338447+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338447+0000","last_undegraded":"2023-12-19T16:16:43.338447+0000","last_fullsized":"2023-12-19T16:16:43.338447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:04:18.438411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.350123+0000","last_change":"2023-12-19T16:16:43.345454+0000","last_active":"2023-12-19T16:16:43.350123+0000","last_peered":"2023-12-19T16:16:43.350123+0000","last_clean":"2023-12-19T16:16:43.350123+0000","last_became_active":"2023-12-19T16:16:43.344871+0000","last_became_peered":"2023-12-19T16:16:43.344871+0000","last_unstale":"2023-12-19T16:16:43.350123+0000","last_undegraded":"2023-12-19T16:16:43.350123+0000","last_fullsized":"2023-12-19T16:16:43.350123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:18:53.082616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337703+0000","last_change":"2023-12-19T16:16:43.337703+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337703+0000","last_undegraded":"2023-12-19T16:16:43.337703+0000","last_fullsized":"2023-12-19T16:16:43.337703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356645+0000","last_change":"2023-12-19T16:16:43.348383+0000","last_active":"2023-12-19T16:16:43.356645+0000","last_peered":"2023-12-19T16:16:43.356645+0000","last_clean":"2023-12-19T16:16:43.356645+0000","last_became_active":"2023-12-19T16:16:43.348021+0000","last_became_peered":"2023-12-19T16:16:43.348021+0000","last_unstale":"2023-12-19T16:16:43.356645+0000","last_undegraded":"2023-12-19T16:16:43.356645+0000","last_fullsized":"2023-12-19T16:16:43.356645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346713+0000","last_change":"2023-12-19T16:16:43.346713+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346713+0000","last_undegraded":"2023-12-19T16:16:43.346713+0000","last_fullsized":"2023-12-19T16:16:43.346713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.511527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353054+0000","last_change":"2023-12-19T16:16:43.349882+0000","last_active":"2023-12-19T16:16:43.353054+0000","last_peered":"2023-12-19T16:16:43.353054+0000","last_clean":"2023-12-19T16:16:43.353054+0000","last_became_active":"2023-12-19T16:16:43.349600+0000","last_became_peered":"2023-12-19T16:16:43.349600+0000","last_unstale":"2023-12-19T16:16:43.353054+0000","last_undegraded":"2023-12-19T16:16:43.353054+0000","last_fullsized":"2023-12-19T16:16:43.353054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:43:50.507030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337054+0000","last_change":"2023-12-19T16:16:43.337054+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337054+0000","last_undegraded":"2023-12-19T16:16:43.337054+0000","last_fullsized":"2023-12-19T16:16:43.337054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:06:54.423721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353522+0000","last_change":"2023-12-19T16:16:43.348488+0000","last_active":"2023-12-19T16:16:43.353522+0000","last_peered":"2023-12-19T16:16:43.353522+0000","last_clean":"2023-12-19T16:16:43.353522+0000","last_became_active":"2023-12-19T16:16:43.348144+0000","last_became_peered":"2023-12-19T16:16:43.348144+0000","last_unstale":"2023-12-19T16:16:43.353522+0000","last_undegraded":"2023-12-19T16:16:43.353522+0000","last_fullsized":"2023-12-19T16:16:43.353522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336758+0000","last_change":"2023-12-19T16:16:43.336758+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336758+0000","last_undegraded":"2023-12-19T16:16:43.336758+0000","last_fullsized":"2023-12-19T16:16:43.336758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353530+0000","last_change":"2023-12-19T16:16:43.346209+0000","last_active":"2023-12-19T16:16:43.353530+0000","last_peered":"2023-12-19T16:16:43.353530+0000","last_clean":"2023-12-19T16:16:43.353530+0000","last_became_active":"2023-12-19T16:16:43.345183+0000","last_became_peered":"2023-12-19T16:16:43.345183+0000","last_unstale":"2023-12-19T16:16:43.353530+0000","last_undegraded":"2023-12-19T16:16:43.353530+0000","last_fullsized":"2023-12-19T16:16:43.353530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:52.446500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336956+0000","last_change":"2023-12-19T16:16:43.336956+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336956+0000","last_undegraded":"2023-12-19T16:16:43.336956+0000","last_fullsized":"2023-12-19T16:16:43.336956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359157+0000","last_change":"2023-12-19T16:16:43.355011+0000","last_active":"2023-12-19T16:16:43.359157+0000","last_peered":"2023-12-19T16:16:43.359157+0000","last_clean":"2023-12-19T16:16:43.359157+0000","last_became_active":"2023-12-19T16:16:43.352649+0000","last_became_peered":"2023-12-19T16:16:43.352649+0000","last_unstale":"2023-12-19T16:16:43.359157+0000","last_undegraded":"2023-12-19T16:16:43.359157+0000","last_fullsized":"2023-12-19T16:16:43.359157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:17.585498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340344+0000","last_change":"2023-12-19T16:16:43.340344+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340344+0000","last_undegraded":"2023-12-19T16:16:43.340344+0000","last_fullsized":"2023-12-19T16:16:43.340344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355857+0000","last_change":"2023-12-19T16:16:43.347544+0000","last_active":"2023-12-19T16:16:43.355857+0000","last_peered":"2023-12-19T16:16:43.355857+0000","last_clean":"2023-12-19T16:16:43.355857+0000","last_became_active":"2023-12-19T16:16:43.347259+0000","last_became_peered":"2023-12-19T16:16:43.347259+0000","last_unstale":"2023-12-19T16:16:43.355857+0000","last_undegraded":"2023-12-19T16:16:43.355857+0000","last_fullsized":"2023-12-19T16:16:43.355857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:56.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.345062+0000","last_change":"2023-12-19T16:16:43.345062+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.345062+0000","last_undegraded":"2023-12-19T16:16:43.345062+0000","last_fullsized":"2023-12-19T16:16:43.345062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:44.359529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353827+0000","last_change":"2023-12-19T16:16:43.349535+0000","last_active":"2023-12-19T16:16:43.353827+0000","last_peered":"2023-12-19T16:16:43.353827+0000","last_clean":"2023-12-19T16:16:43.353827+0000","last_became_active":"2023-12-19T16:16:43.349097+0000","last_became_peered":"2023-12-19T16:16:43.349097+0000","last_unstale":"2023-12-19T16:16:43.353827+0000","last_undegraded":"2023-12-19T16:16:43.353827+0000","last_fullsized":"2023-12-19T16:16:43.353827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:35.320757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334304+0000","last_change":"2023-12-19T16:16:43.334304+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334304+0000","last_undegraded":"2023-12-19T16:16:43.334304+0000","last_fullsized":"2023-12-19T16:16:43.334304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.360874+0000","last_change":"2023-12-19T16:16:43.358272+0000","last_active":"2023-12-19T16:16:43.360874+0000","last_peered":"2023-12-19T16:16:43.360874+0000","last_clean":"2023-12-19T16:16:43.360874+0000","last_became_active":"2023-12-19T16:16:43.358010+0000","last_became_peered":"2023-12-19T16:16:43.358010+0000","last_unstale":"2023-12-19T16:16:43.360874+0000","last_undegraded":"2023-12-19T16:16:43.360874+0000","last_fullsized":"2023-12-19T16:16:43.360874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:28.970063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:42.328795+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:16:42.328795+0000","last_peered":"2023-12-19T16:16:42.328795+0000","last_clean":"2023-12-19T16:16:42.328795+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:16:42.328795+0000","last_undegraded":"2023-12-19T16:16:42.328795+0000","last_fullsized":"2023-12-19T16:16:42.328795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.499},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.499},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.1559999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.746},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.753}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.379}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.307},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.1259999999999994,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.68300000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.627}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.752},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.437}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495}]},{"osd":4,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97799999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.62},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.47199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338118+0000', 'last_change': '2023-12-19T16:16:43.338118+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338118+0000', 'last_undegraded': '2023-12-19T16:16:43.338118+0000', 'last_fullsized': '2023-12-19T16:16:43.338118+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:00:56.457430+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337559+0000', 'last_change': '2023-12-19T16:16:43.337559+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337559+0000', 'last_undegraded': '2023-12-19T16:16:43.337559+0000', 'last_fullsized': '2023-12-19T16:16:43.337559+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339257+0000', 'last_change': '2023-12-19T16:16:43.339257+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339257+0000', 'last_undegraded': '2023-12-19T16:16:43.339257+0000', 'last_fullsized': '2023-12-19T16:16:43.339257+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-12-19T16:16:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335769+0000', 'last_change': '2023-12-19T16:16:43.335769+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335769+0000', 'last_undegraded': '2023-12-19T16:16:43.335769+0000', 'last_fullsized': '2023-12-19T16:16:43.335769+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:46:47.984745+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335614+0000', 'last_change': '2023-12-19T16:16:43.335614+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335614+0000', 'last_undegraded': '2023-12-19T16:16:43.335614+0000', 'last_fullsized': '2023-12-19T16:16:43.335614+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:09:25.945586+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338026+0000', 'last_change': '2023-12-19T16:16:43.338026+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338026+0000', 'last_undegraded': '2023-12-19T16:16:43.338026+0000', 'last_fullsized': '2023-12-19T16:16:43.338026+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335944+0000', 'last_change': '2023-12-19T16:16:43.335944+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335944+0000', 'last_undegraded': '2023-12-19T16:16:43.335944+0000', 'last_fullsized': '2023-12-19T16:16:43.335944+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:59:06.895711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337835+0000', 'last_change': '2023-12-19T16:16:43.337835+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337835+0000', 'last_undegraded': '2023-12-19T16:16:43.337835+0000', 'last_fullsized': '2023-12-19T16:16:43.337835+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:13:44.026866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-12-19T16:16:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.341168+0000', 'last_change': '2023-12-19T16:16:43.341168+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.341168+0000', 'last_undegraded': '2023-12-19T16:16:43.341168+0000', 'last_fullsized': '2023-12-19T16:16:43.341168+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.336369+0000', 'last_change': '2023-12-19T16:16:43.336369+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.336369+0000', 'last_undegraded': '2023-12-19T16:16:43.336369+0000', 'last_fullsized': '2023-12-19T16:16:43.336369+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335006+0000', 'last_change': '2023-12-19T16:16:43.335006+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335006+0000', 'last_undegraded': '2023-12-19T16:16:43.335006+0000', 'last_fullsized': '2023-12-19T16:16:43.335006+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:05:28.808811+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338899+0000', 'last_change': '2023-12-19T16:16:43.338899+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338899+0000', 'last_undegraded': '2023-12-19T16:16:43.338899+0000', 'last_fullsized': '2023-12-19T16:16:43.338899+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:17:05.566170+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335735+0000', 'last_change': '2023-12-19T16:16:43.335735+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335735+0000', 'last_undegraded': '2023-12-19T16:16:43.335735+0000', 'last_fullsized': '2023-12-19T16:16:43.335735+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:04:15.147537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.340837+0000', 'last_change': '2023-12-19T16:16:43.340837+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.340837+0000', 'last_undegraded': '2023-12-19T16:16:43.340837+0000', 'last_fullsized': '2023-12-19T16:16:43.340837+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335395+0000', 'last_change': '2023-12-19T16:16:43.335395+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335395+0000', 'last_undegraded': '2023-12-19T16:16:43.335395+0000', 'last_fullsized': '2023-12-19T16:16:43.335395+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.348688+0000', 'last_change': '2023-12-19T16:16:43.348688+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.348688+0000', 'last_undegraded': '2023-12-19T16:16:43.348688+0000', 'last_fullsized': '2023-12-19T16:16:43.348688+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:07:59.870736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.350099+0000', 'last_change': '2023-12-19T16:16:43.350099+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.350099+0000', 'last_undegraded': '2023-12-19T16:16:43.350099+0000', 'last_fullsized': '2023-12-19T16:16:43.350099+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:57:16.718934+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338925+0000', 'last_change': '2023-12-19T16:16:43.338925+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338925+0000', 'last_undegraded': '2023-12-19T16:16:43.338925+0000', 'last_fullsized': '2023-12-19T16:16:43.338925+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338228+0000', 'last_change': '2023-12-19T16:16:43.338228+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338228+0000', 'last_undegraded': '2023-12-19T16:16:43.338228+0000', 'last_fullsized': '2023-12-19T16:16:43.338228+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:20:30.632732+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.340185+0000', 'last_change': '2023-12-19T16:16:43.340185+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.340185+0000', 'last_undegraded': '2023-12-19T16:16:43.340185+0000', 'last_fullsized': '2023-12-19T16:16:43.340185+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:16:48.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335197+0000', 'last_change': '2023-12-19T16:16:43.335197+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335197+0000', 'last_undegraded': '2023-12-19T16:16:43.335197+0000', 'last_fullsized': '2023-12-19T16:16:43.335197+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339777+0000', 'last_change': '2023-12-19T16:16:43.339777+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339777+0000', 'last_undegraded': '2023-12-19T16:16:43.339777+0000', 'last_fullsized': '2023-12-19T16:16:43.339777+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.347769+0000', 'last_change': '2023-12-19T16:16:43.347769+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.347769+0000', 'last_undegraded': '2023-12-19T16:16:43.347769+0000', 'last_fullsized': '2023-12-19T16:16:43.347769+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.336223+0000', 'last_change': '2023-12-19T16:16:43.336223+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.336223+0000', 'last_undegraded': '2023-12-19T16:16:43.336223+0000', 'last_fullsized': '2023-12-19T16:16:43.336223+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:19:00.102817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339775+0000', 'last_change': '2023-12-19T16:16:43.339775+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339775+0000', 'last_undegraded': '2023-12-19T16:16:43.339775+0000', 'last_fullsized': '2023-12-19T16:16:43.339775+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-12-19T16:16:48.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338229+0000', 'last_change': '2023-12-19T16:16:43.338229+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338229+0000', 'last_undegraded': '2023-12-19T16:16:43.338229+0000', 'last_fullsized': '2023-12-19T16:16:43.338229+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.340668+0000', 'last_change': '2023-12-19T16:16:43.340668+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.340668+0000', 'last_undegraded': '2023-12-19T16:16:43.340668+0000', 'last_fullsized': '2023-12-19T16:16:43.340668+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:21:51.570844+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.334767+0000', 'last_change': '2023-12-19T16:16:43.334767+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.334767+0000', 'last_undegraded': '2023-12-19T16:16:43.334767+0000', 'last_fullsized': '2023-12-19T16:16:43.334767+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339584+0000', 'last_change': '2023-12-19T16:16:43.339584+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339584+0000', 'last_undegraded': '2023-12-19T16:16:43.339584+0000', 'last_fullsized': '2023-12-19T16:16:43.339584+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:55:53.457991+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.340792+0000', 'last_change': '2023-12-19T16:16:43.340792+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.340792+0000', 'last_undegraded': '2023-12-19T16:16:43.340792+0000', 'last_fullsized': '2023-12-19T16:16:43.340792+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:42:56.016247+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.347279+0000', 'last_change': '2023-12-19T16:16:43.347279+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.347279+0000', 'last_undegraded': '2023-12-19T16:16:43.347279+0000', 'last_fullsized': '2023-12-19T16:16:43.347279+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-12-19T16:16:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.336623+0000', 'last_change': '2023-12-19T16:16:43.336623+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.336623+0000', 'last_undegraded': '2023-12-19T16:16:43.336623+0000', 'last_fullsized': '2023-12-19T16:16:43.336623+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:59:27.494042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.346171+0000', 'last_change': '2023-12-19T16:16:43.346171+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.346171+0000', 'last_undegraded': '2023-12-19T16:16:43.346171+0000', 'last_fullsized': '2023-12-19T16:16:43.346171+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339356+0000', 'last_change': '2023-12-19T16:16:43.339356+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339356+0000', 'last_undegraded': '2023-12-19T16:16:43.339356+0000', 'last_fullsized': '2023-12-19T16:16:43.339356+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.341524+0000', 'last_change': '2023-12-19T16:16:43.341524+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.341524+0000', 'last_undegraded': '2023-12-19T16:16:43.341524+0000', 'last_fullsized': '2023-12-19T16:16:43.341524+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338567+0000', 'last_change': '2023-12-19T16:16:43.338567+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338567+0000', 'last_undegraded': '2023-12-19T16:16:43.338567+0000', 'last_fullsized': '2023-12-19T16:16:43.338567+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:12:42.986335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337686+0000', 'last_change': '2023-12-19T16:16:43.337686+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337686+0000', 'last_undegraded': '2023-12-19T16:16:43.337686+0000', 'last_fullsized': '2023-12-19T16:16:43.337686+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.333774+0000', 'last_change': '2023-12-19T16:16:43.333774+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.333774+0000', 'last_undegraded': '2023-12-19T16:16:43.333774+0000', 'last_fullsized': '2023-12-19T16:16:43.333774+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339230+0000', 'last_change': '2023-12-19T16:16:43.339230+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339230+0000', 'last_undegraded': '2023-12-19T16:16:43.339230+0000', 'last_fullsized': '2023-12-19T16:16:43.339230+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.339397+0000', 'last_change': '2023-12-19T16:16:43.339397+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.339397+0000', 'last_undegraded': '2023-12-19T16:16:43.339397+0000', 'last_fullsized': '2023-12-19T16:16:43.339397+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:59:04.059004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335055+0000', 'last_change': '2023-12-19T16:16:43.335055+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335055+0000', 'last_undegraded': '2023-12-19T16:16:43.335055+0000', 'last_fullsized': '2023-12-19T16:16:43.335055+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:19:23.594948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.347181+0000', 'last_change': '2023-12-19T16:16:43.347181+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.347181+0000', 'last_undegraded': '2023-12-19T16:16:43.347181+0000', 'last_fullsized': '2023-12-19T16:16:43.347181+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:22:41.285289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.342135+0000', 'last_change': '2023-12-19T16:16:43.342135+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.342135+0000', 'last_undegraded': '2023-12-19T16:16:43.342135+0000', 'last_fullsized': '2023-12-19T16:16:43.342135+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:40:33.717463+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.343896+0000', 'last_change': '2023-12-19T16:16:43.343896+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.343896+0000', 'last_undegraded': '2023-12-19T16:16:43.343896+0000', 'last_fullsized': '2023-12-19T16:16:43.343896+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337262+0000', 'last_change': '2023-12-19T16:16:43.337262+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337262+0000', 'last_undegraded': '2023-12-19T16:16:43.337262+0000', 'last_fullsized': '2023-12-19T16:16:43.337262+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337025+0000', 'last_change': '2023-12-19T16:16:43.337025+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337025+0000', 'last_undegraded': '2023-12-19T16:16:43.337025+0000', 'last_fullsized': '2023-12-19T16:16:43.337025+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:50:09.818826+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.349392+0000', 'last_change': '2023-12-19T16:16:43.349392+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.349392+0000', 'last_undegraded': '2023-12-19T16:16:43.349392+0000', 'last_fullsized': '2023-12-19T16:16:43.349392+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:49:57.366648+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338944+0000', 'last_change': '2023-12-19T16:16:43.338944+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338944+0000', 'last_undegraded': '2023-12-19T16:16:43.338944+0000', 'last_fullsized': '2023-12-19T16:16:43.338944+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:25:50.011355+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-12-19T16:16:48.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337472+0000', 'last_change': '2023-12-19T16:16:43.337472+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337472+0000', 'last_undegraded': '2023-12-19T16:16:43.337472+0000', 'last_fullsized': '2023-12-19T16:16:43.337472+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:44:38.947784+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.333995+0000', 'last_change': '2023-12-19T16:16:43.333995+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.333995+0000', 'last_undegraded': '2023-12-19T16:16:43.333995+0000', 'last_fullsized': '2023-12-19T16:16:43.333995+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.342077+0000', 'last_change': '2023-12-19T16:16:43.342077+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.342077+0000', 'last_undegraded': '2023-12-19T16:16:43.342077+0000', 'last_fullsized': '2023-12-19T16:16:43.342077+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.334915+0000', 'last_change': '2023-12-19T16:16:43.334915+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.334915+0000', 'last_undegraded': '2023-12-19T16:16:43.334915+0000', 'last_fullsized': '2023-12-19T16:16:43.334915+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:24:18.596989+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.348260+0000', 'last_change': '2023-12-19T16:16:43.348260+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.348260+0000', 'last_undegraded': '2023-12-19T16:16:43.348260+0000', 'last_fullsized': '2023-12-19T16:16:43.348260+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:07:17.730523+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.335519+0000', 'last_change': '2023-12-19T16:16:43.335519+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.335519+0000', 'last_undegraded': '2023-12-19T16:16:43.335519+0000', 'last_fullsized': '2023-12-19T16:16:43.335519+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.334176+0000', 'last_change': '2023-12-19T16:16:43.334176+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.334176+0000', 'last_undegraded': '2023-12-19T16:16:43.334176+0000', 'last_fullsized': '2023-12-19T16:16:43.334176+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:06:43.321414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.338447+0000', 'last_change': '2023-12-19T16:16:43.338447+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.338447+0000', 'last_undegraded': '2023-12-19T16:16:43.338447+0000', 'last_fullsized': '2023-12-19T16:16:43.338447+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:04:18.438411+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337703+0000', 'last_change': '2023-12-19T16:16:43.337703+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337703+0000', 'last_undegraded': '2023-12-19T16:16:43.337703+0000', 'last_fullsized': '2023-12-19T16:16:43.337703+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.346713+0000', 'last_change': '2023-12-19T16:16:43.346713+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.346713+0000', 'last_undegraded': '2023-12-19T16:16:43.346713+0000', 'last_fullsized': '2023-12-19T16:16:43.346713+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:52:23.511527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.337054+0000', 'last_change': '2023-12-19T16:16:43.337054+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.337054+0000', 'last_undegraded': '2023-12-19T16:16:43.337054+0000', 'last_fullsized': '2023-12-19T16:16:43.337054+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T04:06:54.423721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.336758+0000', 'last_change': '2023-12-19T16:16:43.336758+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.336758+0000', 'last_undegraded': '2023-12-19T16:16:43.336758+0000', 'last_fullsized': '2023-12-19T16:16:43.336758+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:16:48.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.336956+0000', 'last_change': '2023-12-19T16:16:43.336956+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.336956+0000', 'last_undegraded': '2023-12-19T16:16:43.336956+0000', 'last_fullsized': '2023-12-19T16:16:43.336956+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.340344+0000', 'last_change': '2023-12-19T16:16:43.340344+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.340344+0000', 'last_undegraded': '2023-12-19T16:16:43.340344+0000', 'last_fullsized': '2023-12-19T16:16:43.340344+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.345062+0000', 'last_change': '2023-12-19T16:16:43.345062+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.345062+0000', 'last_undegraded': '2023-12-19T16:16:43.345062+0000', 'last_fullsized': '2023-12-19T16:16:43.345062+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:17:44.359529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-12-19T16:16:48.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:16:43.334304+0000', 'last_change': '2023-12-19T16:16:43.334304+0000', 'last_active': '2023-12-19T16:16:43.318998+0000', 'last_peered': '2023-12-19T16:16:43.318998+0000', 'last_clean': '2023-12-19T16:16:43.318998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:16:43.334304+0000', 'last_undegraded': '2023-12-19T16:16:43.334304+0000', 'last_fullsized': '2023-12-19T16:16:43.334304+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'last_clean_scrub_stamp': '2023-12-19T16:16:43.318998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:16:48.548 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T16:16:48.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 Processor -- start 2023-12-19T16:16:48.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 -- start start 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17741570c0 0x7f177406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17740ca000 0x7f1774070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17740c9460 con 0x7f177406c320 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177406c7a0 con 0x7f17740ca000 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f177b17b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17741574a0 con 0x7f17741570c0 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17740ca000 0x7f1774070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17740ca000 0x7f1774070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45428/0 (socket says 172.21.15.119:45428) 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 -- 172.21.15.119:0/1956040677 learned_addr learned my addr 172.21.15.119:0/1956040677 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:48.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1778f17640 1 --2- 172.21.15.119:0/1956040677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17741570c0 0x7f177406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 -- 172.21.15.119:0/1956040677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17741570c0 msgr2=0x7f177406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:48.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 --2- 172.21.15.119:0/1956040677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17741570c0 0x7f177406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 -- 172.21.15.119:0/1956040677 >> v1:172.21.15.119:6789/0 conn(0x7f177406c320 legacy=0x7f17740c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.737+0000 7f1779718640 1 -- 172.21.15.119:0/1956040677 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740c8b30 con 0x7f17740ca000 2023-12-19T16:16:48.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f1779718640 1 --2- 172.21.15.119:0/1956040677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740ca000 0x7f1774070df0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d150 tx=0x7f176c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493cbb56bf6cbc39 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:48.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f176b7fe640 1 -- 172.21.15.119:0/1956040677 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c00b2d0 con 0x7f17740ca000 2023-12-19T16:16:48.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f176b7fe640 1 -- 172.21.15.119:0/1956040677 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c00b430 con 0x7f17740ca000 2023-12-19T16:16:48.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f176b7fe640 1 -- 172.21.15.119:0/1956040677 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0a7c40 con 0x7f17740ca000 2023-12-19T16:16:48.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 -- 172.21.15.119:0/1956040677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740ca000 msgr2=0x7f1774070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 --2- 172.21.15.119:0/1956040677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740ca000 0x7f1774070df0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d150 tx=0x7f176c01eb50 comp rx=0 tx=0).stop 2023-12-19T16:16:48.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 -- 172.21.15.119:0/1956040677 shutdown_connections 2023-12-19T16:16:48.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 --2- 172.21.15.119:0/1956040677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740ca000 0x7f1774070df0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 --2- 172.21.15.119:0/1956040677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17741570c0 0x7f177406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 -- 172.21.15.119:0/1956040677 >> 172.21.15.119:0/1956040677 conn(0x7f177406a3e0 msgr2=0x7f17740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:48.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 -- 172.21.15.119:0/1956040677 shutdown_connections 2023-12-19T16:16:48.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.741+0000 7f177b17b640 1 -- 172.21.15.119:0/1956040677 wait complete. 2023-12-19T16:16:48.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 Processor -- start 2023-12-19T16:16:48.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- start start 2023-12-19T16:16:48.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 0x7f17740ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17740ca000 0x7f17740c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17741570c0 0x7f17741551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740cc4c0 con 0x7f177406c320 2023-12-19T16:16:48.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1774155bc0 con 0x7f17741570c0 2023-12-19T16:16:48.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1774155ea0 con 0x7f17740ca000 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 0x7f17740ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 0x7f17740ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45432/0 (socket says 172.21.15.119:45432) 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 -- 172.21.15.119:0/4060203532 learned_addr learned my addr 172.21.15.119:0/4060203532 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 -- 172.21.15.119:0/4060203532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17740ca000 msgr2=0x7f17740c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17740ca000 0x7f17740c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 -- 172.21.15.119:0/4060203532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17741570c0 msgr2=0x7f17741551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17741570c0 0x7f17741551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 -- 172.21.15.119:0/4060203532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c00bd40 con 0x7f177406c320 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f1778f17640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 0x7f17740ccf10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f177000e930 tx=0x7f177000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000ca00 con 0x7f177406c320 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177000cb60 con 0x7f177406c320 2023-12-19T16:16:48.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17740cc710 con 0x7f177406c320 2023-12-19T16:16:48.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770013470 con 0x7f177406c320 2023-12-19T16:16:48.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17740cd450 con 0x7f177406c320 2023-12-19T16:16:48.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.745+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17740735b0 con 0x7f177406c320 2023-12-19T16:16:48.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.749+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f17700135d0 con 0x7f177406c320 2023-12-19T16:16:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.749+0000 7f17697fa640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1760065a60 0x7f1760067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.749+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1770083590 con 0x7f177406c320 2023-12-19T16:16:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.749+0000 7f176bfff640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1760065a60 0x7f1760067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.749+0000 7f176bfff640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1760065a60 0x7f1760067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1764000f70 tx=0x7f17640079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.753+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1770050ec0 con 0x7f177406c320 2023-12-19T16:16:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.957+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f177404e000 con 0x7f177406c320 2023-12-19T16:16:48.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.957+0000 7f17697fa640 1 -- 172.21.15.119:0/4060203532 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7f17700544e0 con 0x7f177406c320 2023-12-19T16:16:48.965 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:48.965 INFO:teuthology.orchestra.run.smithi119.stdout:{"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1703002507,"num_in_osds":8,"osd_in_since":1703002497,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225312768,"bytes_avail":772868800512,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5490}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-19T16:16:26.462659+0000","services":{}},"progress_events":{}} 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1760065a60 msgr2=0x7f1760067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1760065a60 0x7f1760067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1764000f70 tx=0x7f17640079c0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 msgr2=0x7f17740ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 0x7f17740ccf10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f177000e930 tx=0x7f177000edf0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 shutdown_connections 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1760065a60 0x7f1760067f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17741570c0 0x7f17741551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17740ca000 0x7f17740c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 --2- 172.21.15.119:0/4060203532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f177406c320 0x7f17740ccf10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 >> 172.21.15.119:0/4060203532 conn(0x7f177406a3e0 msgr2=0x7f17741595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:48.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 shutdown_connections 2023-12-19T16:16:48.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:48.961+0000 7f177b17b640 1 -- 172.21.15.119:0/4060203532 wait complete. 2023-12-19T16:16:48.987 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T16:16:48.987 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:49.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 Processor -- start 2023-12-19T16:16:49.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 -- start start 2023-12-19T16:16:49.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e3c06c4f0 0x7f2e3c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:49.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c0c9e30 0x7f2e3c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:49.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c0c9460 con 0x7f2e3c1570c0 2023-12-19T16:16:49.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c1574a0 con 0x7f2e3c06c4f0 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e41412640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0c8b30 con 0x7f2e3c0c9e30 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e327fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e3c06c4f0 0x7f2e3c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e327fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e3c06c4f0 0x7f2e3c0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45434/0 (socket says 172.21.15.119:45434) 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.121+0000 7f2e327fc640 1 -- 172.21.15.119:0/755638656 learned_addr learned my addr 172.21.15.119:0/755638656 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e3b7fe640 1 --2- 172.21.15.119:0/755638656 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c0c9e30 0x7f2e3c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e327fc640 1 -- 172.21.15.119:0/755638656 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c0c9e30 msgr2=0x7f2e3c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e327fc640 1 --2- 172.21.15.119:0/755638656 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c0c9e30 0x7f2e3c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e327fc640 1 -- 172.21.15.119:0/755638656 >> v1:172.21.15.143:6789/0 conn(0x7f2e3c1570c0 legacy=0x7f2e3c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e327fc640 1 -- 172.21.15.119:0/755638656 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0c8e10 con 0x7f2e3c06c4f0 2023-12-19T16:16:49.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e327fc640 1 --2- 172.21.15.119:0/755638656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c98f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009e50 tx=0x7f2e2401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd40243287131d69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:49.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e3a7fc640 1 -- 172.21.15.119:0/755638656 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240a5720 con 0x7f2e3c06c4f0 2023-12-19T16:16:49.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e3a7fc640 1 -- 172.21.15.119:0/755638656 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e240a5880 con 0x7f2e3c06c4f0 2023-12-19T16:16:49.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e3a7fc640 1 -- 172.21.15.119:0/755638656 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240a5c10 con 0x7f2e3c06c4f0 2023-12-19T16:16:49.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 -- 172.21.15.119:0/755638656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c06c4f0 msgr2=0x7f2e3c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:49.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 --2- 172.21.15.119:0/755638656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c98f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009e50 tx=0x7f2e2401c950 comp rx=0 tx=0).stop 2023-12-19T16:16:49.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 -- 172.21.15.119:0/755638656 shutdown_connections 2023-12-19T16:16:49.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 --2- 172.21.15.119:0/755638656 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c0c9e30 0x7f2e3c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 --2- 172.21.15.119:0/755638656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c98f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 -- 172.21.15.119:0/755638656 >> 172.21.15.119:0/755638656 conn(0x7f2e3c06a3e0 msgr2=0x7f2e3c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:49.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.125+0000 7f2e41412640 1 -- 172.21.15.119:0/755638656 shutdown_connections 2023-12-19T16:16:49.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 -- 172.21.15.119:0/755638656 wait complete. 2023-12-19T16:16:49.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 Processor -- start 2023-12-19T16:16:49.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 -- start start 2023-12-19T16:16:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e3c0c9e30 0x7f2e3c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 0x7f2e3c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0c2f30 con 0x7f2e3c1570c0 2023-12-19T16:16:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0c2320 con 0x7f2e3c0c9e30 2023-12-19T16:16:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e41412640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0c2600 con 0x7f2e3c06c4f0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 0x7f2e3c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 0x7f2e3c14cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45446/0 (socket says 172.21.15.119:45446) 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 -- 172.21.15.119:0/1280479970 learned_addr learned my addr 172.21.15.119:0/1280479970 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3affd640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e327fc640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e3c0c9e30 0x7f2e3c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 -- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c06c4f0 msgr2=0x7f2e3c0c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 -- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e3c0c9e30 msgr2=0x7f2e3c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e3c0c9e30 0x7f2e3c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 -- 172.21.15.119:0/1280479970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009b30 con 0x7f2e3c1570c0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3affd640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e3b7fe640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 0x7f2e3c14cf70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d560 tx=0x7f2e3400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.129+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340125f0 con 0x7f2e3c1570c0 2023-12-19T16:16:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34012770 con 0x7f2e3c1570c0 2023-12-19T16:16:49.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c0c28e0 con 0x7f2e3c1570c0 2023-12-19T16:16:49.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34012b20 con 0x7f2e3c1570c0 2023-12-19T16:16:49.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c0c3900 con 0x7f2e3c1570c0 2023-12-19T16:16:49.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c0735b0 con 0x7f2e3c1570c0 2023-12-19T16:16:49.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e34012c80 con 0x7f2e3c1570c0 2023-12-19T16:16:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e33fff640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2e1c065a60 0x7f2e1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e34083700 con 0x7f2e3c1570c0 2023-12-19T16:16:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e3affd640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2e1c065a60 0x7f2e1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.133+0000 7f2e3affd640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2e1c065a60 0x7f2e1c067f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c000f70 tx=0x7f2e2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:49.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.137+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2e34050f80 con 0x7f2e3c1570c0 2023-12-19T16:16:49.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.285+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e3c04e000 con 0x7f2e1c065a60 2023-12-19T16:16:49.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.293+0000 7f2e33fff640 1 -- 172.21.15.119:0/1280479970 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286117 (secure 0 0 0) 0x7f2e3c04e000 con 0x7f2e1c065a60 2023-12-19T16:16:49.300 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:49.302 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:16:49.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.293+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2e1c065a60 msgr2=0x7f2e1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.293+0000 7f2e41412640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2e1c065a60 0x7f2e1c067f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c000f70 tx=0x7f2e2c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.293+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 msgr2=0x7f2e3c14cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.293+0000 7f2e41412640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 0x7f2e3c14cf70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d560 tx=0x7f2e3400da20 comp rx=0 tx=0).stop 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 shutdown_connections 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2e1c065a60 0x7f2e1c067f20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e3c0c9e30 0x7f2e3c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e3c1570c0 0x7f2e3c14cf70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 --2- 172.21.15.119:0/1280479970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e3c06c4f0 0x7f2e3c0c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 >> 172.21.15.119:0/1280479970 conn(0x7f2e3c06a3e0 msgr2=0x7f2e3c1578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 shutdown_connections 2023-12-19T16:16:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:49.297+0000 7f2e41412640 1 -- 172.21.15.119:0/1280479970 wait complete. 2023-12-19T16:16:49.320 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-12-19T16:16:48.466646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220032,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754688,"statfs":{"total":773094113280,"available":772868800512,"internally_reserved":0,"allocated":4521984,"data_stored":2588614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000948"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338118+0000","last_change":"2023-12-19T16:16:43.338118+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338118+0000","last_undegraded":"2023-12-19T16:16:43.338118+0000","last_fullsized":"2023-12-19T16:16:43.338118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.457430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337559+0000","last_change":"2023-12-19T16:16:43.337559+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337559+0000","last_undegraded":"2023-12-19T16:16:43.337559+0000","last_fullsized":"2023-12-19T16:16:43.337559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339257+0000","last_change":"2023-12-19T16:16:43.339257+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339257+0000","last_undegraded":"2023-12-19T16:16:43.339257+0000","last_fullsized":"2023-12-19T16:16:43.339257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335769+0000","last_change":"2023-12-19T16:16:43.335769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335769+0000","last_undegraded":"2023-12-19T16:16:43.335769+0000","last_fullsized":"2023-12-19T16:16:43.335769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:47.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335614+0000","last_change":"2023-12-19T16:16:43.335614+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335614+0000","last_undegraded":"2023-12-19T16:16:43.335614+0000","last_fullsized":"2023-12-19T16:16:43.335614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:25.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338026+0000","last_change":"2023-12-19T16:16:43.338026+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338026+0000","last_undegraded":"2023-12-19T16:16:43.338026+0000","last_fullsized":"2023-12-19T16:16:43.338026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335944+0000","last_change":"2023-12-19T16:16:43.335944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335944+0000","last_undegraded":"2023-12-19T16:16:43.335944+0000","last_fullsized":"2023-12-19T16:16:43.335944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:59:06.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337835+0000","last_change":"2023-12-19T16:16:43.337835+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337835+0000","last_undegraded":"2023-12-19T16:16:43.337835+0000","last_fullsized":"2023-12-19T16:16:43.337835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:44.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341168+0000","last_change":"2023-12-19T16:16:43.341168+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341168+0000","last_undegraded":"2023-12-19T16:16:43.341168+0000","last_fullsized":"2023-12-19T16:16:43.341168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336369+0000","last_change":"2023-12-19T16:16:43.336369+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336369+0000","last_undegraded":"2023-12-19T16:16:43.336369+0000","last_fullsized":"2023-12-19T16:16:43.336369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335006+0000","last_change":"2023-12-19T16:16:43.335006+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335006+0000","last_undegraded":"2023-12-19T16:16:43.335006+0000","last_fullsized":"2023-12-19T16:16:43.335006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:28.808811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338899+0000","last_change":"2023-12-19T16:16:43.338899+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338899+0000","last_undegraded":"2023-12-19T16:16:43.338899+0000","last_fullsized":"2023-12-19T16:16:43.338899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:17:05.566170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335735+0000","last_change":"2023-12-19T16:16:43.335735+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335735+0000","last_undegraded":"2023-12-19T16:16:43.335735+0000","last_fullsized":"2023-12-19T16:16:43.335735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:15.147537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340837+0000","last_change":"2023-12-19T16:16:43.340837+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340837+0000","last_undegraded":"2023-12-19T16:16:43.340837+0000","last_fullsized":"2023-12-19T16:16:43.340837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335395+0000","last_change":"2023-12-19T16:16:43.335395+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335395+0000","last_undegraded":"2023-12-19T16:16:43.335395+0000","last_fullsized":"2023-12-19T16:16:43.335395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348688+0000","last_change":"2023-12-19T16:16:43.348688+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348688+0000","last_undegraded":"2023-12-19T16:16:43.348688+0000","last_fullsized":"2023-12-19T16:16:43.348688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:59.870736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.350099+0000","last_change":"2023-12-19T16:16:43.350099+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.350099+0000","last_undegraded":"2023-12-19T16:16:43.350099+0000","last_fullsized":"2023-12-19T16:16:43.350099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338925+0000","last_change":"2023-12-19T16:16:43.338925+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338925+0000","last_undegraded":"2023-12-19T16:16:43.338925+0000","last_fullsized":"2023-12-19T16:16:43.338925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338228+0000","last_change":"2023-12-19T16:16:43.338228+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338228+0000","last_undegraded":"2023-12-19T16:16:43.338228+0000","last_fullsized":"2023-12-19T16:16:43.338228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:30.632732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340185+0000","last_change":"2023-12-19T16:16:43.340185+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340185+0000","last_undegraded":"2023-12-19T16:16:43.340185+0000","last_fullsized":"2023-12-19T16:16:43.340185+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335197+0000","last_change":"2023-12-19T16:16:43.335197+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335197+0000","last_undegraded":"2023-12-19T16:16:43.335197+0000","last_fullsized":"2023-12-19T16:16:43.335197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339777+0000","last_change":"2023-12-19T16:16:43.339777+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339777+0000","last_undegraded":"2023-12-19T16:16:43.339777+0000","last_fullsized":"2023-12-19T16:16:43.339777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347769+0000","last_change":"2023-12-19T16:16:43.347769+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347769+0000","last_undegraded":"2023-12-19T16:16:43.347769+0000","last_fullsized":"2023-12-19T16:16:43.347769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336223+0000","last_change":"2023-12-19T16:16:43.336223+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336223+0000","last_undegraded":"2023-12-19T16:16:43.336223+0000","last_fullsized":"2023-12-19T16:16:43.336223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:00.102817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339775+0000","last_change":"2023-12-19T16:16:43.339775+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339775+0000","last_undegraded":"2023-12-19T16:16:43.339775+0000","last_fullsized":"2023-12-19T16:16:43.339775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338229+0000","last_change":"2023-12-19T16:16:43.338229+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338229+0000","last_undegraded":"2023-12-19T16:16:43.338229+0000","last_fullsized":"2023-12-19T16:16:43.338229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340668+0000","last_change":"2023-12-19T16:16:43.340668+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340668+0000","last_undegraded":"2023-12-19T16:16:43.340668+0000","last_fullsized":"2023-12-19T16:16:43.340668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:51.570844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334767+0000","last_change":"2023-12-19T16:16:43.334767+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334767+0000","last_undegraded":"2023-12-19T16:16:43.334767+0000","last_fullsized":"2023-12-19T16:16:43.334767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339584+0000","last_change":"2023-12-19T16:16:43.339584+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339584+0000","last_undegraded":"2023-12-19T16:16:43.339584+0000","last_fullsized":"2023-12-19T16:16:43.339584+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:53.457991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340792+0000","last_change":"2023-12-19T16:16:43.340792+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340792+0000","last_undegraded":"2023-12-19T16:16:43.340792+0000","last_fullsized":"2023-12-19T16:16:43.340792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:56.016247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347279+0000","last_change":"2023-12-19T16:16:43.347279+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347279+0000","last_undegraded":"2023-12-19T16:16:43.347279+0000","last_fullsized":"2023-12-19T16:16:43.347279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336623+0000","last_change":"2023-12-19T16:16:43.336623+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336623+0000","last_undegraded":"2023-12-19T16:16:43.336623+0000","last_fullsized":"2023-12-19T16:16:43.336623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:59:27.494042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346171+0000","last_change":"2023-12-19T16:16:43.346171+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346171+0000","last_undegraded":"2023-12-19T16:16:43.346171+0000","last_fullsized":"2023-12-19T16:16:43.346171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359067+0000","last_change":"2023-12-19T16:16:43.353262+0000","last_active":"2023-12-19T16:16:43.359067+0000","last_peered":"2023-12-19T16:16:43.359067+0000","last_clean":"2023-12-19T16:16:43.359067+0000","last_became_active":"2023-12-19T16:16:43.352978+0000","last_became_peered":"2023-12-19T16:16:43.352978+0000","last_unstale":"2023-12-19T16:16:43.359067+0000","last_undegraded":"2023-12-19T16:16:43.359067+0000","last_fullsized":"2023-12-19T16:16:43.359067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339356+0000","last_change":"2023-12-19T16:16:43.339356+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339356+0000","last_undegraded":"2023-12-19T16:16:43.339356+0000","last_fullsized":"2023-12-19T16:16:43.339356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359660+0000","last_change":"2023-12-19T16:16:43.356368+0000","last_active":"2023-12-19T16:16:43.359660+0000","last_peered":"2023-12-19T16:16:43.359660+0000","last_clean":"2023-12-19T16:16:43.359660+0000","last_became_active":"2023-12-19T16:16:43.355995+0000","last_became_peered":"2023-12-19T16:16:43.355995+0000","last_unstale":"2023-12-19T16:16:43.359660+0000","last_undegraded":"2023-12-19T16:16:43.359660+0000","last_fullsized":"2023-12-19T16:16:43.359660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.341524+0000","last_change":"2023-12-19T16:16:43.341524+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.341524+0000","last_undegraded":"2023-12-19T16:16:43.341524+0000","last_fullsized":"2023-12-19T16:16:43.341524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.357381+0000","last_change":"2023-12-19T16:16:43.354704+0000","last_active":"2023-12-19T16:16:43.357381+0000","last_peered":"2023-12-19T16:16:43.357381+0000","last_clean":"2023-12-19T16:16:43.357381+0000","last_became_active":"2023-12-19T16:16:43.354443+0000","last_became_peered":"2023-12-19T16:16:43.354443+0000","last_unstale":"2023-12-19T16:16:43.357381+0000","last_undegraded":"2023-12-19T16:16:43.357381+0000","last_fullsized":"2023-12-19T16:16:43.357381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338567+0000","last_change":"2023-12-19T16:16:43.338567+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338567+0000","last_undegraded":"2023-12-19T16:16:43.338567+0000","last_fullsized":"2023-12-19T16:16:43.338567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:42.986335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359349+0000","last_change":"2023-12-19T16:16:43.352896+0000","last_active":"2023-12-19T16:16:43.359349+0000","last_peered":"2023-12-19T16:16:43.359349+0000","last_clean":"2023-12-19T16:16:43.359349+0000","last_became_active":"2023-12-19T16:16:43.352492+0000","last_became_peered":"2023-12-19T16:16:43.352492+0000","last_unstale":"2023-12-19T16:16:43.359349+0000","last_undegraded":"2023-12-19T16:16:43.359349+0000","last_fullsized":"2023-12-19T16:16:43.359349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337686+0000","last_change":"2023-12-19T16:16:43.337686+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337686+0000","last_undegraded":"2023-12-19T16:16:43.337686+0000","last_fullsized":"2023-12-19T16:16:43.337686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358862+0000","last_change":"2023-12-19T16:16:43.354651+0000","last_active":"2023-12-19T16:16:43.358862+0000","last_peered":"2023-12-19T16:16:43.358862+0000","last_clean":"2023-12-19T16:16:43.358862+0000","last_became_active":"2023-12-19T16:16:43.354392+0000","last_became_peered":"2023-12-19T16:16:43.354392+0000","last_unstale":"2023-12-19T16:16:43.358862+0000","last_undegraded":"2023-12-19T16:16:43.358862+0000","last_fullsized":"2023-12-19T16:16:43.358862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.500035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333774+0000","last_change":"2023-12-19T16:16:43.333774+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333774+0000","last_undegraded":"2023-12-19T16:16:43.333774+0000","last_fullsized":"2023-12-19T16:16:43.333774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361527+0000","last_change":"2023-12-19T16:16:43.359797+0000","last_active":"2023-12-19T16:16:43.361527+0000","last_peered":"2023-12-19T16:16:43.361527+0000","last_clean":"2023-12-19T16:16:43.361527+0000","last_became_active":"2023-12-19T16:16:43.359535+0000","last_became_peered":"2023-12-19T16:16:43.359535+0000","last_unstale":"2023-12-19T16:16:43.361527+0000","last_undegraded":"2023-12-19T16:16:43.361527+0000","last_fullsized":"2023-12-19T16:16:43.361527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339230+0000","last_change":"2023-12-19T16:16:43.339230+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339230+0000","last_undegraded":"2023-12-19T16:16:43.339230+0000","last_fullsized":"2023-12-19T16:16:43.339230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355477+0000","last_change":"2023-12-19T16:16:43.350869+0000","last_active":"2023-12-19T16:16:43.355477+0000","last_peered":"2023-12-19T16:16:43.355477+0000","last_clean":"2023-12-19T16:16:43.355477+0000","last_became_active":"2023-12-19T16:16:43.350591+0000","last_became_peered":"2023-12-19T16:16:43.350591+0000","last_unstale":"2023-12-19T16:16:43.355477+0000","last_undegraded":"2023-12-19T16:16:43.355477+0000","last_fullsized":"2023-12-19T16:16:43.355477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.339397+0000","last_change":"2023-12-19T16:16:43.339397+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.339397+0000","last_undegraded":"2023-12-19T16:16:43.339397+0000","last_fullsized":"2023-12-19T16:16:43.339397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:04.059004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359272+0000","last_change":"2023-12-19T16:16:43.351126+0000","last_active":"2023-12-19T16:16:43.359272+0000","last_peered":"2023-12-19T16:16:43.359272+0000","last_clean":"2023-12-19T16:16:43.359272+0000","last_became_active":"2023-12-19T16:16:43.350844+0000","last_became_peered":"2023-12-19T16:16:43.350844+0000","last_unstale":"2023-12-19T16:16:43.359272+0000","last_undegraded":"2023-12-19T16:16:43.359272+0000","last_fullsized":"2023-12-19T16:16:43.359272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335055+0000","last_change":"2023-12-19T16:16:43.335055+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335055+0000","last_undegraded":"2023-12-19T16:16:43.335055+0000","last_fullsized":"2023-12-19T16:16:43.335055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:23.594948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353568+0000","last_change":"2023-12-19T16:16:43.348887+0000","last_active":"2023-12-19T16:16:43.353568+0000","last_peered":"2023-12-19T16:16:43.353568+0000","last_clean":"2023-12-19T16:16:43.353568+0000","last_became_active":"2023-12-19T16:16:43.348607+0000","last_became_peered":"2023-12-19T16:16:43.348607+0000","last_unstale":"2023-12-19T16:16:43.353568+0000","last_undegraded":"2023-12-19T16:16:43.353568+0000","last_fullsized":"2023-12-19T16:16:43.353568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:32.705972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.347181+0000","last_change":"2023-12-19T16:16:43.347181+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.347181+0000","last_undegraded":"2023-12-19T16:16:43.347181+0000","last_fullsized":"2023-12-19T16:16:43.347181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:41.285289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358700+0000","last_change":"2023-12-19T16:16:43.353196+0000","last_active":"2023-12-19T16:16:43.358700+0000","last_peered":"2023-12-19T16:16:43.358700+0000","last_clean":"2023-12-19T16:16:43.358700+0000","last_became_active":"2023-12-19T16:16:43.352913+0000","last_became_peered":"2023-12-19T16:16:43.352913+0000","last_unstale":"2023-12-19T16:16:43.358700+0000","last_undegraded":"2023-12-19T16:16:43.358700+0000","last_fullsized":"2023-12-19T16:16:43.358700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342135+0000","last_change":"2023-12-19T16:16:43.342135+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342135+0000","last_undegraded":"2023-12-19T16:16:43.342135+0000","last_fullsized":"2023-12-19T16:16:43.342135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:33.717463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356707+0000","last_change":"2023-12-19T16:16:43.349320+0000","last_active":"2023-12-19T16:16:43.356707+0000","last_peered":"2023-12-19T16:16:43.356707+0000","last_clean":"2023-12-19T16:16:43.356707+0000","last_became_active":"2023-12-19T16:16:43.348855+0000","last_became_peered":"2023-12-19T16:16:43.348855+0000","last_unstale":"2023-12-19T16:16:43.356707+0000","last_undegraded":"2023-12-19T16:16:43.356707+0000","last_fullsized":"2023-12-19T16:16:43.356707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.343896+0000","last_change":"2023-12-19T16:16:43.343896+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.343896+0000","last_undegraded":"2023-12-19T16:16:43.343896+0000","last_fullsized":"2023-12-19T16:16:43.343896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359701+0000","last_change":"2023-12-19T16:16:43.356135+0000","last_active":"2023-12-19T16:16:43.359701+0000","last_peered":"2023-12-19T16:16:43.359701+0000","last_clean":"2023-12-19T16:16:43.359701+0000","last_became_active":"2023-12-19T16:16:43.355836+0000","last_became_peered":"2023-12-19T16:16:43.355836+0000","last_unstale":"2023-12-19T16:16:43.359701+0000","last_undegraded":"2023-12-19T16:16:43.359701+0000","last_fullsized":"2023-12-19T16:16:43.359701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:22.459861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337262+0000","last_change":"2023-12-19T16:16:43.337262+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337262+0000","last_undegraded":"2023-12-19T16:16:43.337262+0000","last_fullsized":"2023-12-19T16:16:43.337262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.354176+0000","last_change":"2023-12-19T16:16:43.352367+0000","last_active":"2023-12-19T16:16:43.354176+0000","last_peered":"2023-12-19T16:16:43.354176+0000","last_clean":"2023-12-19T16:16:43.354176+0000","last_became_active":"2023-12-19T16:16:43.351864+0000","last_became_peered":"2023-12-19T16:16:43.351864+0000","last_unstale":"2023-12-19T16:16:43.354176+0000","last_undegraded":"2023-12-19T16:16:43.354176+0000","last_fullsized":"2023-12-19T16:16:43.354176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:08.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337025+0000","last_change":"2023-12-19T16:16:43.337025+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337025+0000","last_undegraded":"2023-12-19T16:16:43.337025+0000","last_fullsized":"2023-12-19T16:16:43.337025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:09.818826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355298+0000","last_change":"2023-12-19T16:16:43.351147+0000","last_active":"2023-12-19T16:16:43.355298+0000","last_peered":"2023-12-19T16:16:43.355298+0000","last_clean":"2023-12-19T16:16:43.355298+0000","last_became_active":"2023-12-19T16:16:43.350898+0000","last_became_peered":"2023-12-19T16:16:43.350898+0000","last_unstale":"2023-12-19T16:16:43.355298+0000","last_undegraded":"2023-12-19T16:16:43.355298+0000","last_fullsized":"2023-12-19T16:16:43.355298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.349392+0000","last_change":"2023-12-19T16:16:43.349392+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.349392+0000","last_undegraded":"2023-12-19T16:16:43.349392+0000","last_fullsized":"2023-12-19T16:16:43.349392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359130+0000","last_change":"2023-12-19T16:16:43.353579+0000","last_active":"2023-12-19T16:16:43.359130+0000","last_peered":"2023-12-19T16:16:43.359130+0000","last_clean":"2023-12-19T16:16:43.359130+0000","last_became_active":"2023-12-19T16:16:43.353312+0000","last_became_peered":"2023-12-19T16:16:43.353312+0000","last_unstale":"2023-12-19T16:16:43.359130+0000","last_undegraded":"2023-12-19T16:16:43.359130+0000","last_fullsized":"2023-12-19T16:16:43.359130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338944+0000","last_change":"2023-12-19T16:16:43.338944+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338944+0000","last_undegraded":"2023-12-19T16:16:43.338944+0000","last_fullsized":"2023-12-19T16:16:43.338944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:25:50.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361587+0000","last_change":"2023-12-19T16:16:43.360259+0000","last_active":"2023-12-19T16:16:43.361587+0000","last_peered":"2023-12-19T16:16:43.361587+0000","last_clean":"2023-12-19T16:16:43.361587+0000","last_became_active":"2023-12-19T16:16:43.359966+0000","last_became_peered":"2023-12-19T16:16:43.359966+0000","last_unstale":"2023-12-19T16:16:43.361587+0000","last_undegraded":"2023-12-19T16:16:43.361587+0000","last_fullsized":"2023-12-19T16:16:43.361587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337472+0000","last_change":"2023-12-19T16:16:43.337472+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337472+0000","last_undegraded":"2023-12-19T16:16:43.337472+0000","last_fullsized":"2023-12-19T16:16:43.337472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:38.947784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.358958+0000","last_change":"2023-12-19T16:16:43.355248+0000","last_active":"2023-12-19T16:16:43.358958+0000","last_peered":"2023-12-19T16:16:43.358958+0000","last_clean":"2023-12-19T16:16:43.358958+0000","last_became_active":"2023-12-19T16:16:43.353926+0000","last_became_peered":"2023-12-19T16:16:43.353926+0000","last_unstale":"2023-12-19T16:16:43.358958+0000","last_undegraded":"2023-12-19T16:16:43.358958+0000","last_fullsized":"2023-12-19T16:16:43.358958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.333995+0000","last_change":"2023-12-19T16:16:43.333995+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.333995+0000","last_undegraded":"2023-12-19T16:16:43.333995+0000","last_fullsized":"2023-12-19T16:16:43.333995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359426+0000","last_change":"2023-12-19T16:16:43.353818+0000","last_active":"2023-12-19T16:16:43.359426+0000","last_peered":"2023-12-19T16:16:43.359426+0000","last_clean":"2023-12-19T16:16:43.359426+0000","last_became_active":"2023-12-19T16:16:43.351904+0000","last_became_peered":"2023-12-19T16:16:43.351904+0000","last_unstale":"2023-12-19T16:16:43.359426+0000","last_undegraded":"2023-12-19T16:16:43.359426+0000","last_fullsized":"2023-12-19T16:16:43.359426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:15.707442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.342077+0000","last_change":"2023-12-19T16:16:43.342077+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.342077+0000","last_undegraded":"2023-12-19T16:16:43.342077+0000","last_fullsized":"2023-12-19T16:16:43.342077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359875+0000","last_change":"2023-12-19T16:16:43.357129+0000","last_active":"2023-12-19T16:16:43.359875+0000","last_peered":"2023-12-19T16:16:43.359875+0000","last_clean":"2023-12-19T16:16:43.359875+0000","last_became_active":"2023-12-19T16:16:43.356522+0000","last_became_peered":"2023-12-19T16:16:43.356522+0000","last_unstale":"2023-12-19T16:16:43.359875+0000","last_undegraded":"2023-12-19T16:16:43.359875+0000","last_fullsized":"2023-12-19T16:16:43.359875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:19.245588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334915+0000","last_change":"2023-12-19T16:16:43.334915+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334915+0000","last_undegraded":"2023-12-19T16:16:43.334915+0000","last_fullsized":"2023-12-19T16:16:43.334915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:18.596989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356906+0000","last_change":"2023-12-19T16:16:43.353520+0000","last_active":"2023-12-19T16:16:43.356906+0000","last_peered":"2023-12-19T16:16:43.356906+0000","last_clean":"2023-12-19T16:16:43.356906+0000","last_became_active":"2023-12-19T16:16:43.353269+0000","last_became_peered":"2023-12-19T16:16:43.353269+0000","last_unstale":"2023-12-19T16:16:43.356906+0000","last_undegraded":"2023-12-19T16:16:43.356906+0000","last_fullsized":"2023-12-19T16:16:43.356906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.348260+0000","last_change":"2023-12-19T16:16:43.348260+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.348260+0000","last_undegraded":"2023-12-19T16:16:43.348260+0000","last_fullsized":"2023-12-19T16:16:43.348260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.730523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352107+0000","last_change":"2023-12-19T16:16:43.346989+0000","last_active":"2023-12-19T16:16:43.352107+0000","last_peered":"2023-12-19T16:16:43.352107+0000","last_clean":"2023-12-19T16:16:43.352107+0000","last_became_active":"2023-12-19T16:16:43.346727+0000","last_became_peered":"2023-12-19T16:16:43.346727+0000","last_unstale":"2023-12-19T16:16:43.352107+0000","last_undegraded":"2023-12-19T16:16:43.352107+0000","last_fullsized":"2023-12-19T16:16:43.352107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:24.447700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.335519+0000","last_change":"2023-12-19T16:16:43.335519+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.335519+0000","last_undegraded":"2023-12-19T16:16:43.335519+0000","last_fullsized":"2023-12-19T16:16:43.335519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.352805+0000","last_change":"2023-12-19T16:16:43.350085+0000","last_active":"2023-12-19T16:16:43.352805+0000","last_peered":"2023-12-19T16:16:43.352805+0000","last_clean":"2023-12-19T16:16:43.352805+0000","last_became_active":"2023-12-19T16:16:43.349811+0000","last_became_peered":"2023-12-19T16:16:43.349811+0000","last_unstale":"2023-12-19T16:16:43.352805+0000","last_undegraded":"2023-12-19T16:16:43.352805+0000","last_fullsized":"2023-12-19T16:16:43.352805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:17.741131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334176+0000","last_change":"2023-12-19T16:16:43.334176+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334176+0000","last_undegraded":"2023-12-19T16:16:43.334176+0000","last_fullsized":"2023-12-19T16:16:43.334176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:43.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.361584+0000","last_change":"2023-12-19T16:16:43.360103+0000","last_active":"2023-12-19T16:16:43.361584+0000","last_peered":"2023-12-19T16:16:43.361584+0000","last_clean":"2023-12-19T16:16:43.361584+0000","last_became_active":"2023-12-19T16:16:43.359838+0000","last_became_peered":"2023-12-19T16:16:43.359838+0000","last_unstale":"2023-12-19T16:16:43.361584+0000","last_undegraded":"2023-12-19T16:16:43.361584+0000","last_fullsized":"2023-12-19T16:16:43.361584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:06.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.338447+0000","last_change":"2023-12-19T16:16:43.338447+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.338447+0000","last_undegraded":"2023-12-19T16:16:43.338447+0000","last_fullsized":"2023-12-19T16:16:43.338447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:04:18.438411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.350123+0000","last_change":"2023-12-19T16:16:43.345454+0000","last_active":"2023-12-19T16:16:43.350123+0000","last_peered":"2023-12-19T16:16:43.350123+0000","last_clean":"2023-12-19T16:16:43.350123+0000","last_became_active":"2023-12-19T16:16:43.344871+0000","last_became_peered":"2023-12-19T16:16:43.344871+0000","last_unstale":"2023-12-19T16:16:43.350123+0000","last_undegraded":"2023-12-19T16:16:43.350123+0000","last_fullsized":"2023-12-19T16:16:43.350123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:18:53.082616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337703+0000","last_change":"2023-12-19T16:16:43.337703+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337703+0000","last_undegraded":"2023-12-19T16:16:43.337703+0000","last_fullsized":"2023-12-19T16:16:43.337703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.356645+0000","last_change":"2023-12-19T16:16:43.348383+0000","last_active":"2023-12-19T16:16:43.356645+0000","last_peered":"2023-12-19T16:16:43.356645+0000","last_clean":"2023-12-19T16:16:43.356645+0000","last_became_active":"2023-12-19T16:16:43.348021+0000","last_became_peered":"2023-12-19T16:16:43.348021+0000","last_unstale":"2023-12-19T16:16:43.356645+0000","last_undegraded":"2023-12-19T16:16:43.356645+0000","last_fullsized":"2023-12-19T16:16:43.356645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.346713+0000","last_change":"2023-12-19T16:16:43.346713+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.346713+0000","last_undegraded":"2023-12-19T16:16:43.346713+0000","last_fullsized":"2023-12-19T16:16:43.346713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.511527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353054+0000","last_change":"2023-12-19T16:16:43.349882+0000","last_active":"2023-12-19T16:16:43.353054+0000","last_peered":"2023-12-19T16:16:43.353054+0000","last_clean":"2023-12-19T16:16:43.353054+0000","last_became_active":"2023-12-19T16:16:43.349600+0000","last_became_peered":"2023-12-19T16:16:43.349600+0000","last_unstale":"2023-12-19T16:16:43.353054+0000","last_undegraded":"2023-12-19T16:16:43.353054+0000","last_fullsized":"2023-12-19T16:16:43.353054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:43:50.507030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.337054+0000","last_change":"2023-12-19T16:16:43.337054+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.337054+0000","last_undegraded":"2023-12-19T16:16:43.337054+0000","last_fullsized":"2023-12-19T16:16:43.337054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:06:54.423721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353522+0000","last_change":"2023-12-19T16:16:43.348488+0000","last_active":"2023-12-19T16:16:43.353522+0000","last_peered":"2023-12-19T16:16:43.353522+0000","last_clean":"2023-12-19T16:16:43.353522+0000","last_became_active":"2023-12-19T16:16:43.348144+0000","last_became_peered":"2023-12-19T16:16:43.348144+0000","last_unstale":"2023-12-19T16:16:43.353522+0000","last_undegraded":"2023-12-19T16:16:43.353522+0000","last_fullsized":"2023-12-19T16:16:43.353522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336758+0000","last_change":"2023-12-19T16:16:43.336758+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336758+0000","last_undegraded":"2023-12-19T16:16:43.336758+0000","last_fullsized":"2023-12-19T16:16:43.336758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353530+0000","last_change":"2023-12-19T16:16:43.346209+0000","last_active":"2023-12-19T16:16:43.353530+0000","last_peered":"2023-12-19T16:16:43.353530+0000","last_clean":"2023-12-19T16:16:43.353530+0000","last_became_active":"2023-12-19T16:16:43.345183+0000","last_became_peered":"2023-12-19T16:16:43.345183+0000","last_unstale":"2023-12-19T16:16:43.353530+0000","last_undegraded":"2023-12-19T16:16:43.353530+0000","last_fullsized":"2023-12-19T16:16:43.353530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:52.446500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.336956+0000","last_change":"2023-12-19T16:16:43.336956+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.336956+0000","last_undegraded":"2023-12-19T16:16:43.336956+0000","last_fullsized":"2023-12-19T16:16:43.336956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.359157+0000","last_change":"2023-12-19T16:16:43.355011+0000","last_active":"2023-12-19T16:16:43.359157+0000","last_peered":"2023-12-19T16:16:43.359157+0000","last_clean":"2023-12-19T16:16:43.359157+0000","last_became_active":"2023-12-19T16:16:43.352649+0000","last_became_peered":"2023-12-19T16:16:43.352649+0000","last_unstale":"2023-12-19T16:16:43.359157+0000","last_undegraded":"2023-12-19T16:16:43.359157+0000","last_fullsized":"2023-12-19T16:16:43.359157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:17.585498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.340344+0000","last_change":"2023-12-19T16:16:43.340344+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.340344+0000","last_undegraded":"2023-12-19T16:16:43.340344+0000","last_fullsized":"2023-12-19T16:16:43.340344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.355857+0000","last_change":"2023-12-19T16:16:43.347544+0000","last_active":"2023-12-19T16:16:43.355857+0000","last_peered":"2023-12-19T16:16:43.355857+0000","last_clean":"2023-12-19T16:16:43.355857+0000","last_became_active":"2023-12-19T16:16:43.347259+0000","last_became_peered":"2023-12-19T16:16:43.347259+0000","last_unstale":"2023-12-19T16:16:43.355857+0000","last_undegraded":"2023-12-19T16:16:43.355857+0000","last_fullsized":"2023-12-19T16:16:43.355857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:56.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.345062+0000","last_change":"2023-12-19T16:16:43.345062+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.345062+0000","last_undegraded":"2023-12-19T16:16:43.345062+0000","last_fullsized":"2023-12-19T16:16:43.345062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:44.359529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.353827+0000","last_change":"2023-12-19T16:16:43.349535+0000","last_active":"2023-12-19T16:16:43.353827+0000","last_peered":"2023-12-19T16:16:43.353827+0000","last_clean":"2023-12-19T16:16:43.353827+0000","last_became_active":"2023-12-19T16:16:43.349097+0000","last_became_peered":"2023-12-19T16:16:43.349097+0000","last_unstale":"2023-12-19T16:16:43.353827+0000","last_undegraded":"2023-12-19T16:16:43.353827+0000","last_fullsized":"2023-12-19T16:16:43.353827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:35.320757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-19T16:16:43.334304+0000","last_change":"2023-12-19T16:16:43.334304+0000","last_active":"2023-12-19T16:16:43.318998+0000","last_peered":"2023-12-19T16:16:43.318998+0000","last_clean":"2023-12-19T16:16:43.318998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:16:43.334304+0000","last_undegraded":"2023-12-19T16:16:43.334304+0000","last_fullsized":"2023-12-19T16:16:43.334304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.360874+0000","last_change":"2023-12-19T16:16:43.358272+0000","last_active":"2023-12-19T16:16:43.360874+0000","last_peered":"2023-12-19T16:16:43.360874+0000","last_clean":"2023-12-19T16:16:43.360874+0000","last_became_active":"2023-12-19T16:16:43.358010+0000","last_became_peered":"2023-12-19T16:16:43.358010+0000","last_unstale":"2023-12-19T16:16:43.360874+0000","last_undegraded":"2023-12-19T16:16:43.360874+0000","last_fullsized":"2023-12-19T16:16:43.360874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:28.970063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:42.328795+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:16:42.328795+0000","last_peered":"2023-12-19T16:16:42.328795+0000","last_clean":"2023-12-19T16:16:42.328795+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:16:42.328795+0000","last_undegraded":"2023-12-19T16:16:42.328795+0000","last_fullsized":"2023-12-19T16:16:42.328795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.499},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.499},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.1559999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.746},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.753}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":180931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.379}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.307},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.1259999999999994,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.68300000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.627}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.752},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":174336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.437}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495}]},{"osd":4,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97799999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":764704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.62},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.47199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:52.327 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:52.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 Processor -- start 2023-12-19T16:16:52.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 -- start start 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f411015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f41100cac10 0x7f411015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411015f100 con 0x7f411015afa0 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41100ca7d0 con 0x7f41100cac10 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f4116bce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411015e860 con 0x7f411015a680 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f411516b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f411015afa0 0x7f411006fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46766/0 (socket says 172.21.15.119:46766) 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.469+0000 7f411516b640 1 -- 172.21.15.119:0/3282145770 learned_addr learned my addr 172.21.15.119:0/3282145770 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f411496a640 1 --2- 172.21.15.119:0/3282145770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f411015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f410ffff640 1 --2- 172.21.15.119:0/3282145770 >> v2:172.21.15.143:3300/0 conn(0x7f41100cac10 0x7f411015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f410f7fe640 1 -- 172.21.15.119:0/3282145770 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156773801 0 0) 0x7f411015f100 con 0x7f411015afa0 2023-12-19T16:16:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f410f7fe640 1 -- 172.21.15.119:0/3282145770 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4100003530 con 0x7f411015afa0 2023-12-19T16:16:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f411496a640 1 -- 172.21.15.119:0/3282145770 >> v2:172.21.15.143:3300/0 conn(0x7f41100cac10 msgr2=0x7f411015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f411496a640 1 --2- 172.21.15.119:0/3282145770 >> v2:172.21.15.143:3300/0 conn(0x7f41100cac10 0x7f411015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f411496a640 1 -- 172.21.15.119:0/3282145770 >> v1:172.21.15.119:6789/0 conn(0x7f411015afa0 legacy=0x7f411006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f411496a640 1 -- 172.21.15.119:0/3282145770 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411015eb40 con 0x7f411015a680 2023-12-19T16:16:52.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f411496a640 1 --2- 172.21.15.119:0/3282145770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f411015e160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41040097c0 tx=0x7f410401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=618ddb15ca1f0106 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:52.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f410f7fe640 1 -- 172.21.15.119:0/3282145770 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040ab600 con 0x7f411015a680 2023-12-19T16:16:52.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f410f7fe640 1 -- 172.21.15.119:0/3282145770 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41040a7050 con 0x7f411015a680 2023-12-19T16:16:52.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.473+0000 7f410f7fe640 1 -- 172.21.15.119:0/3282145770 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040ab960 con 0x7f411015a680 2023-12-19T16:16:52.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- 172.21.15.119:0/3282145770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 msgr2=0x7f411015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 --2- 172.21.15.119:0/3282145770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f411015e160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41040097c0 tx=0x7f410401c3f0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- 172.21.15.119:0/3282145770 shutdown_connections 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 --2- 172.21.15.119:0/3282145770 >> v2:172.21.15.143:3300/0 conn(0x7f41100cac10 0x7f411015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 --2- 172.21.15.119:0/3282145770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f411015e160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- 172.21.15.119:0/3282145770 >> 172.21.15.119:0/3282145770 conn(0x7f411006a3e0 msgr2=0x7f41100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- 172.21.15.119:0/3282145770 shutdown_connections 2023-12-19T16:16:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- 172.21.15.119:0/3282145770 wait complete. 2023-12-19T16:16:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 Processor -- start 2023-12-19T16:16:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- start start 2023-12-19T16:16:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41100cac10 0x7f41101519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f41100c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 0x7f41100b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4110158fd0 con 0x7f411015afa0 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b2740 con 0x7f41100cac10 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f4116bce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41101586a0 con 0x7f411015a680 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f411516b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 0x7f41100b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f411516b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 0x7f41100b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33910/0 (socket says 172.21.15.119:33910) 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f411516b640 1 -- 172.21.15.119:0/1450471438 learned_addr learned my addr 172.21.15.119:0/1450471438 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f411496a640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41100cac10 0x7f41101519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.477+0000 7f410ffff640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f41100c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411516b640 1 -- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 msgr2=0x7f41100c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411516b640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f41100c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411516b640 1 -- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41100cac10 msgr2=0x7f41101519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411516b640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41100cac10 0x7f41101519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411516b640 1 -- 172.21.15.119:0/1450471438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4104009420 con 0x7f411015afa0 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411516b640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 0x7f41100b1da0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f410800caa0 tx=0x7f410800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800ac00 con 0x7f411015afa0 2023-12-19T16:16:52.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800ad60 con 0x7f411015afa0 2023-12-19T16:16:52.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4110158980 con 0x7f411015afa0 2023-12-19T16:16:52.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108012620 con 0x7f411015afa0 2023-12-19T16:16:52.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4110151ef0 con 0x7f411015afa0 2023-12-19T16:16:52.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41100735b0 con 0x7f411015afa0 2023-12-19T16:16:52.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4108007070 con 0x7f411015afa0 2023-12-19T16:16:52.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f410d7fa640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40f4065a60 0x7f40f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4108083340 con 0x7f411015afa0 2023-12-19T16:16:52.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.481+0000 7f411496a640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40f4065a60 0x7f40f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.485+0000 7f411496a640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40f4065a60 0x7f40f4067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41040ad000 tx=0x7f4104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:52.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.485+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4108050b20 con 0x7f411015afa0 2023-12-19T16:16:52.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.633+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41100704c0 con 0x7f40f4065a60 2023-12-19T16:16:52.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.641+0000 7f410d7fa640 1 -- 172.21.15.119:0/1450471438 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289073 (secure 0 0 0) 0x7f41040ab5c0 con 0x7f40f4065a60 2023-12-19T16:16:52.651 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:52.652 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:16:52.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40f4065a60 msgr2=0x7f40f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40f4065a60 0x7f40f4067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41040ad000 tx=0x7f4104008040 comp rx=0 tx=0).stop 2023-12-19T16:16:52.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 msgr2=0x7f41100b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 0x7f41100b1da0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f410800caa0 tx=0x7f410800cf60 comp rx=0 tx=0).stop 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 shutdown_connections 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f40f4065a60 0x7f40f4067f20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f411015afa0 0x7f41100b1da0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f411015a680 0x7f41100c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 --2- 172.21.15.119:0/1450471438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41100cac10 0x7f41101519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 >> 172.21.15.119:0/1450471438 conn(0x7f411006a3e0 msgr2=0x7f4110152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 shutdown_connections 2023-12-19T16:16:52.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.645+0000 7f4116bce640 1 -- 172.21.15.119:0/1450471438 wait complete. 2023-12-19T16:16:52.670 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-12-19T16:16:52.467662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220360,"kb_used_data":4744,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754360,"statfs":{"total":773094113280,"available":772868464640,"internally_reserved":0,"allocated":4857856,"data_stored":2742628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.749819"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.747274+0000","last_change":"2023-12-19T16:16:43.741274+0000","last_active":"2023-12-19T16:16:43.747274+0000","last_peered":"2023-12-19T16:16:43.747274+0000","last_clean":"2023-12-19T16:16:43.747274+0000","last_became_active":"2023-12-19T16:16:43.741062+0000","last_became_peered":"2023-12-19T16:16:43.741062+0000","last_unstale":"2023-12-19T16:16:43.747274+0000","last_undegraded":"2023-12-19T16:16:43.747274+0000","last_fullsized":"2023-12-19T16:16:43.747274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.457430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.738883+0000","last_change":"2023-12-19T16:16:43.734686+0000","last_active":"2023-12-19T16:16:43.738883+0000","last_peered":"2023-12-19T16:16:43.738883+0000","last_clean":"2023-12-19T16:16:43.738883+0000","last_became_active":"2023-12-19T16:16:43.734431+0000","last_became_peered":"2023-12-19T16:16:43.734431+0000","last_unstale":"2023-12-19T16:16:43.738883+0000","last_undegraded":"2023-12-19T16:16:43.738883+0000","last_fullsized":"2023-12-19T16:16:43.738883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.765700+0000","last_change":"2023-12-19T16:16:43.764358+0000","last_active":"2023-12-19T16:16:43.765700+0000","last_peered":"2023-12-19T16:16:43.765700+0000","last_clean":"2023-12-19T16:16:43.765700+0000","last_became_active":"2023-12-19T16:16:43.764104+0000","last_became_peered":"2023-12-19T16:16:43.764104+0000","last_unstale":"2023-12-19T16:16:43.765700+0000","last_undegraded":"2023-12-19T16:16:43.765700+0000","last_fullsized":"2023-12-19T16:16:43.765700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.738714+0000","last_change":"2023-12-19T16:16:43.732634+0000","last_active":"2023-12-19T16:16:43.738714+0000","last_peered":"2023-12-19T16:16:43.738714+0000","last_clean":"2023-12-19T16:16:43.738714+0000","last_became_active":"2023-12-19T16:16:43.732224+0000","last_became_peered":"2023-12-19T16:16:43.732224+0000","last_unstale":"2023-12-19T16:16:43.738714+0000","last_undegraded":"2023-12-19T16:16:43.738714+0000","last_fullsized":"2023-12-19T16:16:43.738714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:47.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.741503+0000","last_change":"2023-12-19T16:16:43.737801+0000","last_active":"2023-12-19T16:16:43.741503+0000","last_peered":"2023-12-19T16:16:43.741503+0000","last_clean":"2023-12-19T16:16:43.741503+0000","last_became_active":"2023-12-19T16:16:43.737552+0000","last_became_peered":"2023-12-19T16:16:43.737552+0000","last_unstale":"2023-12-19T16:16:43.741503+0000","last_undegraded":"2023-12-19T16:16:43.741503+0000","last_fullsized":"2023-12-19T16:16:43.741503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:25.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.735746+0000","last_change":"2023-12-19T16:16:43.733262+0000","last_active":"2023-12-19T16:16:43.735746+0000","last_peered":"2023-12-19T16:16:43.735746+0000","last_clean":"2023-12-19T16:16:43.735746+0000","last_became_active":"2023-12-19T16:16:43.733031+0000","last_became_peered":"2023-12-19T16:16:43.733031+0000","last_unstale":"2023-12-19T16:16:43.735746+0000","last_undegraded":"2023-12-19T16:16:43.735746+0000","last_fullsized":"2023-12-19T16:16:43.735746+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.758009+0000","last_change":"2023-12-19T16:16:43.752479+0000","last_active":"2023-12-19T16:16:43.758009+0000","last_peered":"2023-12-19T16:16:43.758009+0000","last_clean":"2023-12-19T16:16:43.758009+0000","last_became_active":"2023-12-19T16:16:43.752146+0000","last_became_peered":"2023-12-19T16:16:43.752146+0000","last_unstale":"2023-12-19T16:16:43.758009+0000","last_undegraded":"2023-12-19T16:16:43.758009+0000","last_fullsized":"2023-12-19T16:16:43.758009+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:59:06.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754085+0000","last_change":"2023-12-19T16:16:43.753268+0000","last_active":"2023-12-19T16:16:43.754085+0000","last_peered":"2023-12-19T16:16:43.754085+0000","last_clean":"2023-12-19T16:16:43.754085+0000","last_became_active":"2023-12-19T16:16:43.752582+0000","last_became_peered":"2023-12-19T16:16:43.752582+0000","last_unstale":"2023-12-19T16:16:43.754085+0000","last_undegraded":"2023-12-19T16:16:43.754085+0000","last_fullsized":"2023-12-19T16:16:43.754085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:44.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754150+0000","last_change":"2023-12-19T16:16:43.752811+0000","last_active":"2023-12-19T16:16:43.754150+0000","last_peered":"2023-12-19T16:16:43.754150+0000","last_clean":"2023-12-19T16:16:43.754150+0000","last_became_active":"2023-12-19T16:16:43.752563+0000","last_became_peered":"2023-12-19T16:16:43.752563+0000","last_unstale":"2023-12-19T16:16:43.754150+0000","last_undegraded":"2023-12-19T16:16:43.754150+0000","last_fullsized":"2023-12-19T16:16:43.754150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767570+0000","last_change":"2023-12-19T16:16:43.765098+0000","last_active":"2023-12-19T16:16:43.767570+0000","last_peered":"2023-12-19T16:16:43.767570+0000","last_clean":"2023-12-19T16:16:43.767570+0000","last_became_active":"2023-12-19T16:16:43.764016+0000","last_became_peered":"2023-12-19T16:16:43.764016+0000","last_unstale":"2023-12-19T16:16:43.767570+0000","last_undegraded":"2023-12-19T16:16:43.767570+0000","last_fullsized":"2023-12-19T16:16:43.767570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:56.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.759456+0000","last_change":"2023-12-19T16:16:43.755832+0000","last_active":"2023-12-19T16:16:43.759456+0000","last_peered":"2023-12-19T16:16:43.759456+0000","last_clean":"2023-12-19T16:16:43.759456+0000","last_became_active":"2023-12-19T16:16:43.755605+0000","last_became_peered":"2023-12-19T16:16:43.755605+0000","last_unstale":"2023-12-19T16:16:43.759456+0000","last_undegraded":"2023-12-19T16:16:43.759456+0000","last_fullsized":"2023-12-19T16:16:43.759456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:28.808811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.740128+0000","last_change":"2023-12-19T16:16:43.735190+0000","last_active":"2023-12-19T16:16:43.740128+0000","last_peered":"2023-12-19T16:16:43.740128+0000","last_clean":"2023-12-19T16:16:43.740128+0000","last_became_active":"2023-12-19T16:16:43.734913+0000","last_became_peered":"2023-12-19T16:16:43.734913+0000","last_unstale":"2023-12-19T16:16:43.740128+0000","last_undegraded":"2023-12-19T16:16:43.740128+0000","last_fullsized":"2023-12-19T16:16:43.740128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:17:05.566170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767529+0000","last_change":"2023-12-19T16:16:43.763993+0000","last_active":"2023-12-19T16:16:43.767529+0000","last_peered":"2023-12-19T16:16:43.767529+0000","last_clean":"2023-12-19T16:16:43.767529+0000","last_became_active":"2023-12-19T16:16:43.763607+0000","last_became_peered":"2023-12-19T16:16:43.763607+0000","last_unstale":"2023-12-19T16:16:43.767529+0000","last_undegraded":"2023-12-19T16:16:43.767529+0000","last_fullsized":"2023-12-19T16:16:43.767529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:15.147537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.752106+0000","last_change":"2023-12-19T16:16:43.741356+0000","last_active":"2023-12-19T16:16:43.752106+0000","last_peered":"2023-12-19T16:16:43.752106+0000","last_clean":"2023-12-19T16:16:43.752106+0000","last_became_active":"2023-12-19T16:16:43.740746+0000","last_became_peered":"2023-12-19T16:16:43.740746+0000","last_unstale":"2023-12-19T16:16:43.752106+0000","last_undegraded":"2023-12-19T16:16:43.752106+0000","last_fullsized":"2023-12-19T16:16:43.752106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.756256+0000","last_change":"2023-12-19T16:16:43.750860+0000","last_active":"2023-12-19T16:16:43.756256+0000","last_peered":"2023-12-19T16:16:43.756256+0000","last_clean":"2023-12-19T16:16:43.756256+0000","last_became_active":"2023-12-19T16:16:43.750590+0000","last_became_peered":"2023-12-19T16:16:43.750590+0000","last_unstale":"2023-12-19T16:16:43.756256+0000","last_undegraded":"2023-12-19T16:16:43.756256+0000","last_fullsized":"2023-12-19T16:16:43.756256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767644+0000","last_change":"2023-12-19T16:16:43.765473+0000","last_active":"2023-12-19T16:16:43.767644+0000","last_peered":"2023-12-19T16:16:43.767644+0000","last_clean":"2023-12-19T16:16:43.767644+0000","last_became_active":"2023-12-19T16:16:43.765193+0000","last_became_peered":"2023-12-19T16:16:43.765193+0000","last_unstale":"2023-12-19T16:16:43.767644+0000","last_undegraded":"2023-12-19T16:16:43.767644+0000","last_fullsized":"2023-12-19T16:16:43.767644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:59.870736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.759850+0000","last_change":"2023-12-19T16:16:43.757721+0000","last_active":"2023-12-19T16:16:43.759850+0000","last_peered":"2023-12-19T16:16:43.759850+0000","last_clean":"2023-12-19T16:16:43.759850+0000","last_became_active":"2023-12-19T16:16:43.757348+0000","last_became_peered":"2023-12-19T16:16:43.757348+0000","last_unstale":"2023-12-19T16:16:43.759850+0000","last_undegraded":"2023-12-19T16:16:43.759850+0000","last_fullsized":"2023-12-19T16:16:43.759850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.755947+0000","last_change":"2023-12-19T16:16:43.749690+0000","last_active":"2023-12-19T16:16:43.755947+0000","last_peered":"2023-12-19T16:16:43.755947+0000","last_clean":"2023-12-19T16:16:43.755947+0000","last_became_active":"2023-12-19T16:16:43.749137+0000","last_became_peered":"2023-12-19T16:16:43.749137+0000","last_unstale":"2023-12-19T16:16:43.755947+0000","last_undegraded":"2023-12-19T16:16:43.755947+0000","last_fullsized":"2023-12-19T16:16:43.755947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.737335+0000","last_change":"2023-12-19T16:16:43.733593+0000","last_active":"2023-12-19T16:16:43.737335+0000","last_peered":"2023-12-19T16:16:43.737335+0000","last_clean":"2023-12-19T16:16:43.737335+0000","last_became_active":"2023-12-19T16:16:43.732168+0000","last_became_peered":"2023-12-19T16:16:43.732168+0000","last_unstale":"2023-12-19T16:16:43.737335+0000","last_undegraded":"2023-12-19T16:16:43.737335+0000","last_fullsized":"2023-12-19T16:16:43.737335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:30.632732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.755751+0000","last_change":"2023-12-19T16:16:43.748751+0000","last_active":"2023-12-19T16:16:43.755751+0000","last_peered":"2023-12-19T16:16:43.755751+0000","last_clean":"2023-12-19T16:16:43.755751+0000","last_became_active":"2023-12-19T16:16:43.748472+0000","last_became_peered":"2023-12-19T16:16:43.748472+0000","last_unstale":"2023-12-19T16:16:43.755751+0000","last_undegraded":"2023-12-19T16:16:43.755751+0000","last_fullsized":"2023-12-19T16:16:43.755751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754777+0000","last_change":"2023-12-19T16:16:43.747735+0000","last_active":"2023-12-19T16:16:43.754777+0000","last_peered":"2023-12-19T16:16:43.754777+0000","last_clean":"2023-12-19T16:16:43.754777+0000","last_became_active":"2023-12-19T16:16:43.747202+0000","last_became_peered":"2023-12-19T16:16:43.747202+0000","last_unstale":"2023-12-19T16:16:43.754777+0000","last_undegraded":"2023-12-19T16:16:43.754777+0000","last_fullsized":"2023-12-19T16:16:43.754777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.752086+0000","last_change":"2023-12-19T16:16:43.740972+0000","last_active":"2023-12-19T16:16:43.752086+0000","last_peered":"2023-12-19T16:16:43.752086+0000","last_clean":"2023-12-19T16:16:43.752086+0000","last_became_active":"2023-12-19T16:16:43.740088+0000","last_became_peered":"2023-12-19T16:16:43.740088+0000","last_unstale":"2023-12-19T16:16:43.752086+0000","last_undegraded":"2023-12-19T16:16:43.752086+0000","last_fullsized":"2023-12-19T16:16:43.752086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.764898+0000","last_change":"2023-12-19T16:16:43.760122+0000","last_active":"2023-12-19T16:16:43.764898+0000","last_peered":"2023-12-19T16:16:43.764898+0000","last_clean":"2023-12-19T16:16:43.764898+0000","last_became_active":"2023-12-19T16:16:43.754202+0000","last_became_peered":"2023-12-19T16:16:43.754202+0000","last_unstale":"2023-12-19T16:16:43.764898+0000","last_undegraded":"2023-12-19T16:16:43.764898+0000","last_fullsized":"2023-12-19T16:16:43.764898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:57.119182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.763226+0000","last_change":"2023-12-19T16:16:43.760840+0000","last_active":"2023-12-19T16:16:43.763226+0000","last_peered":"2023-12-19T16:16:43.763226+0000","last_clean":"2023-12-19T16:16:43.763226+0000","last_became_active":"2023-12-19T16:16:43.760568+0000","last_became_peered":"2023-12-19T16:16:43.760568+0000","last_unstale":"2023-12-19T16:16:43.763226+0000","last_undegraded":"2023-12-19T16:16:43.763226+0000","last_fullsized":"2023-12-19T16:16:43.763226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:19:00.102817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.755494+0000","last_change":"2023-12-19T16:16:43.744161+0000","last_active":"2023-12-19T16:16:43.755494+0000","last_peered":"2023-12-19T16:16:43.755494+0000","last_clean":"2023-12-19T16:16:43.755494+0000","last_became_active":"2023-12-19T16:16:43.743488+0000","last_became_peered":"2023-12-19T16:16:43.743488+0000","last_unstale":"2023-12-19T16:16:43.755494+0000","last_undegraded":"2023-12-19T16:16:43.755494+0000","last_fullsized":"2023-12-19T16:16:43.755494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754916+0000","last_change":"2023-12-19T16:16:43.752507+0000","last_active":"2023-12-19T16:16:43.754916+0000","last_peered":"2023-12-19T16:16:43.754916+0000","last_clean":"2023-12-19T16:16:43.754916+0000","last_became_active":"2023-12-19T16:16:43.752225+0000","last_became_peered":"2023-12-19T16:16:43.752225+0000","last_unstale":"2023-12-19T16:16:43.754916+0000","last_undegraded":"2023-12-19T16:16:43.754916+0000","last_fullsized":"2023-12-19T16:16:43.754916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:36.332249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.752931+0000","last_change":"2023-12-19T16:16:43.739220+0000","last_active":"2023-12-19T16:16:43.752931+0000","last_peered":"2023-12-19T16:16:43.752931+0000","last_clean":"2023-12-19T16:16:43.752931+0000","last_became_active":"2023-12-19T16:16:43.738948+0000","last_became_peered":"2023-12-19T16:16:43.738948+0000","last_unstale":"2023-12-19T16:16:43.752931+0000","last_undegraded":"2023-12-19T16:16:43.752931+0000","last_fullsized":"2023-12-19T16:16:43.752931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:51.570844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.758935+0000","last_change":"2023-12-19T16:16:43.754558+0000","last_active":"2023-12-19T16:16:43.758935+0000","last_peered":"2023-12-19T16:16:43.758935+0000","last_clean":"2023-12-19T16:16:43.758935+0000","last_became_active":"2023-12-19T16:16:43.752655+0000","last_became_peered":"2023-12-19T16:16:43.752655+0000","last_unstale":"2023-12-19T16:16:43.758935+0000","last_undegraded":"2023-12-19T16:16:43.758935+0000","last_fullsized":"2023-12-19T16:16:43.758935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:48:08.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.748368+0000","last_change":"2023-12-19T16:16:43.737368+0000","last_active":"2023-12-19T16:16:43.748368+0000","last_peered":"2023-12-19T16:16:43.748368+0000","last_clean":"2023-12-19T16:16:43.748368+0000","last_became_active":"2023-12-19T16:16:43.736656+0000","last_became_peered":"2023-12-19T16:16:43.736656+0000","last_unstale":"2023-12-19T16:16:43.748368+0000","last_undegraded":"2023-12-19T16:16:43.748368+0000","last_fullsized":"2023-12-19T16:16:43.748368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:53.457991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.755978+0000","last_change":"2023-12-19T16:16:43.748141+0000","last_active":"2023-12-19T16:16:43.755978+0000","last_peered":"2023-12-19T16:16:43.755978+0000","last_clean":"2023-12-19T16:16:43.755978+0000","last_became_active":"2023-12-19T16:16:43.741767+0000","last_became_peered":"2023-12-19T16:16:43.741767+0000","last_unstale":"2023-12-19T16:16:43.755978+0000","last_undegraded":"2023-12-19T16:16:43.755978+0000","last_fullsized":"2023-12-19T16:16:43.755978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:56.016247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.764918+0000","last_change":"2023-12-19T16:16:43.760302+0000","last_active":"2023-12-19T16:16:43.764918+0000","last_peered":"2023-12-19T16:16:43.764918+0000","last_clean":"2023-12-19T16:16:43.764918+0000","last_became_active":"2023-12-19T16:16:43.754588+0000","last_became_peered":"2023-12-19T16:16:43.754588+0000","last_unstale":"2023-12-19T16:16:43.764918+0000","last_undegraded":"2023-12-19T16:16:43.764918+0000","last_fullsized":"2023-12-19T16:16:43.764918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:11.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.743829+0000","last_change":"2023-12-19T16:16:43.738102+0000","last_active":"2023-12-19T16:16:43.743829+0000","last_peered":"2023-12-19T16:16:43.743829+0000","last_clean":"2023-12-19T16:16:43.743829+0000","last_became_active":"2023-12-19T16:16:43.737426+0000","last_became_peered":"2023-12-19T16:16:43.737426+0000","last_unstale":"2023-12-19T16:16:43.743829+0000","last_undegraded":"2023-12-19T16:16:43.743829+0000","last_fullsized":"2023-12-19T16:16:43.743829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:59:27.494042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767205+0000","last_change":"2023-12-19T16:16:43.764863+0000","last_active":"2023-12-19T16:16:43.767205+0000","last_peered":"2023-12-19T16:16:43.767205+0000","last_clean":"2023-12-19T16:16:43.767205+0000","last_became_active":"2023-12-19T16:16:43.764579+0000","last_became_peered":"2023-12-19T16:16:43.764579+0000","last_unstale":"2023-12-19T16:16:43.767205+0000","last_undegraded":"2023-12-19T16:16:43.767205+0000","last_fullsized":"2023-12-19T16:16:43.767205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:00.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.755666+0000","last_change":"2023-12-19T16:16:43.353262+0000","last_active":"2023-12-19T16:16:43.755666+0000","last_peered":"2023-12-19T16:16:43.755666+0000","last_clean":"2023-12-19T16:16:43.755666+0000","last_became_active":"2023-12-19T16:16:43.352978+0000","last_became_peered":"2023-12-19T16:16:43.352978+0000","last_unstale":"2023-12-19T16:16:43.755666+0000","last_undegraded":"2023-12-19T16:16:43.755666+0000","last_fullsized":"2023-12-19T16:16:43.755666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.760347+0000","last_change":"2023-12-19T16:16:43.759501+0000","last_active":"2023-12-19T16:16:43.760347+0000","last_peered":"2023-12-19T16:16:43.760347+0000","last_clean":"2023-12-19T16:16:43.760347+0000","last_became_active":"2023-12-19T16:16:43.759268+0000","last_became_peered":"2023-12-19T16:16:43.759268+0000","last_unstale":"2023-12-19T16:16:43.760347+0000","last_undegraded":"2023-12-19T16:16:43.760347+0000","last_fullsized":"2023-12-19T16:16:43.760347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.739965+0000","last_change":"2023-12-19T16:16:43.356368+0000","last_active":"2023-12-19T16:16:43.739965+0000","last_peered":"2023-12-19T16:16:43.739965+0000","last_clean":"2023-12-19T16:16:43.739965+0000","last_became_active":"2023-12-19T16:16:43.355995+0000","last_became_peered":"2023-12-19T16:16:43.355995+0000","last_unstale":"2023-12-19T16:16:43.739965+0000","last_undegraded":"2023-12-19T16:16:43.739965+0000","last_fullsized":"2023-12-19T16:16:43.739965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754034+0000","last_change":"2023-12-19T16:16:43.750654+0000","last_active":"2023-12-19T16:16:43.754034+0000","last_peered":"2023-12-19T16:16:43.754034+0000","last_clean":"2023-12-19T16:16:43.754034+0000","last_became_active":"2023-12-19T16:16:43.739599+0000","last_became_peered":"2023-12-19T16:16:43.739599+0000","last_unstale":"2023-12-19T16:16:43.754034+0000","last_undegraded":"2023-12-19T16:16:43.754034+0000","last_fullsized":"2023-12-19T16:16:43.754034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.749469+0000","last_change":"2023-12-19T16:16:43.354704+0000","last_active":"2023-12-19T16:16:43.749469+0000","last_peered":"2023-12-19T16:16:43.749469+0000","last_clean":"2023-12-19T16:16:43.749469+0000","last_became_active":"2023-12-19T16:16:43.354443+0000","last_became_peered":"2023-12-19T16:16:43.354443+0000","last_unstale":"2023-12-19T16:16:43.749469+0000","last_undegraded":"2023-12-19T16:16:43.749469+0000","last_fullsized":"2023-12-19T16:16:43.749469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:25:10.146326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.747127+0000","last_change":"2023-12-19T16:16:43.739388+0000","last_active":"2023-12-19T16:16:43.747127+0000","last_peered":"2023-12-19T16:16:43.747127+0000","last_clean":"2023-12-19T16:16:43.747127+0000","last_became_active":"2023-12-19T16:16:43.739164+0000","last_became_peered":"2023-12-19T16:16:43.739164+0000","last_unstale":"2023-12-19T16:16:43.747127+0000","last_undegraded":"2023-12-19T16:16:43.747127+0000","last_fullsized":"2023-12-19T16:16:43.747127+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:42.986335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.746441+0000","last_change":"2023-12-19T16:16:43.352896+0000","last_active":"2023-12-19T16:16:43.746441+0000","last_peered":"2023-12-19T16:16:43.746441+0000","last_clean":"2023-12-19T16:16:43.746441+0000","last_became_active":"2023-12-19T16:16:43.352492+0000","last_became_peered":"2023-12-19T16:16:43.352492+0000","last_unstale":"2023-12-19T16:16:43.746441+0000","last_undegraded":"2023-12-19T16:16:43.746441+0000","last_fullsized":"2023-12-19T16:16:43.746441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.740154+0000","last_change":"2023-12-19T16:16:43.733650+0000","last_active":"2023-12-19T16:16:43.740154+0000","last_peered":"2023-12-19T16:16:43.740154+0000","last_clean":"2023-12-19T16:16:43.740154+0000","last_became_active":"2023-12-19T16:16:43.733416+0000","last_became_peered":"2023-12-19T16:16:43.733416+0000","last_unstale":"2023-12-19T16:16:43.740154+0000","last_undegraded":"2023-12-19T16:16:43.740154+0000","last_fullsized":"2023-12-19T16:16:43.740154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.757443+0000","last_change":"2023-12-19T16:16:43.354651+0000","last_active":"2023-12-19T16:16:43.757443+0000","last_peered":"2023-12-19T16:16:43.757443+0000","last_clean":"2023-12-19T16:16:43.757443+0000","last_became_active":"2023-12-19T16:16:43.354392+0000","last_became_peered":"2023-12-19T16:16:43.354392+0000","last_unstale":"2023-12-19T16:16:43.757443+0000","last_undegraded":"2023-12-19T16:16:43.757443+0000","last_fullsized":"2023-12-19T16:16:43.757443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.500035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.756227+0000","last_change":"2023-12-19T16:16:43.748633+0000","last_active":"2023-12-19T16:16:43.756227+0000","last_peered":"2023-12-19T16:16:43.756227+0000","last_clean":"2023-12-19T16:16:43.756227+0000","last_became_active":"2023-12-19T16:16:43.747554+0000","last_became_peered":"2023-12-19T16:16:43.747554+0000","last_unstale":"2023-12-19T16:16:43.756227+0000","last_undegraded":"2023-12-19T16:16:43.756227+0000","last_fullsized":"2023-12-19T16:16:43.756227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.761253+0000","last_change":"2023-12-19T16:16:43.359797+0000","last_active":"2023-12-19T16:16:43.761253+0000","last_peered":"2023-12-19T16:16:43.761253+0000","last_clean":"2023-12-19T16:16:43.761253+0000","last_became_active":"2023-12-19T16:16:43.359535+0000","last_became_peered":"2023-12-19T16:16:43.359535+0000","last_unstale":"2023-12-19T16:16:43.761253+0000","last_undegraded":"2023-12-19T16:16:43.761253+0000","last_fullsized":"2023-12-19T16:16:43.761253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:32.742086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.756901+0000","last_change":"2023-12-19T16:16:43.752692+0000","last_active":"2023-12-19T16:16:43.756901+0000","last_peered":"2023-12-19T16:16:43.756901+0000","last_clean":"2023-12-19T16:16:43.756901+0000","last_became_active":"2023-12-19T16:16:43.752330+0000","last_became_peered":"2023-12-19T16:16:43.752330+0000","last_unstale":"2023-12-19T16:16:43.756901+0000","last_undegraded":"2023-12-19T16:16:43.756901+0000","last_fullsized":"2023-12-19T16:16:43.756901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:07.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.728466+0000","last_change":"2023-12-19T16:16:43.350869+0000","last_active":"2023-12-19T16:16:43.728466+0000","last_peered":"2023-12-19T16:16:43.728466+0000","last_clean":"2023-12-19T16:16:43.728466+0000","last_became_active":"2023-12-19T16:16:43.350591+0000","last_became_peered":"2023-12-19T16:16:43.350591+0000","last_unstale":"2023-12-19T16:16:43.728466+0000","last_undegraded":"2023-12-19T16:16:43.728466+0000","last_fullsized":"2023-12-19T16:16:43.728466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.762873+0000","last_change":"2023-12-19T16:16:43.761606+0000","last_active":"2023-12-19T16:16:43.762873+0000","last_peered":"2023-12-19T16:16:43.762873+0000","last_clean":"2023-12-19T16:16:43.762873+0000","last_became_active":"2023-12-19T16:16:43.761256+0000","last_became_peered":"2023-12-19T16:16:43.761256+0000","last_unstale":"2023-12-19T16:16:43.762873+0000","last_undegraded":"2023-12-19T16:16:43.762873+0000","last_fullsized":"2023-12-19T16:16:43.762873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:04.059004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.731414+0000","last_change":"2023-12-19T16:16:43.351126+0000","last_active":"2023-12-19T16:16:43.731414+0000","last_peered":"2023-12-19T16:16:43.731414+0000","last_clean":"2023-12-19T16:16:43.731414+0000","last_became_active":"2023-12-19T16:16:43.350844+0000","last_became_peered":"2023-12-19T16:16:43.350844+0000","last_unstale":"2023-12-19T16:16:43.731414+0000","last_undegraded":"2023-12-19T16:16:43.731414+0000","last_fullsized":"2023-12-19T16:16:43.731414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.735592+0000","last_change":"2023-12-19T16:16:43.730084+0000","last_active":"2023-12-19T16:16:43.735592+0000","last_peered":"2023-12-19T16:16:43.735592+0000","last_clean":"2023-12-19T16:16:43.735592+0000","last_became_active":"2023-12-19T16:16:43.729825+0000","last_became_peered":"2023-12-19T16:16:43.729825+0000","last_unstale":"2023-12-19T16:16:43.735592+0000","last_undegraded":"2023-12-19T16:16:43.735592+0000","last_fullsized":"2023-12-19T16:16:43.735592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:23.594948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.725956+0000","last_change":"2023-12-19T16:16:43.348887+0000","last_active":"2023-12-19T16:16:43.725956+0000","last_peered":"2023-12-19T16:16:43.725956+0000","last_clean":"2023-12-19T16:16:43.725956+0000","last_became_active":"2023-12-19T16:16:43.348607+0000","last_became_peered":"2023-12-19T16:16:43.348607+0000","last_unstale":"2023-12-19T16:16:43.725956+0000","last_undegraded":"2023-12-19T16:16:43.725956+0000","last_fullsized":"2023-12-19T16:16:43.725956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:32.705972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767037+0000","last_change":"2023-12-19T16:16:43.760840+0000","last_active":"2023-12-19T16:16:43.767037+0000","last_peered":"2023-12-19T16:16:43.767037+0000","last_clean":"2023-12-19T16:16:43.767037+0000","last_became_active":"2023-12-19T16:16:43.757748+0000","last_became_peered":"2023-12-19T16:16:43.757748+0000","last_unstale":"2023-12-19T16:16:43.767037+0000","last_undegraded":"2023-12-19T16:16:43.767037+0000","last_fullsized":"2023-12-19T16:16:43.767037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:41.285289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.742931+0000","last_change":"2023-12-19T16:16:43.353196+0000","last_active":"2023-12-19T16:16:43.742931+0000","last_peered":"2023-12-19T16:16:43.742931+0000","last_clean":"2023-12-19T16:16:43.742931+0000","last_became_active":"2023-12-19T16:16:43.352913+0000","last_became_peered":"2023-12-19T16:16:43.352913+0000","last_unstale":"2023-12-19T16:16:43.742931+0000","last_undegraded":"2023-12-19T16:16:43.742931+0000","last_fullsized":"2023-12-19T16:16:43.742931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.747949+0000","last_change":"2023-12-19T16:16:43.744528+0000","last_active":"2023-12-19T16:16:43.747949+0000","last_peered":"2023-12-19T16:16:43.747949+0000","last_clean":"2023-12-19T16:16:43.747949+0000","last_became_active":"2023-12-19T16:16:43.744254+0000","last_became_peered":"2023-12-19T16:16:43.744254+0000","last_unstale":"2023-12-19T16:16:43.747949+0000","last_undegraded":"2023-12-19T16:16:43.747949+0000","last_fullsized":"2023-12-19T16:16:43.747949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:33.717463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.762826+0000","last_change":"2023-12-19T16:16:43.349320+0000","last_active":"2023-12-19T16:16:43.762826+0000","last_peered":"2023-12-19T16:16:43.762826+0000","last_clean":"2023-12-19T16:16:43.762826+0000","last_became_active":"2023-12-19T16:16:43.348855+0000","last_became_peered":"2023-12-19T16:16:43.348855+0000","last_unstale":"2023-12-19T16:16:43.762826+0000","last_undegraded":"2023-12-19T16:16:43.762826+0000","last_fullsized":"2023-12-19T16:16:43.762826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:16.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754924+0000","last_change":"2023-12-19T16:16:43.735827+0000","last_active":"2023-12-19T16:16:43.754924+0000","last_peered":"2023-12-19T16:16:43.754924+0000","last_clean":"2023-12-19T16:16:43.754924+0000","last_became_active":"2023-12-19T16:16:43.735091+0000","last_became_peered":"2023-12-19T16:16:43.735091+0000","last_unstale":"2023-12-19T16:16:43.754924+0000","last_undegraded":"2023-12-19T16:16:43.754924+0000","last_fullsized":"2023-12-19T16:16:43.754924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:50.111893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767483+0000","last_change":"2023-12-19T16:16:43.356135+0000","last_active":"2023-12-19T16:16:43.767483+0000","last_peered":"2023-12-19T16:16:43.767483+0000","last_clean":"2023-12-19T16:16:43.767483+0000","last_became_active":"2023-12-19T16:16:43.355836+0000","last_became_peered":"2023-12-19T16:16:43.355836+0000","last_unstale":"2023-12-19T16:16:43.767483+0000","last_undegraded":"2023-12-19T16:16:43.767483+0000","last_fullsized":"2023-12-19T16:16:43.767483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:22.459861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754008+0000","last_change":"2023-12-19T16:16:43.752750+0000","last_active":"2023-12-19T16:16:43.754008+0000","last_peered":"2023-12-19T16:16:43.754008+0000","last_clean":"2023-12-19T16:16:43.754008+0000","last_became_active":"2023-12-19T16:16:43.752495+0000","last_became_peered":"2023-12-19T16:16:43.752495+0000","last_unstale":"2023-12-19T16:16:43.754008+0000","last_undegraded":"2023-12-19T16:16:43.754008+0000","last_fullsized":"2023-12-19T16:16:43.754008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:36.808817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.745466+0000","last_change":"2023-12-19T16:16:43.352367+0000","last_active":"2023-12-19T16:16:43.745466+0000","last_peered":"2023-12-19T16:16:43.745466+0000","last_clean":"2023-12-19T16:16:43.745466+0000","last_became_active":"2023-12-19T16:16:43.351864+0000","last_became_peered":"2023-12-19T16:16:43.351864+0000","last_unstale":"2023-12-19T16:16:43.745466+0000","last_undegraded":"2023-12-19T16:16:43.745466+0000","last_fullsized":"2023-12-19T16:16:43.745466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:08.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.747322+0000","last_change":"2023-12-19T16:16:43.740821+0000","last_active":"2023-12-19T16:16:43.747322+0000","last_peered":"2023-12-19T16:16:43.747322+0000","last_clean":"2023-12-19T16:16:43.747322+0000","last_became_active":"2023-12-19T16:16:43.740605+0000","last_became_peered":"2023-12-19T16:16:43.740605+0000","last_unstale":"2023-12-19T16:16:43.747322+0000","last_undegraded":"2023-12-19T16:16:43.747322+0000","last_fullsized":"2023-12-19T16:16:43.747322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:50:09.818826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.725197+0000","last_change":"2023-12-19T16:16:43.351147+0000","last_active":"2023-12-19T16:16:43.725197+0000","last_peered":"2023-12-19T16:16:43.725197+0000","last_clean":"2023-12-19T16:16:43.725197+0000","last_became_active":"2023-12-19T16:16:43.350898+0000","last_became_peered":"2023-12-19T16:16:43.350898+0000","last_unstale":"2023-12-19T16:16:43.725197+0000","last_undegraded":"2023-12-19T16:16:43.725197+0000","last_fullsized":"2023-12-19T16:16:43.725197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.758658+0000","last_change":"2023-12-19T16:16:43.754616+0000","last_active":"2023-12-19T16:16:43.758658+0000","last_peered":"2023-12-19T16:16:43.758658+0000","last_clean":"2023-12-19T16:16:43.758658+0000","last_became_active":"2023-12-19T16:16:43.754260+0000","last_became_peered":"2023-12-19T16:16:43.754260+0000","last_unstale":"2023-12-19T16:16:43.758658+0000","last_undegraded":"2023-12-19T16:16:43.758658+0000","last_fullsized":"2023-12-19T16:16:43.758658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.727336+0000","last_change":"2023-12-19T16:16:43.353579+0000","last_active":"2023-12-19T16:16:43.727336+0000","last_peered":"2023-12-19T16:16:43.727336+0000","last_clean":"2023-12-19T16:16:43.727336+0000","last_became_active":"2023-12-19T16:16:43.353312+0000","last_became_peered":"2023-12-19T16:16:43.353312+0000","last_unstale":"2023-12-19T16:16:43.727336+0000","last_undegraded":"2023-12-19T16:16:43.727336+0000","last_fullsized":"2023-12-19T16:16:43.727336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.747368+0000","last_change":"2023-12-19T16:16:43.743013+0000","last_active":"2023-12-19T16:16:43.747368+0000","last_peered":"2023-12-19T16:16:43.747368+0000","last_clean":"2023-12-19T16:16:43.747368+0000","last_became_active":"2023-12-19T16:16:43.741995+0000","last_became_peered":"2023-12-19T16:16:43.741995+0000","last_unstale":"2023-12-19T16:16:43.747368+0000","last_undegraded":"2023-12-19T16:16:43.747368+0000","last_fullsized":"2023-12-19T16:16:43.747368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:25:50.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767519+0000","last_change":"2023-12-19T16:16:43.360259+0000","last_active":"2023-12-19T16:16:43.767519+0000","last_peered":"2023-12-19T16:16:43.767519+0000","last_clean":"2023-12-19T16:16:43.767519+0000","last_became_active":"2023-12-19T16:16:43.359966+0000","last_became_peered":"2023-12-19T16:16:43.359966+0000","last_unstale":"2023-12-19T16:16:43.767519+0000","last_undegraded":"2023-12-19T16:16:43.767519+0000","last_fullsized":"2023-12-19T16:16:43.767519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:13.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.735953+0000","last_change":"2023-12-19T16:16:43.733557+0000","last_active":"2023-12-19T16:16:43.735953+0000","last_peered":"2023-12-19T16:16:43.735953+0000","last_clean":"2023-12-19T16:16:43.735953+0000","last_became_active":"2023-12-19T16:16:43.733212+0000","last_became_peered":"2023-12-19T16:16:43.733212+0000","last_unstale":"2023-12-19T16:16:43.735953+0000","last_undegraded":"2023-12-19T16:16:43.735953+0000","last_fullsized":"2023-12-19T16:16:43.735953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:38.947784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.758090+0000","last_change":"2023-12-19T16:16:43.355248+0000","last_active":"2023-12-19T16:16:43.758090+0000","last_peered":"2023-12-19T16:16:43.758090+0000","last_clean":"2023-12-19T16:16:43.758090+0000","last_became_active":"2023-12-19T16:16:43.353926+0000","last_became_peered":"2023-12-19T16:16:43.353926+0000","last_unstale":"2023-12-19T16:16:43.758090+0000","last_undegraded":"2023-12-19T16:16:43.758090+0000","last_fullsized":"2023-12-19T16:16:43.758090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.817134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.754819+0000","last_change":"2023-12-19T16:16:43.747616+0000","last_active":"2023-12-19T16:16:43.754819+0000","last_peered":"2023-12-19T16:16:43.754819+0000","last_clean":"2023-12-19T16:16:43.754819+0000","last_became_active":"2023-12-19T16:16:43.747316+0000","last_became_peered":"2023-12-19T16:16:43.747316+0000","last_unstale":"2023-12-19T16:16:43.754819+0000","last_undegraded":"2023-12-19T16:16:43.754819+0000","last_fullsized":"2023-12-19T16:16:43.754819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:45:05.885412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.762407+0000","last_change":"2023-12-19T16:16:43.353818+0000","last_active":"2023-12-19T16:16:43.762407+0000","last_peered":"2023-12-19T16:16:43.762407+0000","last_clean":"2023-12-19T16:16:43.762407+0000","last_became_active":"2023-12-19T16:16:43.351904+0000","last_became_peered":"2023-12-19T16:16:43.351904+0000","last_unstale":"2023-12-19T16:16:43.762407+0000","last_undegraded":"2023-12-19T16:16:43.762407+0000","last_fullsized":"2023-12-19T16:16:43.762407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:15.707442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.750849+0000","last_change":"2023-12-19T16:16:43.738732+0000","last_active":"2023-12-19T16:16:43.750849+0000","last_peered":"2023-12-19T16:16:43.750849+0000","last_clean":"2023-12-19T16:16:43.750849+0000","last_became_active":"2023-12-19T16:16:43.738465+0000","last_became_peered":"2023-12-19T16:16:43.738465+0000","last_unstale":"2023-12-19T16:16:43.750849+0000","last_undegraded":"2023-12-19T16:16:43.750849+0000","last_fullsized":"2023-12-19T16:16:43.750849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:49.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.760984+0000","last_change":"2023-12-19T16:16:43.357129+0000","last_active":"2023-12-19T16:16:43.760984+0000","last_peered":"2023-12-19T16:16:43.760984+0000","last_clean":"2023-12-19T16:16:43.760984+0000","last_became_active":"2023-12-19T16:16:43.356522+0000","last_became_peered":"2023-12-19T16:16:43.356522+0000","last_unstale":"2023-12-19T16:16:43.760984+0000","last_undegraded":"2023-12-19T16:16:43.760984+0000","last_fullsized":"2023-12-19T16:16:43.760984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:23:19.245588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.738572+0000","last_change":"2023-12-19T16:16:43.732606+0000","last_active":"2023-12-19T16:16:43.738572+0000","last_peered":"2023-12-19T16:16:43.738572+0000","last_clean":"2023-12-19T16:16:43.738572+0000","last_became_active":"2023-12-19T16:16:43.732054+0000","last_became_peered":"2023-12-19T16:16:43.732054+0000","last_unstale":"2023-12-19T16:16:43.738572+0000","last_undegraded":"2023-12-19T16:16:43.738572+0000","last_fullsized":"2023-12-19T16:16:43.738572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:18.596989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.726092+0000","last_change":"2023-12-19T16:16:43.353520+0000","last_active":"2023-12-19T16:16:43.726092+0000","last_peered":"2023-12-19T16:16:43.726092+0000","last_clean":"2023-12-19T16:16:43.726092+0000","last_became_active":"2023-12-19T16:16:43.353269+0000","last_became_peered":"2023-12-19T16:16:43.353269+0000","last_unstale":"2023-12-19T16:16:43.726092+0000","last_undegraded":"2023-12-19T16:16:43.726092+0000","last_fullsized":"2023-12-19T16:16:43.726092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:43.348038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.765573+0000","last_change":"2023-12-19T16:16:43.760441+0000","last_active":"2023-12-19T16:16:43.765573+0000","last_peered":"2023-12-19T16:16:43.765573+0000","last_clean":"2023-12-19T16:16:43.765573+0000","last_became_active":"2023-12-19T16:16:43.759994+0000","last_became_peered":"2023-12-19T16:16:43.759994+0000","last_unstale":"2023-12-19T16:16:43.765573+0000","last_undegraded":"2023-12-19T16:16:43.765573+0000","last_fullsized":"2023-12-19T16:16:43.765573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:07:17.730523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.744436+0000","last_change":"2023-12-19T16:16:43.346989+0000","last_active":"2023-12-19T16:16:43.744436+0000","last_peered":"2023-12-19T16:16:43.744436+0000","last_clean":"2023-12-19T16:16:43.744436+0000","last_became_active":"2023-12-19T16:16:43.346727+0000","last_became_peered":"2023-12-19T16:16:43.346727+0000","last_unstale":"2023-12-19T16:16:43.744436+0000","last_undegraded":"2023-12-19T16:16:43.744436+0000","last_fullsized":"2023-12-19T16:16:43.744436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:24.447700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.748038+0000","last_change":"2023-12-19T16:16:43.744530+0000","last_active":"2023-12-19T16:16:43.748038+0000","last_peered":"2023-12-19T16:16:43.748038+0000","last_clean":"2023-12-19T16:16:43.748038+0000","last_became_active":"2023-12-19T16:16:43.744242+0000","last_became_peered":"2023-12-19T16:16:43.744242+0000","last_unstale":"2023-12-19T16:16:43.748038+0000","last_undegraded":"2023-12-19T16:16:43.748038+0000","last_fullsized":"2023-12-19T16:16:43.748038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.719448+0000","last_change":"2023-12-19T16:16:43.350085+0000","last_active":"2023-12-19T16:16:43.719448+0000","last_peered":"2023-12-19T16:16:43.719448+0000","last_clean":"2023-12-19T16:16:43.719448+0000","last_became_active":"2023-12-19T16:16:43.349811+0000","last_became_peered":"2023-12-19T16:16:43.349811+0000","last_unstale":"2023-12-19T16:16:43.719448+0000","last_undegraded":"2023-12-19T16:16:43.719448+0000","last_fullsized":"2023-12-19T16:16:43.719448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:51:17.741131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.761143+0000","last_change":"2023-12-19T16:16:43.759645+0000","last_active":"2023-12-19T16:16:43.761143+0000","last_peered":"2023-12-19T16:16:43.761143+0000","last_clean":"2023-12-19T16:16:43.761143+0000","last_became_active":"2023-12-19T16:16:43.759325+0000","last_became_peered":"2023-12-19T16:16:43.759325+0000","last_unstale":"2023-12-19T16:16:43.761143+0000","last_undegraded":"2023-12-19T16:16:43.761143+0000","last_fullsized":"2023-12-19T16:16:43.761143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:43.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.740245+0000","last_change":"2023-12-19T16:16:43.360103+0000","last_active":"2023-12-19T16:16:43.740245+0000","last_peered":"2023-12-19T16:16:43.740245+0000","last_clean":"2023-12-19T16:16:43.740245+0000","last_became_active":"2023-12-19T16:16:43.359838+0000","last_became_peered":"2023-12-19T16:16:43.359838+0000","last_unstale":"2023-12-19T16:16:43.740245+0000","last_undegraded":"2023-12-19T16:16:43.740245+0000","last_fullsized":"2023-12-19T16:16:43.740245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:06.312442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.762863+0000","last_change":"2023-12-19T16:16:43.761540+0000","last_active":"2023-12-19T16:16:43.762863+0000","last_peered":"2023-12-19T16:16:43.762863+0000","last_clean":"2023-12-19T16:16:43.762863+0000","last_became_active":"2023-12-19T16:16:43.761246+0000","last_became_peered":"2023-12-19T16:16:43.761246+0000","last_unstale":"2023-12-19T16:16:43.762863+0000","last_undegraded":"2023-12-19T16:16:43.762863+0000","last_fullsized":"2023-12-19T16:16:43.762863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:04:18.438411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.719450+0000","last_change":"2023-12-19T16:16:43.345454+0000","last_active":"2023-12-19T16:16:43.719450+0000","last_peered":"2023-12-19T16:16:43.719450+0000","last_clean":"2023-12-19T16:16:43.719450+0000","last_became_active":"2023-12-19T16:16:43.344871+0000","last_became_peered":"2023-12-19T16:16:43.344871+0000","last_unstale":"2023-12-19T16:16:43.719450+0000","last_undegraded":"2023-12-19T16:16:43.719450+0000","last_fullsized":"2023-12-19T16:16:43.719450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:18:53.082616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.749224+0000","last_change":"2023-12-19T16:16:43.748577+0000","last_active":"2023-12-19T16:16:43.749224+0000","last_peered":"2023-12-19T16:16:43.749224+0000","last_clean":"2023-12-19T16:16:43.749224+0000","last_became_active":"2023-12-19T16:16:43.747793+0000","last_became_peered":"2023-12-19T16:16:43.747793+0000","last_unstale":"2023-12-19T16:16:43.749224+0000","last_undegraded":"2023-12-19T16:16:43.749224+0000","last_fullsized":"2023-12-19T16:16:43.749224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:23.471352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.748888+0000","last_change":"2023-12-19T16:16:43.348383+0000","last_active":"2023-12-19T16:16:43.748888+0000","last_peered":"2023-12-19T16:16:43.748888+0000","last_clean":"2023-12-19T16:16:43.748888+0000","last_became_active":"2023-12-19T16:16:43.348021+0000","last_became_peered":"2023-12-19T16:16:43.348021+0000","last_unstale":"2023-12-19T16:16:43.748888+0000","last_undegraded":"2023-12-19T16:16:43.748888+0000","last_fullsized":"2023-12-19T16:16:43.748888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:40.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.767058+0000","last_change":"2023-12-19T16:16:43.763140+0000","last_active":"2023-12-19T16:16:43.767058+0000","last_peered":"2023-12-19T16:16:43.767058+0000","last_clean":"2023-12-19T16:16:43.767058+0000","last_became_active":"2023-12-19T16:16:43.762024+0000","last_became_peered":"2023-12-19T16:16:43.762024+0000","last_unstale":"2023-12-19T16:16:43.767058+0000","last_undegraded":"2023-12-19T16:16:43.767058+0000","last_fullsized":"2023-12-19T16:16:43.767058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.511527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T16:16:46.000172+0000","last_change":"2023-12-19T16:16:43.349882+0000","last_active":"2023-12-19T16:16:46.000172+0000","last_peered":"2023-12-19T16:16:46.000172+0000","last_clean":"2023-12-19T16:16:46.000172+0000","last_became_active":"2023-12-19T16:16:43.349600+0000","last_became_peered":"2023-12-19T16:16:43.349600+0000","last_unstale":"2023-12-19T16:16:46.000172+0000","last_undegraded":"2023-12-19T16:16:46.000172+0000","last_fullsized":"2023-12-19T16:16:46.000172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:43:50.507030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.747254+0000","last_change":"2023-12-19T16:16:43.739839+0000","last_active":"2023-12-19T16:16:43.747254+0000","last_peered":"2023-12-19T16:16:43.747254+0000","last_clean":"2023-12-19T16:16:43.747254+0000","last_became_active":"2023-12-19T16:16:43.739598+0000","last_became_peered":"2023-12-19T16:16:43.739598+0000","last_unstale":"2023-12-19T16:16:43.747254+0000","last_undegraded":"2023-12-19T16:16:43.747254+0000","last_fullsized":"2023-12-19T16:16:43.747254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:06:54.423721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.728943+0000","last_change":"2023-12-19T16:16:43.348488+0000","last_active":"2023-12-19T16:16:43.728943+0000","last_peered":"2023-12-19T16:16:43.728943+0000","last_clean":"2023-12-19T16:16:43.728943+0000","last_became_active":"2023-12-19T16:16:43.348144+0000","last_became_peered":"2023-12-19T16:16:43.348144+0000","last_unstale":"2023-12-19T16:16:43.728943+0000","last_undegraded":"2023-12-19T16:16:43.728943+0000","last_fullsized":"2023-12-19T16:16:43.728943+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:56.107691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.740140+0000","last_change":"2023-12-19T16:16:43.731641+0000","last_active":"2023-12-19T16:16:43.740140+0000","last_peered":"2023-12-19T16:16:43.740140+0000","last_clean":"2023-12-19T16:16:43.740140+0000","last_became_active":"2023-12-19T16:16:43.731379+0000","last_became_peered":"2023-12-19T16:16:43.731379+0000","last_unstale":"2023-12-19T16:16:43.740140+0000","last_undegraded":"2023-12-19T16:16:43.740140+0000","last_fullsized":"2023-12-19T16:16:43.740140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:09.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.727090+0000","last_change":"2023-12-19T16:16:43.346209+0000","last_active":"2023-12-19T16:16:43.727090+0000","last_peered":"2023-12-19T16:16:43.727090+0000","last_clean":"2023-12-19T16:16:43.727090+0000","last_became_active":"2023-12-19T16:16:43.345183+0000","last_became_peered":"2023-12-19T16:16:43.345183+0000","last_unstale":"2023-12-19T16:16:43.727090+0000","last_undegraded":"2023-12-19T16:16:43.727090+0000","last_fullsized":"2023-12-19T16:16:43.727090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:52.446500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.744828+0000","last_change":"2023-12-19T16:16:43.738121+0000","last_active":"2023-12-19T16:16:43.744828+0000","last_peered":"2023-12-19T16:16:43.744828+0000","last_clean":"2023-12-19T16:16:43.744828+0000","last_became_active":"2023-12-19T16:16:43.737814+0000","last_became_peered":"2023-12-19T16:16:43.737814+0000","last_unstale":"2023-12-19T16:16:43.744828+0000","last_undegraded":"2023-12-19T16:16:43.744828+0000","last_fullsized":"2023-12-19T16:16:43.744828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:42:12.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.727514+0000","last_change":"2023-12-19T16:16:43.355011+0000","last_active":"2023-12-19T16:16:43.727514+0000","last_peered":"2023-12-19T16:16:43.727514+0000","last_clean":"2023-12-19T16:16:43.727514+0000","last_became_active":"2023-12-19T16:16:43.352649+0000","last_became_peered":"2023-12-19T16:16:43.352649+0000","last_unstale":"2023-12-19T16:16:43.727514+0000","last_undegraded":"2023-12-19T16:16:43.727514+0000","last_fullsized":"2023-12-19T16:16:43.727514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:17.585498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.756881+0000","last_change":"2023-12-19T16:16:43.750196+0000","last_active":"2023-12-19T16:16:43.756881+0000","last_peered":"2023-12-19T16:16:43.756881+0000","last_clean":"2023-12-19T16:16:43.756881+0000","last_became_active":"2023-12-19T16:16:43.740483+0000","last_became_peered":"2023-12-19T16:16:43.740483+0000","last_unstale":"2023-12-19T16:16:43.756881+0000","last_undegraded":"2023-12-19T16:16:43.756881+0000","last_fullsized":"2023-12-19T16:16:43.756881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:11:13.905931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.731369+0000","last_change":"2023-12-19T16:16:43.347544+0000","last_active":"2023-12-19T16:16:43.731369+0000","last_peered":"2023-12-19T16:16:43.731369+0000","last_clean":"2023-12-19T16:16:43.731369+0000","last_became_active":"2023-12-19T16:16:43.347259+0000","last_became_peered":"2023-12-19T16:16:43.347259+0000","last_unstale":"2023-12-19T16:16:43.731369+0000","last_undegraded":"2023-12-19T16:16:43.731369+0000","last_fullsized":"2023-12-19T16:16:43.731369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:56.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.760232+0000","last_change":"2023-12-19T16:16:43.758148+0000","last_active":"2023-12-19T16:16:43.760232+0000","last_peered":"2023-12-19T16:16:43.760232+0000","last_clean":"2023-12-19T16:16:43.760232+0000","last_became_active":"2023-12-19T16:16:43.757835+0000","last_became_peered":"2023-12-19T16:16:43.757835+0000","last_unstale":"2023-12-19T16:16:43.760232+0000","last_undegraded":"2023-12-19T16:16:43.760232+0000","last_fullsized":"2023-12-19T16:16:43.760232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:44.359529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.723874+0000","last_change":"2023-12-19T16:16:43.349535+0000","last_active":"2023-12-19T16:16:43.723874+0000","last_peered":"2023-12-19T16:16:43.723874+0000","last_clean":"2023-12-19T16:16:43.723874+0000","last_became_active":"2023-12-19T16:16:43.349097+0000","last_became_peered":"2023-12-19T16:16:43.349097+0000","last_unstale":"2023-12-19T16:16:43.723874+0000","last_undegraded":"2023-12-19T16:16:43.723874+0000","last_fullsized":"2023-12-19T16:16:43.723874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:35.320757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.763990+0000","last_change":"2023-12-19T16:16:43.757057+0000","last_active":"2023-12-19T16:16:43.763990+0000","last_peered":"2023-12-19T16:16:43.763990+0000","last_clean":"2023-12-19T16:16:43.763990+0000","last_became_active":"2023-12-19T16:16:43.752166+0000","last_became_peered":"2023-12-19T16:16:43.752166+0000","last_unstale":"2023-12-19T16:16:43.763990+0000","last_undegraded":"2023-12-19T16:16:43.763990+0000","last_fullsized":"2023-12-19T16:16:43.763990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:43.318998+0000","last_clean_scrub_stamp":"2023-12-19T16:16:43.318998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:01.219685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.741648+0000","last_change":"2023-12-19T16:16:43.358272+0000","last_active":"2023-12-19T16:16:43.741648+0000","last_peered":"2023-12-19T16:16:43.741648+0000","last_clean":"2023-12-19T16:16:43.741648+0000","last_became_active":"2023-12-19T16:16:43.358010+0000","last_became_peered":"2023-12-19T16:16:43.358010+0000","last_unstale":"2023-12-19T16:16:43.741648+0000","last_undegraded":"2023-12-19T16:16:43.741648+0000","last_fullsized":"2023-12-19T16:16:43.741648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:42.307507+0000","last_clean_scrub_stamp":"2023-12-19T16:16:42.307507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:28.970063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T16:16:43.738466+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:16:43.738466+0000","last_peered":"2023-12-19T16:16:43.738466+0000","last_clean":"2023-12-19T16:16:43.738466+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:16:43.738466+0000","last_undegraded":"2023-12-19T16:16:43.738466+0000","last_fullsized":"2023-12-19T16:16:43.738466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.498},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.625},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":195228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77200000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.623}]},{"osd":3,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.879},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61099999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":194758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.621}]},{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.752}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.1559999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.89500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":195250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.68400000000000005}]},{"osd":1,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.57199999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.62}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78200000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65200000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":196244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.44},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.1259999999999994,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.54000000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.501}]},{"osd":6,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.318},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.373}]},{"osd":4,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.87}]},{"osd":7,"last update":"Tue Dec 19 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.78700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51600000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.872},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.94999999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.80000000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":1048576,"data_stored":785048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.314},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.375},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.014}]},{"osd":5,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.077}]},{"osd":6,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:52.675 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:16:52.675 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T16:16:52.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.849+0000 7f346f68c640 1 Processor -- start 2023-12-19T16:16:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.849+0000 7f346f68c640 1 -- start start 2023-12-19T16:16:52.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346f68c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 0x7f34680cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346f68c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 0x7f34680afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346f68c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680b0870 con 0x7f34680b0410 2023-12-19T16:16:52.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346f68c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34680adcc0 con 0x7f34680ad290 2023-12-19T16:16:52.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346f68c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346815d300 con 0x7f34680cdca0 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 0x7f34680afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346d428640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 0x7f34680cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 0x7f34680afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:60208/0 (socket says 172.21.15.119:60208) 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346dc29640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f34680b0410 0x7f34681609f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:40830/0 (socket says 172.21.15.119:40830) 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346d428640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 0x7f34680cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:59596/0 (socket says 172.21.15.119:59596) 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 -- 172.21.15.119:0/3719909117 learned_addr learned my addr 172.21.15.119:0/3719909117 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 -- 172.21.15.119:0/3719909117 >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 msgr2=0x7f34680cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 --2- 172.21.15.119:0/3719909117 >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 0x7f34680cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 -- 172.21.15.119:0/3719909117 >> v1:172.21.15.143:6789/0 conn(0x7f34680b0410 legacy=0x7f34681609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346cc27640 1 -- 172.21.15.119:0/3719909117 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680ccd60 con 0x7f34680cdca0 2023-12-19T16:16:52.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f345ffff640 1 -- 172.21.15.119:0/3719909117 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656087421 0 0) 0x7f34680b0870 con 0x7f34680b0410 2023-12-19T16:16:52.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.853+0000 7f346d428640 1 --2- 172.21.15.119:0/3719909117 >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 0x7f34680cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:52.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346cc27640 1 --2- 172.21.15.119:0/3719909117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 0x7f34680afed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3458009870 tx=0x7f345801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e07b9f502667d0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:52.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f345ffff640 1 -- 172.21.15.119:0/3719909117 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580ab680 con 0x7f34680cdca0 2023-12-19T16:16:52.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f345ffff640 1 -- 172.21.15.119:0/3719909117 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34580ab7e0 con 0x7f34680cdca0 2023-12-19T16:16:52.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f345ffff640 1 -- 172.21.15.119:0/3719909117 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580abb70 con 0x7f34680cdca0 2023-12-19T16:16:52.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 -- 172.21.15.119:0/3719909117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 msgr2=0x7f34680afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 --2- 172.21.15.119:0/3719909117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 0x7f34680afed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3458009870 tx=0x7f345801c480 comp rx=0 tx=0).stop 2023-12-19T16:16:52.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 -- 172.21.15.119:0/3719909117 shutdown_connections 2023-12-19T16:16:52.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 --2- 172.21.15.119:0/3719909117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680cdca0 0x7f34680afed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 --2- 172.21.15.119:0/3719909117 >> v2:172.21.15.143:3300/0 conn(0x7f34680ad290 0x7f34680cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 -- 172.21.15.119:0/3719909117 >> 172.21.15.119:0/3719909117 conn(0x7f34680ce450 msgr2=0x7f34680ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:52.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 -- 172.21.15.119:0/3719909117 shutdown_connections 2023-12-19T16:16:52.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 -- 172.21.15.119:0/3719909117 wait complete. 2023-12-19T16:16:52.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.857+0000 7f346f68c640 1 Processor -- start 2023-12-19T16:16:52.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- start start 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680ad290 0x7f3468158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34680b0410 0x7f34681458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34680cdca0 0x7f346815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3468157110 con 0x7f34680b0410 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34681573f0 con 0x7f34680cdca0 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34681576d0 con 0x7f34680ad290 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34680b0410 0x7f34681458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346dc29640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34680cdca0 0x7f346815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346d428640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680ad290 0x7f3468158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346d428640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680ad290 0x7f3468158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:60224/0 (socket says 172.21.15.119:60224) 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346dc29640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34680cdca0 0x7f346815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:59612/0 (socket says 172.21.15.119:59612) 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346d428640 1 -- 172.21.15.119:0/1283742745 learned_addr learned my addr 172.21.15.119:0/1283742745 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 -- 172.21.15.119:0/1283742745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680ad290 msgr2=0x7f3468158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680ad290 0x7f3468158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 -- 172.21.15.119:0/1283742745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34680cdca0 msgr2=0x7f346815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34680cdca0 0x7f346815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 -- 172.21.15.119:0/1283742745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009420 con 0x7f34680b0410 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346cc27640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34680b0410 0x7f34681458f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f34580ac000 tx=0x7f3458019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580c0680 con 0x7f34680b0410 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34580b9070 con 0x7f34680b0410 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580c0a40 con 0x7f34680b0410 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34580094d0 con 0x7f34680b0410 2023-12-19T16:16:52.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3468157c90 con 0x7f34680b0410 2023-12-19T16:16:52.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.861+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3468066e70 con 0x7f34680b0410 2023-12-19T16:16:52.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.865+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34580c0ba0 con 0x7f34680b0410 2023-12-19T16:16:52.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.865+0000 7f345dffb640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f344c065a60 0x7f344c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:52.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.865+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34580bb070 con 0x7f34680b0410 2023-12-19T16:16:52.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.865+0000 7f346d428640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f344c065a60 0x7f344c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:52.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.865+0000 7f346d428640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f344c065a60 0x7f344c067f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3468072900 tx=0x7f3464009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:52.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:52.869+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34580ebc70 con 0x7f34680b0410 2023-12-19T16:16:53.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.069+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f346815ddf0 con 0x7f34680b0410 2023-12-19T16:16:53.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f345dffb640 1 -- 172.21.15.119:0/1283742745 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f34580ef290 con 0x7f34680b0410 2023-12-19T16:16:53.082 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f344c065a60 msgr2=0x7f344c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f344c065a60 0x7f344c067f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3468072900 tx=0x7f3464009190 comp rx=0 tx=0).stop 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34680b0410 msgr2=0x7f34681458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34680b0410 0x7f34681458f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f34580ac000 tx=0x7f3458019220 comp rx=0 tx=0).stop 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 shutdown_connections 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f344c065a60 0x7f344c067f20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34680cdca0 0x7f346815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34680b0410 0x7f34681458f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 --2- 172.21.15.119:0/1283742745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34680ad290 0x7f3468158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 >> 172.21.15.119:0/1283742745 conn(0x7f34680ce450 msgr2=0x7f3468070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:53.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 shutdown_connections 2023-12-19T16:16:53.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.077+0000 7f346f68c640 1 -- 172.21.15.119:0/1283742745 wait complete. 2023-12-19T16:16:53.106 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.237+0000 7f16fae11640 1 Processor -- start 2023-12-19T16:16:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.237+0000 7f16fae11640 1 -- start start 2023-12-19T16:16:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16fae11640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f16f415a680 0x7f16f415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16fae11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16f40cac10 0x7f16f415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16fae11640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f415f100 con 0x7f16f415afa0 2023-12-19T16:16:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16fae11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40ca7d0 con 0x7f16f40cac10 2023-12-19T16:16:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16fae11640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f415e860 con 0x7f16f415a680 2023-12-19T16:16:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16f40cac10 0x7f16f415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16f40cac10 0x7f16f415aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33924/0 (socket says 172.21.15.119:33924) 2023-12-19T16:16:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 -- 172.21.15.119:0/3474729822 learned_addr learned my addr 172.21.15.119:0/3474729822 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 -- 172.21.15.119:0/3474729822 >> v2:172.21.15.143:3300/0 conn(0x7f16f415a680 msgr2=0x7f16f415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16f8bad640 1 --2- 172.21.15.119:0/3474729822 >> v2:172.21.15.143:3300/0 conn(0x7f16f415a680 0x7f16f415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 --2- 172.21.15.119:0/3474729822 >> v2:172.21.15.143:3300/0 conn(0x7f16f415a680 0x7f16f415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 -- 172.21.15.119:0/3474729822 >> v1:172.21.15.143:6789/0 conn(0x7f16f415afa0 legacy=0x7f16f406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 -- 172.21.15.119:0/3474729822 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f415eb40 con 0x7f16f40cac10 2023-12-19T16:16:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16f8bad640 1 --2- 172.21.15.119:0/3474729822 >> v2:172.21.15.143:3300/0 conn(0x7f16f415a680 0x7f16f415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16ebfff640 1 --2- 172.21.15.119:0/3474729822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f40cac10 0x7f16f415aa60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009870 tx=0x7f16e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa91c48be5ef8e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.241+0000 7f16eb7fe640 1 -- 172.21.15.119:0/3474729822 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40a7070 con 0x7f16f40cac10 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16eb7fe640 1 -- 172.21.15.119:0/3474729822 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40ab430 con 0x7f16f40cac10 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16eb7fe640 1 -- 172.21.15.119:0/3474729822 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40ab7c0 con 0x7f16f40cac10 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- 172.21.15.119:0/3474729822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f40cac10 msgr2=0x7f16f415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 --2- 172.21.15.119:0/3474729822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f40cac10 0x7f16f415aa60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009870 tx=0x7f16e401c430 comp rx=0 tx=0).stop 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- 172.21.15.119:0/3474729822 shutdown_connections 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 --2- 172.21.15.119:0/3474729822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f40cac10 0x7f16f415aa60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 --2- 172.21.15.119:0/3474729822 >> v2:172.21.15.143:3300/0 conn(0x7f16f415a680 0x7f16f415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- 172.21.15.119:0/3474729822 >> 172.21.15.119:0/3474729822 conn(0x7f16f406a3e0 msgr2=0x7f16f40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- 172.21.15.119:0/3474729822 shutdown_connections 2023-12-19T16:16:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- 172.21.15.119:0/3474729822 wait complete. 2023-12-19T16:16:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 Processor -- start 2023-12-19T16:16:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- start start 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16f40cac10 0x7f16f40b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 0x7f16f4157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16f415afa0 0x7f16f40ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40b2dd0 con 0x7f16f415a680 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40b1ab0 con 0x7f16f415afa0 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16fae11640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40c1f30 con 0x7f16f40cac10 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16ebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 0x7f16f4157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16ebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 0x7f16f4157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33926/0 (socket says 172.21.15.119:33926) 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16ebfff640 1 -- 172.21.15.119:0/1295609754 learned_addr learned my addr 172.21.15.119:0/1295609754 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16f8bad640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16f40cac10 0x7f16f40b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.245+0000 7f16f93ae640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16f415afa0 0x7f16f40ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16ebfff640 1 -- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16f40cac10 msgr2=0x7f16f40b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16ebfff640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16f40cac10 0x7f16f40b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16ebfff640 1 -- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16f415afa0 msgr2=0x7f16f40ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16ebfff640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16f415afa0 0x7f16f40ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16ebfff640 1 -- 172.21.15.119:0/1295609754 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40094d0 con 0x7f16f415a680 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16f93ae640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16f415afa0 0x7f16f40ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16ebfff640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 0x7f16f4157860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f16e401a060 tx=0x7f16e40191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40ba070 con 0x7f16f415a680 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40b4630 con 0x7f16f415a680 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40b4a00 con 0x7f16f415a680 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f40c2210 con 0x7f16f415a680 2023-12-19T16:16:53.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f40b1d90 con 0x7f16f415a680 2023-12-19T16:16:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f40735b0 con 0x7f16f415a680 2023-12-19T16:16:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16e40b4b60 con 0x7f16f415a680 2023-12-19T16:16:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.249+0000 7f16e97fa640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f16e0065a60 0x7f16e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.253+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f16e411cc60 con 0x7f16f415a680 2023-12-19T16:16:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.253+0000 7f16f8bad640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f16e0065a60 0x7f16e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.253+0000 7f16f8bad640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f16e0065a60 0x7f16e0067f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f16f000ab60 tx=0x7f16f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:53.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.253+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16e40ea600 con 0x7f16f415a680 2023-12-19T16:16:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.433+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16f404e000 con 0x7f16f415a680 2023-12-19T16:16:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.433+0000 7f16e97fa640 1 -- 172.21.15.119:0/1295609754 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f16e40edc20 con 0x7f16f415a680 2023-12-19T16:16:53.441 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:53.441 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:46.726263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2023-12-19T16:16:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f16e0065a60 msgr2=0x7f16e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f16e0065a60 0x7f16e0067f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f16f000ab60 tx=0x7f16f0008040 comp rx=0 tx=0).stop 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 msgr2=0x7f16f4157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 0x7f16f4157860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f16e401a060 tx=0x7f16e40191d0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 shutdown_connections 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f16e0065a60 0x7f16e0067f20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16f415afa0 0x7f16f40ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f415a680 0x7f16f4157860 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 --2- 172.21.15.119:0/1295609754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16f40cac10 0x7f16f40b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 >> 172.21.15.119:0/1295609754 conn(0x7f16f406a3e0 msgr2=0x7f16f4159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 shutdown_connections 2023-12-19T16:16:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:53.437+0000 7f16fae11640 1 -- 172.21.15.119:0/1295609754 wait complete. 2023-12-19T16:16:53.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:16:43.714510+0000', 'modified': '2023-12-19T16:16:46.726263+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5490': {'gid': 5490, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6835/985218590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6833', 'nonce': 985218590}, {'type': 'v1', 'addr': '172.21.15.143:6835', 'nonce': 985218590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:16:53.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:16:53.865 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T16:16:54.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87dd5a6640 1 Processor -- start 2023-12-19T16:16:54.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87dd5a6640 1 -- start start 2023-12-19T16:16:54.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87dd5a6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87d81570c0 0x7f87d806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87dd5a6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80c9460 con 0x7f87d80ca000 2023-12-19T16:16:54.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87dd5a6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d81574a0 con 0x7f87d806c320 2023-12-19T16:16:54.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87dd5a6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d806c7a0 con 0x7f87d81570c0 2023-12-19T16:16:54.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d77fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f87d80ca000 0x7f87d8070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52556/0 (socket says 172.21.15.119:52556) 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d77fe640 1 -- 172.21.15.119:0/1369057899 learned_addr learned my addr 172.21.15.119:0/1369057899 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/1369057899 >> v2:172.21.15.143:3300/0 conn(0x7f87d81570c0 0x7f87d806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d67fc640 1 -- 172.21.15.119:0/1369057899 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476991949 0 0) 0x7f87d80c9460 con 0x7f87d80ca000 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d67fc640 1 -- 172.21.15.119:0/1369057899 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c4003530 con 0x7f87d80ca000 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1369057899 >> v1:172.21.15.143:6789/0 conn(0x7f87d806c320 legacy=0x7f87d80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d67fc640 1 -- 172.21.15.119:0/1369057899 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1686982858 0 0) 0x7f87c4003530 con 0x7f87d80ca000 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1369057899 >> v1:172.21.15.119:6789/0 conn(0x7f87d80ca000 legacy=0x7f87d8070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.001+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1369057899 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d80c8b30 con 0x7f87d81570c0 2023-12-19T16:16:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/1369057899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d81570c0 0x7f87d806bde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f87c80097c0 tx=0x7f87c801c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc381bb29e686f98 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87d67fc640 1 -- 172.21.15.119:0/1369057899 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0001a00 con 0x7f87d81570c0 2023-12-19T16:16:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87d67fc640 1 -- 172.21.15.119:0/1369057899 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c80a7050 con 0x7f87d81570c0 2023-12-19T16:16:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87d67fc640 1 -- 172.21.15.119:0/1369057899 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80ab600 con 0x7f87d81570c0 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 -- 172.21.15.119:0/1369057899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d81570c0 msgr2=0x7f87d806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/1369057899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d81570c0 0x7f87d806bde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f87c80097c0 tx=0x7f87c801c190 comp rx=0 tx=0).stop 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 -- 172.21.15.119:0/1369057899 shutdown_connections 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/1369057899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d81570c0 0x7f87d806bde0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 -- 172.21.15.119:0/1369057899 >> 172.21.15.119:0/1369057899 conn(0x7f87d806a3e0 msgr2=0x7f87d80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 -- 172.21.15.119:0/1369057899 shutdown_connections 2023-12-19T16:16:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.005+0000 7f87dd5a6640 1 -- 172.21.15.119:0/1369057899 wait complete. 2023-12-19T16:16:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 Processor -- start 2023-12-19T16:16:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 -- start start 2023-12-19T16:16:54.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d806c320 0x7f87d80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 0x7f87d814a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87d81570c0 0x7f87d814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80c4170 con 0x7f87d80ca000 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80c46a0 con 0x7f87d806c320 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80c43c0 con 0x7f87d81570c0 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 0x7f87d814a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 0x7f87d814a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33930/0 (socket says 172.21.15.119:33930) 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2100599644 learned_addr learned my addr 172.21.15.119:0/2100599644 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d806c320 0x7f87d80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87d77fe640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87d81570c0 0x7f87d814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87d81570c0 msgr2=0x7f87d814a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87d81570c0 0x7f87d814a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d806c320 msgr2=0x7f87d80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d806c320 0x7f87d80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2100599644 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8009420 con 0x7f87d80ca000 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87d77fe640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87d81570c0 0x7f87d814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 0x7f87d814a420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c780 tx=0x7f87c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87cffff640 1 -- 172.21.15.119:0/2100599644 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0005270 con 0x7f87d80ca000 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87cffff640 1 -- 172.21.15.119:0/2100599644 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c00053d0 con 0x7f87d80ca000 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87cffff640 1 -- 172.21.15.119:0/2100599644 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000a880 con 0x7f87d80ca000 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d80caef0 con 0x7f87d80ca000 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.009+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d80cb4b0 con 0x7f87d80ca000 2023-12-19T16:16:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87cffff640 1 -- 172.21.15.119:0/2100599644 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f87c000a9e0 con 0x7f87d80ca000 2023-12-19T16:16:54.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87cffff640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f87b8065a60 0x7f87b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87cffff640 1 -- 172.21.15.119:0/2100599644 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f87c0082ab0 con 0x7f87d80ca000 2023-12-19T16:16:54.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f87b8065a60 0x7f87b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87e090b000 1 Processor -- start 2023-12-19T16:16:54.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87e090b000 1 -- start start 2023-12-19T16:16:54.021 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.013+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f87b8065a60 0x7f87b8067f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f87c80ad000 tx=0x7f87c80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d58d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d542c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d366c90 con 0x55c49d58d070 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d398220 con 0x55c49d5431c0 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d3957f0 con 0x55c49d58d990 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d58d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d58d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33946/0 (socket says 172.21.15.119:33946) 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1071688132 learned_addr learned my addr 172.21.15.119:0/1071688132 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d542c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d77fe640 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 msgr2=0x55c49d542c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d542c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 msgr2=0x55c49d5435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 -- 172.21.15.119:0/1071688132 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c49d08d890 con 0x55c49d58d070 2023-12-19T16:16:54.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d77fe640 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:54.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d58d450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f87c8019dc0 tx=0x7f87c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae8803ee0d7051e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87ccff9640 1 -- 172.21.15.119:0/1071688132 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8003d70 con 0x55c49d58d070 2023-12-19T16:16:54.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87ccff9640 1 -- 172.21.15.119:0/1071688132 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c80c2440 con 0x55c49d58d070 2023-12-19T16:16:54.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87ccff9640 1 -- 172.21.15.119:0/1071688132 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80c27b0 con 0x55c49d58d070 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- 172.21.15.119:0/1071688132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 msgr2=0x55c49d58d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d58d450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f87c8019dc0 tx=0x7f87c8004740 comp rx=0 tx=0).stop 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- 172.21.15.119:0/1071688132 shutdown_connections 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d542c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 --2- 172.21.15.119:0/1071688132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d58d450 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- 172.21.15.119:0/1071688132 >> 172.21.15.119:0/1071688132 conn(0x55c49d549950 msgr2=0x55c49d541560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- 172.21.15.119:0/1071688132 shutdown_connections 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- 172.21.15.119:0/1071688132 wait complete. 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 -- start start 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.017+0000 7f87e090b000 1 Processor -- start 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d5431c0 0x55c49d548720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d070 0x55c49d54f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 0x55c49d54f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d3910e0 con 0x55c49d58d990 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d330310 con 0x55c49d58d070 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d34e770 con 0x55c49d5431c0 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 10 client.0 _ll_register_callbacks cb 0x55c49d52eb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 0x55c49d54f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 0x55c49d54f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33956/0 (socket says 172.21.15.119:33956) 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 -- 172.21.15.119:0/2511641836 learned_addr learned my addr 172.21.15.119:0/2511641836 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d070 0x55c49d54f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 -- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d5431c0 msgr2=0x55c49d548720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d5431c0 0x55c49d548720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d5431c0 0x55c49d548720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 -- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d070 msgr2=0x55c49d54f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d070 0x55c49d54f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 -- 172.21.15.119:0/2511641836 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d80c8b30 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d070 0x55c49d54f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d5431c0 0x55c49d548720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d77fe640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 0x55c49d54f5c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f87d0007160 tx=0x7f87d0007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1aca372b394869 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 1 -- 172.21.15.119:0/2511641836 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0004d80 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 1 -- 172.21.15.119:0/2511641836 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f87d000f4d0 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c49d360c10 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 1 -- 172.21.15.119:0/2511641836 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87d000f690 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 10 client.5673 fetch_fsmap learned FSMap version 17 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c49d356260 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 1 -- 172.21.15.119:0/2511641836 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c49d360c10 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 1 -- 172.21.15.119:0/2511641836 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f87d0012070 con 0x55c49d58d990 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 10 client.5673 fetch_fsmap finished waiting for FSMap version 17 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 10 client.5673 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:16:54.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 20 client.5673 populate_metadata read hostname 'smithi119' 2023-12-19T16:16:54.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5948d0 0x55c49d594cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 4 client.5673 mds_command: new command op to 5490 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:16:54.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 --> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c49d38fa30 con 0x55c49d5948d0 2023-12-19T16:16:54.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5948d0 0x55c49d594cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5948d0 0x55c49d594cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4db0275399451b4 server_cookie=f34c161943513b92 in_seq=0 out_seq=0 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 10 client.5673 ms_handle_connect on v2:172.21.15.143:6833/985218590 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 1 -- 172.21.15.119:0/2511641836 <== mds.0 v2:172.21.15.143:6833/985218590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c49d38fa30 con 0x55c49d5948d0 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.021+0000 7f87b5ffb640 10 client.5673 handle_command_reply: tid=0 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 client.5673 shutdown 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 msgr2=0x55c49d54f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 0x55c49d54f5c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f87d0007160 tx=0x7f87d0007620 comp rx=0 tx=0).stop 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 shutdown_connections 2023-12-19T16:16:54.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5948d0 0x55c49d594cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d070 0x55c49d54f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87b5ffb640 0 client.5673 ms_handle_reset on v2:172.21.15.143:6833/985218590 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d990 0x55c49d54f5c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 --2- 172.21.15.119:0/2511641836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d5431c0 0x55c49d548720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 >> 172.21.15.119:0/2511641836 conn(0x55c49d549950 msgr2=0x55c49d541c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 shutdown_connections 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 1 -- 172.21.15.119:0/2511641836 wait complete. 2023-12-19T16:16:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.025+0000 7f87e090b000 20 client.5673 trim_cache size 0 max 16384 2023-12-19T16:16:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 Processor -- start 2023-12-19T16:16:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 -- start start 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5e9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d5e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d5e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d04e940 con 0x55c49d58d070 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d461b30 con 0x55c49d5431c0 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.037+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d545d70 con 0x55c49d58d990 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d5e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d5e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33968/0 (socket says 172.21.15.119:33968) 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2996222818 learned_addr learned my addr 172.21.15.119:0/2996222818 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2996222818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 msgr2=0x55c49d5e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d5e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2996222818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 msgr2=0x55c49d5e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 -- 172.21.15.119:0/2996222818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c49d33c3b0 con 0x55c49d58d070 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d5e9870 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f87c0050450 tx=0x7f87c00012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab112511b8ef6838 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87cd7fa640 1 -- 172.21.15.119:0/2996222818 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c005bf30 con 0x55c49d58d070 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87cd7fa640 1 -- 172.21.15.119:0/2996222818 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c00522f0 con 0x55c49d58d070 2023-12-19T16:16:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87cd7fa640 1 -- 172.21.15.119:0/2996222818 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000ac90 con 0x55c49d58d070 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- 172.21.15.119:0/2996222818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 msgr2=0x55c49d5e9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d5e9870 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f87c0050450 tx=0x7f87c00012c0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- 172.21.15.119:0/2996222818 shutdown_connections 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d990 0x55c49d5e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d58d070 0x55c49d5e9870 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- 172.21.15.119:0/2996222818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d5431c0 0x55c49d5e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- 172.21.15.119:0/2996222818 >> 172.21.15.119:0/2996222818 conn(0x55c49d549950 msgr2=0x55c49d54ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- 172.21.15.119:0/2996222818 shutdown_connections 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- 172.21.15.119:0/2996222818 wait complete. 2023-12-19T16:16:54.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- start start 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 Processor -- start 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 0x55c49d5ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d070 0x55c49d5eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d990 0x55c49d5d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d393c40 con 0x55c49d5431c0 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d339860 con 0x55c49d58d990 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d336570 con 0x55c49d58d070 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87e090b000 10 client.0 _ll_register_callbacks cb 0x55c49d33f640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 0x55c49d5ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 0x55c49d5ee980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33976/0 (socket says 172.21.15.119:33976) 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 -- 172.21.15.119:0/3624510090 learned_addr learned my addr 172.21.15.119:0/3624510090 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d070 0x55c49d5eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d77fe640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d990 0x55c49d5d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 -- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d070 msgr2=0x55c49d5eeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d070 0x55c49d5eeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 -- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d990 msgr2=0x55c49d5d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d990 0x55c49d5d54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.041+0000 7f87d6ffd640 1 -- 172.21.15.119:0/3624510090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d80cb4b0 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87d6ffd640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 0x55c49d5ee980 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b9040 tx=0x7f87c801a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32316aac4bdfd226 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 1 -- 172.21.15.119:0/3624510090 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80d4450 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 1 -- 172.21.15.119:0/3624510090 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f87c80d0040 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c49d356e00 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 1 -- 172.21.15.119:0/3624510090 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87c8003af0 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 10 client.5679 fetch_fsmap learned FSMap version 17 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c49d08dcc0 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 1 -- 172.21.15.119:0/3624510090 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c49d356e00 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 1 -- 172.21.15.119:0/3624510090 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f87c80bf050 con 0x55c49d5431c0 2023-12-19T16:16:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 10 client.5679 fetch_fsmap finished waiting for FSMap version 17 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 10 client.5679 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 20 client.5679 populate_metadata read hostname 'smithi119' 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5d5a20 0x55c49d5d5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 4 client.5679 mds_command: new command op to 5490 tid=0[{"prefix": "status"}] 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 --> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c49d38a160 con 0x55c49d5d5a20 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5d5a20 0x55c49d5d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 10 client.5679 ms_handle_connect on v2:172.21.15.143:6833/985218590 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87ce7fc640 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5d5a20 0x55c49d5d5e00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a13b689a01dcb7b server_cookie=425ac42fa0a24ee4 in_seq=0 out_seq=0 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 1 -- 172.21.15.119:0/3624510090 <== mds.0 v2:172.21.15.143:6833/985218590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c49d38a160 con 0x55c49d5d5a20 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 10 client.5679 handle_command_reply: tid=0 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 client.5679 shutdown 2023-12-19T16:16:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 msgr2=0x55c49d5ee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 0x55c49d5ee980 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b9040 tx=0x7f87c801a9d0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 shutdown_connections 2023-12-19T16:16:54.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:6833/985218590,v1:172.21.15.143:6835/985218590] conn(0x55c49d5d5a20 0x55c49d5d5e00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c49d58d990 0x55c49d5d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c49d58d070 0x55c49d5eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 --2- 172.21.15.119:0/3624510090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c49d5431c0 0x55c49d5ee980 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87b5ffb640 0 client.5679 ms_handle_reset on v2:172.21.15.143:6833/985218590 2023-12-19T16:16:54.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 >> 172.21.15.119:0/3624510090 conn(0x55c49d549950 msgr2=0x55c49d588050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 shutdown_connections 2023-12-19T16:16:54.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 1 -- 172.21.15.119:0/3624510090 wait complete. 2023-12-19T16:16:54.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87e090b000 20 client.5679 trim_cache size 0 max 16384 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "95401411-8d68-4720-80be-89deeb6bcc32", 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5490, 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2023-12-19T16:16:54.058 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2023-12-19T16:16:54.059 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 10.33301097, 2023-12-19T16:16:54.059 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 17, 2023-12-19T16:16:54.059 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 39, 2023-12-19T16:16:54.059 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 39, 2023-12-19T16:16:54.059 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 17.068676203999999 2023-12-19T16:16:54.059 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:16:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f87b8065a60 msgr2=0x7f87b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f87b8065a60 0x7f87b8067f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f87c80ad000 tx=0x7f87c80a6000 comp rx=0 tx=0).stop 2023-12-19T16:16:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 msgr2=0x7f87d814a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 0x7f87d814a420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c780 tx=0x7f87c000cc40 comp rx=0 tx=0).stop 2023-12-19T16:16:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 shutdown_connections 2023-12-19T16:16:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f87b8065a60 0x7f87b8067f20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87d81570c0 0x7f87d814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87d80ca000 0x7f87d814a420 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 --2- 172.21.15.119:0/2100599644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87d806c320 0x7f87d80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 >> 172.21.15.119:0/2100599644 conn(0x7f87d806a3e0 msgr2=0x7f87d8158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 shutdown_connections 2023-12-19T16:16:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.045+0000 7f87dd5a6640 1 -- 172.21.15.119:0/2100599644 wait complete. 2023-12-19T16:16:54.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:16:54.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe59bc41640 1 Processor -- start 2023-12-19T16:16:54.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe59bc41640 1 -- start start 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe59bc41640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5940cf760 0x7fe5940b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe59bc41640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940d02c0 con 0x7fe59415fe70 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe59bc41640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940cdf70 con 0x7fe5940cd290 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe59bc41640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940b38b0 con 0x7fe5940cf760 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5999dd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe59415fe70 0x7fe5940cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52572/0 (socket says 172.21.15.119:52572) 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5999dd640 1 -- 172.21.15.119:0/1593375599 learned_addr learned my addr 172.21.15.119:0/1593375599 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5991dc640 1 --2- 172.21.15.119:0/1593375599 >> v2:172.21.15.143:3300/0 conn(0x7fe5940cf760 0x7fe5940b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270393915 0 0) 0x7fe5940d02c0 con 0x7fe59415fe70 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe580003530 con 0x7fe59415fe70 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1844132012 0 0) 0x7fe580003530 con 0x7fe59415fe70 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 >> v2:172.21.15.143:3300/0 conn(0x7fe5940cf760 msgr2=0x7fe5940b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 --2- 172.21.15.119:0/1593375599 >> v2:172.21.15.143:3300/0 conn(0x7fe5940cf760 0x7fe5940b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 >> v1:172.21.15.143:6789/0 conn(0x7fe5940cd290 legacy=0x7fe5940cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.205+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940ce250 con 0x7fe59415fe70 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fe590001680 con 0x7fe59415fe70 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 >> v1:172.21.15.119:6789/0 conn(0x7fe59415fe70 legacy=0x7fe5940cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe580003980 0x7fe580003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5800047d0 0x7fe580004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580005190 0x7fe58000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940b38b0 con 0x7fe580003980 2023-12-19T16:16:54.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58000c130 con 0x7fe5800047d0 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58000c2f0 con 0x7fe580005190 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe580003980 0x7fe580003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5991dc640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5800047d0 0x7fe580004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe59a1de640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580005190 0x7fe58000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 -- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580005190 msgr2=0x7fe58000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580005190 0x7fe58000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 -- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5800047d0 msgr2=0x7fe580004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5800047d0 0x7fe580004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 -- 172.21.15.119:0/1593375599 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580003530 con 0x7fe580003980 2023-12-19T16:16:54.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe59a1de640 1 -- 172.21.15.119:0/1593375599 reap_dead start 2023-12-19T16:16:54.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe580003980 0x7fe580003da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c240 tx=0x7fe59001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf6acb3a5cc76a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900a5af0 con 0x7fe580003980 2023-12-19T16:16:54.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5900a5c50 con 0x7fe580003980 2023-12-19T16:16:54.217 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.209+0000 7fe5989db640 1 -- 172.21.15.119:0/1593375599 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590005b20 con 0x7fe580003980 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- 172.21.15.119:0/1593375599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe580003980 msgr2=0x7fe580003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe580003980 0x7fe580003da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c240 tx=0x7fe59001cc10 comp rx=0 tx=0).stop 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- 172.21.15.119:0/1593375599 shutdown_connections 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1593375599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe580003980 0x7fe580003da0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- 172.21.15.119:0/1593375599 >> 172.21.15.119:0/1593375599 conn(0x7fe59409ba60 msgr2=0x7fe5940d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- 172.21.15.119:0/1593375599 shutdown_connections 2023-12-19T16:16:54.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- 172.21.15.119:0/1593375599 wait complete. 2023-12-19T16:16:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 Processor -- start 2023-12-19T16:16:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- start start 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580003980 0x7fe5940c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5941f8c40 0x7fe5941f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 0x7fe5940c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5941f9600 con 0x7fe5940c68c0 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c9540 con 0x7fe5941f8c40 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59bc41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940cab60 con 0x7fe580003980 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59a1de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 0x7fe5940c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59a1de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 0x7fe5940c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34004/0 (socket says 172.21.15.119:34004) 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe59a1de640 1 -- 172.21.15.119:0/1809441628 learned_addr learned my addr 172.21.15.119:0/1809441628 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580003980 0x7fe5940c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.213+0000 7fe5991dc640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5941f8c40 0x7fe5941f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59a1de640 1 -- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580003980 msgr2=0x7fe5940c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59a1de640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580003980 0x7fe5940c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59a1de640 1 -- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5941f8c40 msgr2=0x7fe5941f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59a1de640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5941f8c40 0x7fe5941f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59a1de640 1 -- 172.21.15.119:0/1809441628 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940cae40 con 0x7fe5940c68c0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe5991dc640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5941f8c40 0x7fe5941f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59a1de640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 0x7fe5940c6d40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe5940b52e0 tx=0x7fe58c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00eed0 con 0x7fe5940c68c0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c003980 con 0x7fe5940c68c0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c003d50 con 0x7fe5940c68c0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940cb120 con 0x7fe5940c68c0 2023-12-19T16:16:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940cb6e0 con 0x7fe5940c68c0 2023-12-19T16:16:54.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59404e000 con 0x7fe5940c68c0 2023-12-19T16:16:54.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe58c0050d0 con 0x7fe5940c68c0 2023-12-19T16:16:54.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe58a7fc640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe578065a90 0x7fe578067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:54.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe58c082f90 con 0x7fe5940c68c0 2023-12-19T16:16:54.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.217+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe578065a90 0x7fe578067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:54.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.221+0000 7fe5999dd640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe578065a90 0x7fe578067f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe5900ab000 tx=0x7fe590006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:54.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.221+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe58c0508a0 con 0x7fe5940c68c0 2023-12-19T16:16:54.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.405+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe59406c320 con 0x7fe5940c68c0 2023-12-19T16:16:54.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe58a7fc640 1 -- 172.21.15.119:0/1809441628 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe58c053ec0 con 0x7fe5940c68c0 2023-12-19T16:16:54.414 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:16:54.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe578065a90 msgr2=0x7fe578067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe578065a90 0x7fe578067f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe5900ab000 tx=0x7fe590006040 comp rx=0 tx=0).stop 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 msgr2=0x7fe5940c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 0x7fe5940c6d40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe5940b52e0 tx=0x7fe58c00eb90 comp rx=0 tx=0).stop 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 shutdown_connections 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe578065a90 0x7fe578067f50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5941f8c40 0x7fe5941f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5940c68c0 0x7fe5940c6d40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 --2- 172.21.15.119:0/1809441628 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe580003980 0x7fe5940c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:54.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 >> 172.21.15.119:0/1809441628 conn(0x7fe59409ba60 msgr2=0x7fe59406c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:54.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 shutdown_connections 2023-12-19T16:16:54.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:54.409+0000 7fe59bc41640 1 -- 172.21.15.119:0/1809441628 wait complete. 2023-12-19T16:16:54.434 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:16:54.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:16:54.435 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:16:54.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.435 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42344sec preferred_lft 42344sec 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:16:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:54.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.448 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:16:54.511 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:16:54.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.513 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:16:54.572 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:16:54.572 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:16:54.572 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:16:54.572 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:16:54.572 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:16:54.572 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:16:54.573 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:54.573 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:54.573 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:54.573 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:16:54.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.573 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:16:54.573 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:16:54.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:16:54.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:16:54.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:16:54.573 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:16:54.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.663 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:16:54.672 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:16:54.672 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:16:54.673 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:16:54.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.673 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:16:54.741 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:16:54.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:54.741 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:54.789 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:16:54.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:54.789 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:54.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:16:54.905 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:54.906 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:54.967 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:54.969 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:54.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.969 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:16:55.021 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:16:55.021 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:16:55.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:16:55.089 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:55.089 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:55.153 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:55.154 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:55.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:55.154 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:16:55.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:16:55.157+0000 7f784684d580 -1 init, newargv = 0x55655ca02ed0 newargc=15 2023-12-19T16:16:55.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[49707]: starting ceph client 2023-12-19T16:16:55.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[49707]: starting fuse 2023-12-19T16:16:56.273 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:16:56.297 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:16:56.297 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:16:56.365 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:16:56.366 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:16:56.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:56.367 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:16:56.417 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:16:56.418 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:16:56.418 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:16:56.419 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:16:56.544 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.49707.asok 2023-12-19T16:16:56.729 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49707.asok 2023-12-19T16:16:56.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:56.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49707.asok status 2023-12-19T16:16:56.902 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "49707", 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:56.903 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5691, 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5691 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 486507453 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:16:56.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 486507453 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5691 192.168.0.1:0/486507453", 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/486507453", 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 17, 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 39, 2023-12-19T16:16:56.905 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:16:56.906 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:16:56.906 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:16:56.906 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:16:56.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:56.918 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:16:56.918 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:16:56.928 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:56.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:56.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:56.990 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-12-19T16:16:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.169+0000 7fd8bb0fc640 1 Processor -- start 2023-12-19T16:16:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.169+0000 7fd8bb0fc640 1 -- start start 2023-12-19T16:16:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8bb0fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8b406d8a0 0x7fd8b40ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8bb0fc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40b28a0 con 0x7fd8b406d440 2023-12-19T16:16:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8bb0fc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b415ab30 con 0x7fd8b40ce5d0 2023-12-19T16:16:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8bb0fc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b406dcf0 con 0x7fd8b406d8a0 2023-12-19T16:16:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8b9699640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8b406d8a0 0x7fd8b40ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8b9699640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8b406d8a0 0x7fd8b40ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34016/0 (socket says 172.21.15.119:34016) 2023-12-19T16:16:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8b9699640 1 -- 172.21.15.119:0/3110248246 learned_addr learned my addr 172.21.15.119:0/3110248246 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8b9699640 1 -- 172.21.15.119:0/3110248246 >> v1:172.21.15.143:6789/0 conn(0x7fd8b40ce5d0 legacy=0x7fd8b40ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8b9699640 1 -- 172.21.15.119:0/3110248246 >> v1:172.21.15.119:6789/0 conn(0x7fd8b406d440 legacy=0x7fd8b40ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8b9699640 1 -- 172.21.15.119:0/3110248246 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40b1c90 con 0x7fd8b406d8a0 2023-12-19T16:16:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.173+0000 7fd8ab7fe640 1 -- 172.21.15.119:0/3110248246 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427613797 0 0) 0x7fd8b40b28a0 con 0x7fd8b406d440 2023-12-19T16:16:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8b9699640 1 --2- 172.21.15.119:0/3110248246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d8a0 0x7fd8b40ab8a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009e50 tx=0x7fd8ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce1e1c7afd55d90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8ab7fe640 1 -- 172.21.15.119:0/3110248246 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0a5770 con 0x7fd8b406d8a0 2023-12-19T16:16:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8ab7fe640 1 -- 172.21.15.119:0/3110248246 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac0a58d0 con 0x7fd8b406d8a0 2023-12-19T16:16:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8ab7fe640 1 -- 172.21.15.119:0/3110248246 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0a5c60 con 0x7fd8b406d8a0 2023-12-19T16:16:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3110248246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d8a0 msgr2=0x7fd8b40ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3110248246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d8a0 0x7fd8b40ab8a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009e50 tx=0x7fd8ac01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3110248246 shutdown_connections 2023-12-19T16:16:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3110248246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d8a0 0x7fd8b40ab8a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3110248246 >> 172.21.15.119:0/3110248246 conn(0x7fd8b4069e70 msgr2=0x7fd8b406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3110248246 shutdown_connections 2023-12-19T16:16:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3110248246 wait complete. 2023-12-19T16:16:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 Processor -- start 2023-12-19T16:16:57.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- start start 2023-12-19T16:16:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 0x7fd8b40ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8b406d8a0 0x7fd8b4156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8b40ce5d0 0x7fd8b40c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40af260 con 0x7fd8b406d440 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ae670 con 0x7fd8b40ce5d0 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8bb0fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ae950 con 0x7fd8b406d8a0 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.177+0000 7fd8b8e98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 0x7fd8b40ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 0x7fd8b40ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34024/0 (socket says 172.21.15.119:34024) 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 -- 172.21.15.119:0/3776459523 learned_addr learned my addr 172.21.15.119:0/3776459523 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b9699640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8b40ce5d0 0x7fd8b40c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8abfff640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8b406d8a0 0x7fd8b4156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 -- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8b406d8a0 msgr2=0x7fd8b4156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8b406d8a0 0x7fd8b4156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 -- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8b40ce5d0 msgr2=0x7fd8b40c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8b40ce5d0 0x7fd8b40c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 -- 172.21.15.119:0/3776459523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac009b30 con 0x7fd8b406d440 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8abfff640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8b406d8a0 0x7fd8b4156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8b8e98640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 0x7fd8b40ade20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c450 tx=0x7fd8b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0012830 con 0x7fd8b406d440 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b00129b0 con 0x7fd8b406d440 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b40b2eb0 con 0x7fd8b406d440 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0012d60 con 0x7fd8b406d440 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b40ae360 con 0x7fd8b406d440 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40b2d10 con 0x7fd8b406d440 2023-12-19T16:16:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8b001c460 con 0x7fd8b406d440 2023-12-19T16:16:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8a97fa640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd8a0065a60 0x7fd8a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd8b00831d0 con 0x7fd8b406d440 2023-12-19T16:16:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.181+0000 7fd8abfff640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd8a0065a60 0x7fd8a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.185+0000 7fd8abfff640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd8a0065a60 0x7fd8a0067f20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40add00 tx=0x7fd8a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:57.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.185+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd8b40b2d10 con 0x7fd8b406d440 2023-12-19T16:16:57.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:57.341+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fd8b40b2d10 con 0x7fd8b406d440 2023-12-19T16:16:58.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.201+0000 7fd8a97fa640 1 -- 172.21.15.119:0/3776459523 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v40) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd8b40b2d10 con 0x7fd8b406d440 2023-12-19T16:16:58.207 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'data_new' created 2023-12-19T16:16:58.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd8a0065a60 msgr2=0x7fd8a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd8a0065a60 0x7fd8a0067f20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40add00 tx=0x7fd8a4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:58.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 msgr2=0x7fd8b40ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 0x7fd8b40ade20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c450 tx=0x7fd8b000c910 comp rx=0 tx=0).stop 2023-12-19T16:16:58.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 shutdown_connections 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd8a0065a60 0x7fd8a0067f20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8b40ce5d0 0x7fd8b40c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8b406d8a0 0x7fd8b4156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 --2- 172.21.15.119:0/3776459523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b406d440 0x7fd8b40ade20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 >> 172.21.15.119:0/3776459523 conn(0x7fd8b4069e70 msgr2=0x7fd8b4159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 shutdown_connections 2023-12-19T16:16:58.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.205+0000 7fd8bb0fc640 1 -- 172.21.15.119:0/3776459523 wait complete. 2023-12-19T16:16:58.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-12-19T16:16:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 Processor -- start 2023-12-19T16:16:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 -- start start 2023-12-19T16:16:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb1c15c690 0x7ffb1c0d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15ca70 0x7ffb1c0d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb1c0b1320 0x7ffb1c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c0b1c20 con 0x7ffb1c0b1320 2023-12-19T16:16:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c0d15c0 con 0x7ffb1c15c690 2023-12-19T16:16:58.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb209be640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0d17c0 con 0x7ffb1c15ca70 2023-12-19T16:16:58.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb1c0b1320 0x7ffb1c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb1c0b1320 0x7ffb1c0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34034/0 (socket says 172.21.15.119:34034) 2023-12-19T16:16:58.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 -- 172.21.15.119:0/902323238 learned_addr learned my addr 172.21.15.119:0/902323238 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:58.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1b7fe640 1 --2- 172.21.15.119:0/902323238 >> v2:172.21.15.143:3300/0 conn(0x7ffb1c15c690 0x7ffb1c0d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb13fff640 1 --2- 172.21.15.119:0/902323238 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15ca70 0x7ffb1c0d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 -- 172.21.15.119:0/902323238 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15ca70 msgr2=0x7ffb1c0d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 --2- 172.21.15.119:0/902323238 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15ca70 0x7ffb1c0d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 -- 172.21.15.119:0/902323238 >> v2:172.21.15.143:3300/0 conn(0x7ffb1c15c690 msgr2=0x7ffb1c0d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 --2- 172.21.15.119:0/902323238 >> v2:172.21.15.143:3300/0 conn(0x7ffb1c15c690 0x7ffb1c0d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.377+0000 7ffb1bfff640 1 -- 172.21.15.119:0/902323238 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0d1cb0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb1bfff640 1 --2- 172.21.15.119:0/902323238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c0cce10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cfe70 tx=0x7ffb1401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ed537cde5631f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:58.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb1affd640 1 -- 172.21.15.119:0/902323238 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140af400 con 0x7ffb1c0b1320 2023-12-19T16:16:58.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb1affd640 1 -- 172.21.15.119:0/902323238 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140ab050 con 0x7ffb1c0b1320 2023-12-19T16:16:58.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb1affd640 1 -- 172.21.15.119:0/902323238 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140af780 con 0x7ffb1c0b1320 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 -- 172.21.15.119:0/902323238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 msgr2=0x7ffb1c0cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 --2- 172.21.15.119:0/902323238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c0cce10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cfe70 tx=0x7ffb1401f1c0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 -- 172.21.15.119:0/902323238 shutdown_connections 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 --2- 172.21.15.119:0/902323238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c0cce10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 --2- 172.21.15.119:0/902323238 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15ca70 0x7ffb1c0d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 --2- 172.21.15.119:0/902323238 >> v2:172.21.15.143:3300/0 conn(0x7ffb1c15c690 0x7ffb1c0d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 -- 172.21.15.119:0/902323238 >> 172.21.15.119:0/902323238 conn(0x7ffb1c0717d0 msgr2=0x7ffb1c071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 -- 172.21.15.119:0/902323238 shutdown_connections 2023-12-19T16:16:58.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.381+0000 7ffb209be640 1 -- 172.21.15.119:0/902323238 wait complete. 2023-12-19T16:16:58.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 Processor -- start 2023-12-19T16:16:58.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- start start 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15c690 0x7ffb1c1f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1c15ca70 0x7ffb1c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c15b2e0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c15ad40 con 0x7ffb1c15ca70 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c15b000 con 0x7ffb1c15c690 2023-12-19T16:16:58.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34036/0 (socket says 172.21.15.119:34036) 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 -- 172.21.15.119:0/943655253 learned_addr learned my addr 172.21.15.119:0/943655253 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1bfff640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1c15ca70 0x7ffb1c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb13fff640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15c690 0x7ffb1c1f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 -- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15c690 msgr2=0x7ffb1c1f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15c690 0x7ffb1c1f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 -- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1c15ca70 msgr2=0x7ffb1c0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1c15ca70 0x7ffb1c0c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 -- 172.21.15.119:0/943655253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009b30 con 0x7ffb1c0b1320 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb1b7fe640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c158cc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00d800 tx=0x7ffb0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00b6c0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c00b820 con 0x7ffb1c0b1320 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00bb90 con 0x7ffb1c0b1320 2023-12-19T16:16:58.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c0ca3c0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c0cabc0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.385+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c0ca200 con 0x7ffb1c0b1320 2023-12-19T16:16:58.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.389+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb0c00bcf0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.389+0000 7ffb18ff9640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffafc065a60 0x7ffafc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.389+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6392+0+0 (secure 0 0 0) 0x7ffb0c0842b0 con 0x7ffb1c0b1320 2023-12-19T16:16:58.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.389+0000 7ffb13fff640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffafc065a60 0x7ffafc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.389+0000 7ffb13fff640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffafc065a60 0x7ffafc067f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cc460 tx=0x7ffb04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:58.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.393+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb0c051b50 con 0x7ffb1c0b1320 2023-12-19T16:16:58.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.581+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7ffb1c04e000 con 0x7ffb1c0b1320 2023-12-19T16:16:58.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.585+0000 7ffb18ff9640 1 -- 172.21.15.119:0/943655253 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v18) v1 ==== 131+0+0 (secure 0 0 0) 0x7ffb0c055170 con 0x7ffb1c0b1320 2023-12-19T16:16:58.593 INFO:teuthology.orchestra.run.smithi119.stderr:added data pool 7 to fsmap 2023-12-19T16:16:58.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.589+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffafc065a60 msgr2=0x7ffafc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.589+0000 7ffb209be640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffafc065a60 0x7ffafc067f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cc460 tx=0x7ffb04008040 comp rx=0 tx=0).stop 2023-12-19T16:16:58.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.589+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 msgr2=0x7ffb1c158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.589+0000 7ffb209be640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c158cc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00d800 tx=0x7ffb0c00dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 shutdown_connections 2023-12-19T16:16:58.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffafc065a60 0x7ffafc067f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1c15ca70 0x7ffb1c0c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1c15c690 0x7ffb1c1f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 --2- 172.21.15.119:0/943655253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb1c0b1320 0x7ffb1c158cc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 >> 172.21.15.119:0/943655253 conn(0x7ffb1c0717d0 msgr2=0x7ffb1c0c58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:58.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 shutdown_connections 2023-12-19T16:16:58.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.593+0000 7ffb209be640 1 -- 172.21.15.119:0/943655253 wait complete. 2023-12-19T16:16:58.626 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:58.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.757+0000 7f5e8998f640 1 Processor -- start 2023-12-19T16:16:58.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.757+0000 7f5e8998f640 1 -- start start 2023-12-19T16:16:58.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e8998f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e8406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e8998f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e8406c320 0x7f5e840c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e8998f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e840c9460 con 0x7f5e840c9e30 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e8998f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8406c7a0 con 0x7f5e8406c320 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e8998f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841574a0 con 0x7f5e841570c0 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e8406c320 0x7f5e840c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e8406c320 0x7f5e840c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34048/0 (socket says 172.21.15.119:34048) 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 -- 172.21.15.119:0/1146540643 learned_addr learned my addr 172.21.15.119:0/1146540643 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e837fe640 1 --1- 172.21.15.119:0/1146540643 >> v1:172.21.15.119:6789/0 conn(0x7f5e840c9e30 0x7f5e8415d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52596/0 (socket says 172.21.15.119:52596) 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e82ffd640 1 --2- 172.21.15.119:0/1146540643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e8406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 -- 172.21.15.119:0/1146540643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 msgr2=0x7f5e8406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 --2- 172.21.15.119:0/1146540643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e8406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 -- 172.21.15.119:0/1146540643 >> v1:172.21.15.119:6789/0 conn(0x7f5e840c9e30 legacy=0x7f5e8415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e827fc640 1 -- 172.21.15.119:0/1146540643 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840c8b30 con 0x7f5e8406c320 2023-12-19T16:16:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.761+0000 7f5e81ffb640 1 -- 172.21.15.119:0/1146540643 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814760448 0 0) 0x7f5e840c9460 con 0x7f5e840c9e30 2023-12-19T16:16:58.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e827fc640 1 --2- 172.21.15.119:0/1146540643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e840c98f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800bb10 tx=0x7f5e7801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e47ef5d9048abe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:58.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e81ffb640 1 -- 172.21.15.119:0/1146540643 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780a7b30 con 0x7f5e8406c320 2023-12-19T16:16:58.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e81ffb640 1 -- 172.21.15.119:0/1146540643 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e780a7c90 con 0x7f5e8406c320 2023-12-19T16:16:58.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e81ffb640 1 -- 172.21.15.119:0/1146540643 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780af440 con 0x7f5e8406c320 2023-12-19T16:16:58.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 -- 172.21.15.119:0/1146540643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 msgr2=0x7f5e840c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 --2- 172.21.15.119:0/1146540643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e840c98f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800bb10 tx=0x7f5e7801eb50 comp rx=0 tx=0).stop 2023-12-19T16:16:58.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 -- 172.21.15.119:0/1146540643 shutdown_connections 2023-12-19T16:16:58.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 --2- 172.21.15.119:0/1146540643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e840c98f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 --2- 172.21.15.119:0/1146540643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e8406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 -- 172.21.15.119:0/1146540643 >> 172.21.15.119:0/1146540643 conn(0x7f5e8406a3e0 msgr2=0x7f5e840afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:58.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 -- 172.21.15.119:0/1146540643 shutdown_connections 2023-12-19T16:16:58.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 -- 172.21.15.119:0/1146540643 wait complete. 2023-12-19T16:16:58.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 Processor -- start 2023-12-19T16:16:58.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.765+0000 7f5e8998f640 1 -- start start 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e84157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e840c9e30 0x7f5e84154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e840a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841588f0 con 0x7f5e8406c320 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84158ee0 con 0x7f5e840c9e30 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84159180 con 0x7f5e841570c0 2023-12-19T16:16:58.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e84157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e84157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34052/0 (socket says 172.21.15.119:34052) 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 -- 172.21.15.119:0/3022931880 learned_addr learned my addr 172.21.15.119:0/3022931880 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e827fc640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e840c9e30 0x7f5e84154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e837fe640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e840a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 -- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 msgr2=0x7f5e840a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e840a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 -- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e840c9e30 msgr2=0x7f5e84154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e840c9e30 0x7f5e84154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 -- 172.21.15.119:0/3022931880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7800b770 con 0x7f5e8406c320 2023-12-19T16:16:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e82ffd640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e84157ff0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400e870 tx=0x7f5e7400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:58.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74009510 con 0x7f5e8406c320 2023-12-19T16:16:58.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400eec0 con 0x7f5e8406c320 2023-12-19T16:16:58.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400cb40 con 0x7f5e8406c320 2023-12-19T16:16:58.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84159460 con 0x7f5e8406c320 2023-12-19T16:16:58.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e84158530 con 0x7f5e8406c320 2023-12-19T16:16:58.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840735b0 con 0x7f5e8406c320 2023-12-19T16:16:58.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.769+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5e7400cca0 con 0x7f5e8406c320 2023-12-19T16:16:58.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.773+0000 7f5e6bfff640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5e70065a60 0x7f5e70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:58.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.773+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f5e74083500 con 0x7f5e8406c320 2023-12-19T16:16:58.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.773+0000 7f5e827fc640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5e70065a60 0x7f5e70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:58.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.773+0000 7f5e827fc640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5e70065a60 0x7f5e70067f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e780b1000 tx=0x7f5e780a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:58.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.777+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5e74050c10 con 0x7f5e8406c320 2023-12-19T16:16:58.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.957+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e8404e000 con 0x7f5e8406c320 2023-12-19T16:16:58.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.957+0000 7f5e6bfff640 1 -- 172.21.15.119:0/3022931880 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f5e74054230 con 0x7f5e8406c320 2023-12-19T16:16:58.965 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:58.965 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:58.585749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:58.965 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5e70065a60 msgr2=0x7f5e70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5e70065a60 0x7f5e70067f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e780b1000 tx=0x7f5e780a9070 comp rx=0 tx=0).stop 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 msgr2=0x7f5e84157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e84157ff0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400e870 tx=0x7f5e7400ec70 comp rx=0 tx=0).stop 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 shutdown_connections 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5e70065a60 0x7f5e70067f20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e840c9e30 0x7f5e84154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e841570c0 0x7f5e840a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 --2- 172.21.15.119:0/3022931880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e8406c320 0x7f5e84157ff0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 >> 172.21.15.119:0/3022931880 conn(0x7f5e8406a3e0 msgr2=0x7f5e840c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 shutdown_connections 2023-12-19T16:16:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:58.961+0000 7f5e8998f640 1 -- 172.21.15.119:0/3022931880 wait complete. 2023-12-19T16:16:58.986 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:59.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 Processor -- start 2023-12-19T16:16:59.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 -- start start 2023-12-19T16:16:59.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe49415a680 0x7fe49415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49406fdb0 0x7fe494070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49415f100 con 0x7fe4940cac10 2023-12-19T16:16:59.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe494070780 con 0x7fe49415a680 2023-12-19T16:16:59.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49c455640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940ca7d0 con 0x7fe49406fdb0 2023-12-19T16:16:59.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe4999f0640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe4940cac10 0x7fe49415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52598/0 (socket says 172.21.15.119:52598) 2023-12-19T16:16:59.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe4999f0640 1 -- 172.21.15.119:0/410450141 learned_addr learned my addr 172.21.15.119:0/410450141 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49a1f1640 1 --2- 172.21.15.119:0/410450141 >> v2:172.21.15.143:3300/0 conn(0x7fe49415a680 0x7fe49415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.117+0000 7fe49a9f2640 1 --2- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49406fdb0 0x7fe494070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe4991ef640 1 -- 172.21.15.119:0/410450141 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194350892 0 0) 0x7fe49415f100 con 0x7fe4940cac10 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe4991ef640 1 -- 172.21.15.119:0/410450141 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe480003530 con 0x7fe4940cac10 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe4991ef640 1 -- 172.21.15.119:0/410450141 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793581121 0 0) 0x7fe480003530 con 0x7fe4940cac10 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe49a1f1640 1 -- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49406fdb0 msgr2=0x7fe494070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe49a1f1640 1 --2- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49406fdb0 0x7fe494070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe49a1f1640 1 -- 172.21.15.119:0/410450141 >> v1:172.21.15.119:6789/0 conn(0x7fe4940cac10 legacy=0x7fe49415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe49a1f1640 1 -- 172.21.15.119:0/410450141 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49415e860 con 0x7fe49415a680 2023-12-19T16:16:59.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe49a1f1640 1 --2- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe49415a680 0x7fe49415e160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe4900097f0 tx=0x7fe49001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62af493fb9285853 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:59.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe4991ef640 1 -- 172.21.15.119:0/410450141 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484001680 con 0x7fe49415a680 2023-12-19T16:16:59.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe4991ef640 1 -- 172.21.15.119:0/410450141 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4900a7050 con 0x7fe49415a680 2023-12-19T16:16:59.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.121+0000 7fe4991ef640 1 -- 172.21.15.119:0/410450141 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4900ab620 con 0x7fe49415a680 2023-12-19T16:16:59.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe49415a680 msgr2=0x7fe49415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 --2- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe49415a680 0x7fe49415e160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe4900097f0 tx=0x7fe49001c310 comp rx=0 tx=0).stop 2023-12-19T16:16:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- 172.21.15.119:0/410450141 shutdown_connections 2023-12-19T16:16:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 --2- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49406fdb0 0x7fe494070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 --2- 172.21.15.119:0/410450141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe49415a680 0x7fe49415e160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- 172.21.15.119:0/410450141 >> 172.21.15.119:0/410450141 conn(0x7fe49406a3e0 msgr2=0x7fe4940afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- 172.21.15.119:0/410450141 shutdown_connections 2023-12-19T16:16:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- 172.21.15.119:0/410450141 wait complete. 2023-12-19T16:16:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 Processor -- start 2023-12-19T16:16:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- start start 2023-12-19T16:16:59.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 0x7fe4940b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940cac10 0x7fe4940b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49415a680 0x7fe494159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406c480 con 0x7fe49406fdb0 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406cc50 con 0x7fe4940cac10 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49c455640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940c85b0 con 0x7fe49415a680 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 0x7fe4940b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 0x7fe4940b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34062/0 (socket says 172.21.15.119:34062) 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 -- 172.21.15.119:0/2603679246 learned_addr learned my addr 172.21.15.119:0/2603679246 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe4999f0640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940cac10 0x7fe4940b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a9f2640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49415a680 0x7fe494159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 -- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49415a680 msgr2=0x7fe494159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49415a680 0x7fe494159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 -- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940cac10 msgr2=0x7fe4940b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940cac10 0x7fe4940b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe49a1f1640 1 -- 172.21.15.119:0/2603679246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe490009420 con 0x7fe49406fdb0 2023-12-19T16:16:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.125+0000 7fe4999f0640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940cac10 0x7fe4940b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe49a1f1640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 0x7fe4940b2f30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe4900ae040 tx=0x7fe49001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4900b7450 con 0x7fe49406fdb0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4900b75d0 con 0x7fe49406fdb0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49406c690 con 0x7fe49406fdb0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4900b7980 con 0x7fe49406fdb0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4940704f0 con 0x7fe49406fdb0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4940735b0 con 0x7fe49406fdb0 2023-12-19T16:16:59.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe4900b7ae0 con 0x7fe49406fdb0 2023-12-19T16:16:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe48affd640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe478065a60 0x7fe478067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fe49011dba0 con 0x7fe49406fdb0 2023-12-19T16:16:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe4999f0640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe478065a60 0x7fe478067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.129+0000 7fe4999f0640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe478065a60 0x7fe478067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe494164250 tx=0x7fe484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:59.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.133+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4900eb290 con 0x7fe49406fdb0 2023-12-19T16:16:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.285+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4940b4050 con 0x7fe49406fdb0 2023-12-19T16:16:59.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe48affd640 1 -- 172.21.15.119:0/2603679246 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18146 (secure 0 0 0) 0x7fe4900b0090 con 0x7fe49406fdb0 2023-12-19T16:16:59.295 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:16:59.295 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":41,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:58.585455+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe478065a60 msgr2=0x7fe478067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe478065a60 0x7fe478067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe494164250 tx=0x7fe484009040 comp rx=0 tx=0).stop 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 msgr2=0x7fe4940b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 0x7fe4940b2f30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe4900ae040 tx=0x7fe49001ab50 comp rx=0 tx=0).stop 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 shutdown_connections 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe478065a60 0x7fe478067f20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4940cac10 0x7fe4940b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe49415a680 0x7fe494159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 --2- 172.21.15.119:0/2603679246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49406fdb0 0x7fe4940b2f30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 >> 172.21.15.119:0/2603679246 conn(0x7fe49406a3e0 msgr2=0x7fe4940ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 shutdown_connections 2023-12-19T16:16:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.289+0000 7fe49c455640 1 -- 172.21.15.119:0/2603679246 wait complete. 2023-12-19T16:16:59.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:59.315 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-12-19T16:16:59.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:59.332 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-12-19T16:16:59.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-12-19T16:16:59.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.569+0000 7fd7dae04640 1 Processor -- start 2023-12-19T16:16:59.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7dae04640 1 -- start start 2023-12-19T16:16:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7dae04640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d4159440 0x7fd7d415da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7dae04640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7d406bd00 0x7fd7d406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7dae04640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d406c690 con 0x7fd7d40cdb30 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7dae04640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d415df60 con 0x7fd7d406bd00 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7dae04640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d40b0e00 con 0x7fd7d4159440 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9e02640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d4159440 0x7fd7d415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9601640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd7d40cdb30 0x7fd7d4070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52600/0 (socket says 172.21.15.119:52600) 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9601640 1 -- 172.21.15.119:0/1707390642 learned_addr learned my addr 172.21.15.119:0/1707390642 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7da603640 1 --2- 172.21.15.119:0/1707390642 >> v2:172.21.15.143:3300/0 conn(0x7fd7d406bd00 0x7fd7d406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d8e00640 1 -- 172.21.15.119:0/1707390642 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327245504 0 0) 0x7fd7c4001120 con 0x7fd7d40cdb30 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d8e00640 1 -- 172.21.15.119:0/1707390642 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c0003530 con 0x7fd7d40cdb30 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9e02640 1 -- 172.21.15.119:0/1707390642 >> v2:172.21.15.143:3300/0 conn(0x7fd7d406bd00 msgr2=0x7fd7d406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9e02640 1 --2- 172.21.15.119:0/1707390642 >> v2:172.21.15.143:3300/0 conn(0x7fd7d406bd00 0x7fd7d406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9e02640 1 -- 172.21.15.119:0/1707390642 >> v1:172.21.15.119:6789/0 conn(0x7fd7d40cdb30 legacy=0x7fd7d4070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.573+0000 7fd7d9e02640 1 -- 172.21.15.119:0/1707390642 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40ca7c0 con 0x7fd7d4159440 2023-12-19T16:16:59.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7d9e02640 1 --2- 172.21.15.119:0/1707390642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d4159440 0x7fd7d415da20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00097c0 tx=0x7fd7d001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb3a34ff6807d7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:59.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7d8e00640 1 -- 172.21.15.119:0/1707390642 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00ac620 con 0x7fd7d4159440 2023-12-19T16:16:59.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7d8e00640 1 -- 172.21.15.119:0/1707390642 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d00ac780 con 0x7fd7d4159440 2023-12-19T16:16:59.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7d8e00640 1 -- 172.21.15.119:0/1707390642 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00acb10 con 0x7fd7d4159440 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 -- 172.21.15.119:0/1707390642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d4159440 msgr2=0x7fd7d415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 --2- 172.21.15.119:0/1707390642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d4159440 0x7fd7d415da20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00097c0 tx=0x7fd7d001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 -- 172.21.15.119:0/1707390642 shutdown_connections 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 --2- 172.21.15.119:0/1707390642 >> v2:172.21.15.143:3300/0 conn(0x7fd7d406bd00 0x7fd7d406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 --2- 172.21.15.119:0/1707390642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d4159440 0x7fd7d415da20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 -- 172.21.15.119:0/1707390642 >> 172.21.15.119:0/1707390642 conn(0x7fd7d406a350 msgr2=0x7fd7d40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 -- 172.21.15.119:0/1707390642 shutdown_connections 2023-12-19T16:16:59.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.577+0000 7fd7dae04640 1 -- 172.21.15.119:0/1707390642 wait complete. 2023-12-19T16:16:59.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 Processor -- start 2023-12-19T16:16:59.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- start start 2023-12-19T16:16:59.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7d406bd00 0x7fd7d414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d40cdb30 0x7fd7d4151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 0x7fd7d4163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d414cb60 con 0x7fd7d4159440 2023-12-19T16:16:59.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41f4bf0 con 0x7fd7d406bd00 2023-12-19T16:16:59.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41f4ed0 con 0x7fd7d40cdb30 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 0x7fd7d4163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 0x7fd7d4163770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34076/0 (socket says 172.21.15.119:34076) 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 -- 172.21.15.119:0/774697711 learned_addr learned my addr 172.21.15.119:0/774697711 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7d9601640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d40cdb30 0x7fd7d4151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7d9e02640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7d406bd00 0x7fd7d414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 -- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d40cdb30 msgr2=0x7fd7d4151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d40cdb30 0x7fd7d4151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 -- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7d406bd00 msgr2=0x7fd7d414c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7d406bd00 0x7fd7d414c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 -- 172.21.15.119:0/774697711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0009420 con 0x7fd7d4159440 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7da603640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 0x7fd7d4163770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0082d0 tx=0x7fd7cc008790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc010040 con 0x7fd7d4159440 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc0165f0 con 0x7fd7d4159440 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0169a0 con 0x7fd7d4159440 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d41f51b0 con 0x7fd7d4159440 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d41f5770 con 0x7fd7d4159440 2023-12-19T16:16:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.581+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d41f7e90 con 0x7fd7d4159440 2023-12-19T16:16:59.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.585+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7cc016b00 con 0x7fd7d4159440 2023-12-19T16:16:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.585+0000 7fd7ca7fc640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd7b8065a60 0x7fd7b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.585+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd7cc083720 con 0x7fd7d4159440 2023-12-19T16:16:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.585+0000 7fd7d9e02640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd7b8065a60 0x7fd7b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.585+0000 7fd7d9e02640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd7b8065a60 0x7fd7b8067f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ae000 tx=0x7fd7d00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.589+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd7cc050ec0 con 0x7fd7d4159440 2023-12-19T16:16:59.805 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.797+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7fd7d404e000 con 0x7fd7d4159440 2023-12-19T16:16:59.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7ca7fc640 1 -- 172.21.15.119:0/774697711 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+0 (secure 0 0 0) 0x7fd7cc0544e0 con 0x7fd7d4159440 2023-12-19T16:16:59.810 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:16:59.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd7b8065a60 msgr2=0x7fd7b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd7b8065a60 0x7fd7b8067f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ae000 tx=0x7fd7d00a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:59.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 msgr2=0x7fd7d4163770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 0x7fd7d4163770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0082d0 tx=0x7fd7cc008790 comp rx=0 tx=0).stop 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 shutdown_connections 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd7b8065a60 0x7fd7b8067f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7d4159440 0x7fd7d4163770 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7d40cdb30 0x7fd7d4151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 --2- 172.21.15.119:0/774697711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7d406bd00 0x7fd7d414c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 >> 172.21.15.119:0/774697711 conn(0x7fd7d406a350 msgr2=0x7fd7d40c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 shutdown_connections 2023-12-19T16:16:59.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:16:59.805+0000 7fd7dae04640 1 -- 172.21.15.119:0/774697711 wait complete. 2023-12-19T16:16:59.831 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:16:59.831 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:59.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 Processor -- start 2023-12-19T16:17:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 -- start start 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6e015ca40 0x7fd6e00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e00ce3f0 0x7fd6e00cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e00cfa70 con 0x7fd6e00cf610 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00d11c0 con 0x7fd6e015ca40 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6e5a2d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00d0310 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6e015ca40 0x7fd6e00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6e015ca40 0x7fd6e00cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34090/0 (socket says 172.21.15.119:34090) 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 -- 172.21.15.119:0/67833943 learned_addr learned my addr 172.21.15.119:0/67833943 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6de7fc640 1 --2- 172.21.15.119:0/67833943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e00ce3f0 0x7fd6e00cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 -- 172.21.15.119:0/67833943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e00ce3f0 msgr2=0x7fd6e00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 --2- 172.21.15.119:0/67833943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e00ce3f0 0x7fd6e00cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 -- 172.21.15.119:0/67833943 >> v1:172.21.15.143:6789/0 conn(0x7fd6e00cf610 legacy=0x7fd6e01605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.017+0000 7fd6deffd640 1 -- 172.21.15.119:0/67833943 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00d05b0 con 0x7fd6e015ca40 2023-12-19T16:17:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6deffd640 1 --2- 172.21.15.119:0/67833943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e015ca40 0x7fd6e00cdeb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0006fd0 tx=0x7fd6d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a216dab28c8d288 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6ddffb640 1 -- 172.21.15.119:0/67833943 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00ab640 con 0x7fd6e015ca40 2023-12-19T16:17:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6ddffb640 1 -- 172.21.15.119:0/67833943 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d00a7070 con 0x7fd6e015ca40 2023-12-19T16:17:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6ddffb640 1 -- 172.21.15.119:0/67833943 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00ab9c0 con 0x7fd6e015ca40 2023-12-19T16:17:00.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/67833943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e015ca40 msgr2=0x7fd6e00cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/67833943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e015ca40 0x7fd6e00cdeb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0006fd0 tx=0x7fd6d001c520 comp rx=0 tx=0).stop 2023-12-19T16:17:00.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/67833943 shutdown_connections 2023-12-19T16:17:00.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/67833943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e00ce3f0 0x7fd6e00cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/67833943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e015ca40 0x7fd6e00cdeb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/67833943 >> 172.21.15.119:0/67833943 conn(0x7fd6e0089fb0 msgr2=0x7fd6e00d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:00.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/67833943 shutdown_connections 2023-12-19T16:17:00.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.021+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/67833943 wait complete. 2023-12-19T16:17:00.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 Processor -- start 2023-12-19T16:17:00.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 -- start start 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 0x7fd6e015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00cf610 0x7fd6e00c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e015ca40 0x7fd6e00c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00c8510 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e015d1d0 con 0x7fd6e00cf610 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00c7c70 con 0x7fd6e015ca40 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 0x7fd6e015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 0x7fd6e015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34106/0 (socket says 172.21.15.119:34106) 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 -- 172.21.15.119:0/3914095150 learned_addr learned my addr 172.21.15.119:0/3914095150 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6de7fc640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00cf610 0x7fd6e00c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6df7fe640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e015ca40 0x7fd6e00c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 -- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e015ca40 msgr2=0x7fd6e00c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e015ca40 0x7fd6e00c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 -- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00cf610 msgr2=0x7fd6e00c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00cf610 0x7fd6e00c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 -- 172.21.15.119:0/3914095150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009480 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6deffd640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 0x7fd6e015b300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd6d001a150 tx=0x7fd6d00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0003960 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0003ac0 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0003e70 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e00c7f50 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.025+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e014bcf0 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.029+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e004e000 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.029+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd6d00ab440 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.029+0000 7fd6c7fff640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd6cc065a60 0x7fd6cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.029+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd6d011d6a0 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.029+0000 7fd6de7fc640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd6cc065a60 0x7fd6cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.033+0000 7fd6de7fc640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd6cc065a60 0x7fd6cc067f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd6e01f8a70 tx=0x7fd6d4006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.033+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd6d00eada0 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.189+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6e00cff10 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.189+0000 7fd6c7fff640 1 -- 172.21.15.119:0/3914095150 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7fd6d00ee3c0 con 0x7fd6e00ce3f0 2023-12-19T16:17:00.197 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:00.197 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd6cc065a60 msgr2=0x7fd6cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd6cc065a60 0x7fd6cc067f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd6e01f8a70 tx=0x7fd6d4006f90 comp rx=0 tx=0).stop 2023-12-19T16:17:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 msgr2=0x7fd6e015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 0x7fd6e015b300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd6d001a150 tx=0x7fd6d00192c0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 shutdown_connections 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd6cc065a60 0x7fd6cc067f20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00cf610 0x7fd6e00c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e015ca40 0x7fd6e00c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 --2- 172.21.15.119:0/3914095150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e00ce3f0 0x7fd6e015b300 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 >> 172.21.15.119:0/3914095150 conn(0x7fd6e0089fb0 msgr2=0x7fd6e00cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 shutdown_connections 2023-12-19T16:17:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.193+0000 7fd6e5a2d640 1 -- 172.21.15.119:0/3914095150 wait complete. 2023-12-19T16:17:00.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:00.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:00.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 Processor -- start 2023-12-19T16:17:00.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 -- start start 2023-12-19T16:17:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f631815cae0 0x7f63180d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cde90 0x7f63180ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631815cec0 con 0x7f63180cf170 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63180d0530 con 0x7f631815cae0 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631f895640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63180d0810 con 0x7f63180cde90 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631d631640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f631815cae0 0x7f63180d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631de32640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f63180cf170 0x7f631806add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52604/0 (socket says 172.21.15.119:52604) 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631de32640 1 -- 172.21.15.119:0/3682405327 learned_addr learned my addr 172.21.15.119:0/3682405327 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631d631640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f631815cae0 0x7f63180d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34108/0 (socket says 172.21.15.119:34108) 2023-12-19T16:17:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631ce30640 1 --2- 172.21.15.119:0/3682405327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cde90 0x7f63180ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f630ffff640 1 -- 172.21.15.119:0/3682405327 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328851060 0 0) 0x7f631815cec0 con 0x7f63180cf170 2023-12-19T16:17:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f630ffff640 1 -- 172.21.15.119:0/3682405327 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6304003530 con 0x7f63180cf170 2023-12-19T16:17:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631d631640 1 -- 172.21.15.119:0/3682405327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cde90 msgr2=0x7f63180ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631d631640 1 --2- 172.21.15.119:0/3682405327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cde90 0x7f63180ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631d631640 1 -- 172.21.15.119:0/3682405327 >> v1:172.21.15.119:6789/0 conn(0x7f63180cf170 legacy=0x7f631806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.357+0000 7f631d631640 1 -- 172.21.15.119:0/3682405327 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180d0af0 con 0x7f631815cae0 2023-12-19T16:17:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631d631640 1 --2- 172.21.15.119:0/3682405327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180d12f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f63140097a0 tx=0x7f631401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04d6cf11524994a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f630ffff640 1 -- 172.21.15.119:0/3682405327 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63140ab650 con 0x7f631815cae0 2023-12-19T16:17:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f630ffff640 1 -- 172.21.15.119:0/3682405327 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63140ab7b0 con 0x7f631815cae0 2023-12-19T16:17:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f630ffff640 1 -- 172.21.15.119:0/3682405327 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63140abb40 con 0x7f631815cae0 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 -- 172.21.15.119:0/3682405327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 msgr2=0x7f63180d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 --2- 172.21.15.119:0/3682405327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180d12f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f63140097a0 tx=0x7f631401ce90 comp rx=0 tx=0).stop 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 -- 172.21.15.119:0/3682405327 shutdown_connections 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 --2- 172.21.15.119:0/3682405327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cde90 0x7f63180ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 --2- 172.21.15.119:0/3682405327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180d12f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 -- 172.21.15.119:0/3682405327 >> 172.21.15.119:0/3682405327 conn(0x7f6318089fb0 msgr2=0x7f63180d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 -- 172.21.15.119:0/3682405327 shutdown_connections 2023-12-19T16:17:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.361+0000 7f631f895640 1 -- 172.21.15.119:0/3682405327 wait complete. 2023-12-19T16:17:00.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 Processor -- start 2023-12-19T16:17:00.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 -- start start 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63180cde90 0x7f63180cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cf170 0x7f63180c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63180ca300 con 0x7f631815cae0 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63180ca5e0 con 0x7f63180cde90 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63180ca8c0 con 0x7f63180cf170 2023-12-19T16:17:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34122/0 (socket says 172.21.15.119:34122) 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 -- 172.21.15.119:0/3206789711 learned_addr learned my addr 172.21.15.119:0/3206789711 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631ce30640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cf170 0x7f63180c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631d631640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63180cde90 0x7f63180cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 -- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cf170 msgr2=0x7f63180c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cf170 0x7f63180c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 -- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63180cde90 msgr2=0x7f63180cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63180cde90 0x7f63180cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 -- 172.21.15.119:0/3206789711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140093b0 con 0x7f631815cae0 2023-12-19T16:17:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631de32640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180cbbd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f631000caa0 tx=0x7f631000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631000ac00 con 0x7f631815cae0 2023-12-19T16:17:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631000ad60 con 0x7f631815cae0 2023-12-19T16:17:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63180cfb10 con 0x7f631815cae0 2023-12-19T16:17:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.365+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310012620 con 0x7f631815cae0 2023-12-19T16:17:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.369+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63180cae80 con 0x7f631815cae0 2023-12-19T16:17:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.369+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63180cb0a0 con 0x7f631815cae0 2023-12-19T16:17:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.369+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6310007070 con 0x7f631815cae0 2023-12-19T16:17:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.369+0000 7f630dffb640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f62fc065a60 0x7f62fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.369+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f6310083320 con 0x7f631815cae0 2023-12-19T16:17:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.369+0000 7f631d631640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f62fc065a60 0x7f62fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.373+0000 7f631d631640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f62fc065a60 0x7f62fc067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f63140af000 tx=0x7f6314004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.373+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6310050ab0 con 0x7f631815cae0 2023-12-19T16:17:00.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.529+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f631804e000 con 0x7f631815cae0 2023-12-19T16:17:00.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f630dffb640 1 -- 172.21.15.119:0/3206789711 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6310017020 con 0x7f631815cae0 2023-12-19T16:17:00.537 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f62fc065a60 msgr2=0x7f62fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f62fc065a60 0x7f62fc067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f63140af000 tx=0x7f6314004740 comp rx=0 tx=0).stop 2023-12-19T16:17:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 msgr2=0x7f63180cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180cbbd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f631000caa0 tx=0x7f631000cf60 comp rx=0 tx=0).stop 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 shutdown_connections 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f62fc065a60 0x7f62fc067f20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631815cae0 0x7f63180cbbd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63180cf170 0x7f63180c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 --2- 172.21.15.119:0/3206789711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63180cde90 0x7f63180cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 >> 172.21.15.119:0/3206789711 conn(0x7f6318089fb0 msgr2=0x7f63180b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 shutdown_connections 2023-12-19T16:17:00.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.533+0000 7f631f895640 1 -- 172.21.15.119:0/3206789711 wait complete. 2023-12-19T16:17:00.558 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:00.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.693+0000 7f7df0a41640 1 Processor -- start 2023-12-19T16:17:00.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.693+0000 7f7df0a41640 1 -- start start 2023-12-19T16:17:00.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7df0a41640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7dec071870 0x7f7dec071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7df0a41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7df0a41640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec0cc930 con 0x7f7dec0ca410 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7df0a41640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec15aab0 con 0x7f7dec071870 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7df0a41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec070df0 con 0x7f7dec0cbff0 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7dea59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7dec0ca410 0x7f7dec159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52606/0 (socket says 172.21.15.119:52606) 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7dea59c640 1 -- 172.21.15.119:0/2151855920 learned_addr learned my addr 172.21.15.119:0/2151855920 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de9d9b640 1 --2- 172.21.15.119:0/2151855920 >> v2:172.21.15.143:3300/0 conn(0x7f7dec071870 0x7f7dec071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7dead9d640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de959a640 1 -- 172.21.15.119:0/2151855920 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043021712 0 0) 0x7f7dec0cc930 con 0x7f7dec0ca410 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de959a640 1 -- 172.21.15.119:0/2151855920 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd4003530 con 0x7f7dec0ca410 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de9d9b640 1 -- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 msgr2=0x7f7dec0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de9d9b640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de9d9b640 1 -- 172.21.15.119:0/2151855920 >> v1:172.21.15.119:6789/0 conn(0x7f7dec0ca410 legacy=0x7f7dec159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7de9d9b640 1 -- 172.21.15.119:0/2151855920 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec15a4f0 con 0x7f7dec071870 2023-12-19T16:17:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.697+0000 7f7dead9d640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7de9d9b640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec071870 0x7f7dec071d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7de00097c0 tx=0x7f7de001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6bb6a7639aa3262 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7de959a640 1 -- 172.21.15.119:0/2151855920 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00ab650 con 0x7f7dec071870 2023-12-19T16:17:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7de959a640 1 -- 172.21.15.119:0/2151855920 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de00ab7b0 con 0x7f7dec071870 2023-12-19T16:17:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7de959a640 1 -- 172.21.15.119:0/2151855920 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00abb40 con 0x7f7dec071870 2023-12-19T16:17:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 -- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec071870 msgr2=0x7f7dec071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec071870 0x7f7dec071d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7de00097c0 tx=0x7f7de001c450 comp rx=0 tx=0).stop 2023-12-19T16:17:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 -- 172.21.15.119:0/2151855920 shutdown_connections 2023-12-19T16:17:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 --2- 172.21.15.119:0/2151855920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec071870 0x7f7dec071d00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 -- 172.21.15.119:0/2151855920 >> 172.21.15.119:0/2151855920 conn(0x7f7dec06a2a0 msgr2=0x7f7dec0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 -- 172.21.15.119:0/2151855920 shutdown_connections 2023-12-19T16:17:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 -- 172.21.15.119:0/2151855920 wait complete. 2023-12-19T16:17:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 Processor -- start 2023-12-19T16:17:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.701+0000 7f7df0a41640 1 -- start start 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 0x7f7dec0c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec0ca410 0x7f7dec0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec157dd0 con 0x7f7dec071870 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0c4ff0 con 0x7f7dec0ca410 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec1577c0 con 0x7f7dec0cbff0 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 0x7f7dec0c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 0x7f7dec0c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34132/0 (socket says 172.21.15.119:34132) 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 -- 172.21.15.119:0/938946648 learned_addr learned my addr 172.21.15.119:0/938946648 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dead9d640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7de9d9b640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec0ca410 0x7f7dec0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 -- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 msgr2=0x7f7dec0c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 -- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec0ca410 msgr2=0x7f7dec0c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec0ca410 0x7f7dec0c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 -- 172.21.15.119:0/938946648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4009a70 con 0x7f7dec071870 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7dea59c640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 0x7f7dec0c9590 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c4d0 tx=0x7f7ddc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc005cf0 con 0x7f7dec071870 2023-12-19T16:17:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc005e50 con 0x7f7dec071870 2023-12-19T16:17:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0072d0 con 0x7f7dec071870 2023-12-19T16:17:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de0009420 con 0x7f7dec071870 2023-12-19T16:17:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec157a60 con 0x7f7dec071870 2023-12-19T16:17:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec04e000 con 0x7f7dec071870 2023-12-19T16:17:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.705+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ddc007430 con 0x7f7dec071870 2023-12-19T16:17:00.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.709+0000 7f7ddaffd640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7dcc065a60 0x7f7dcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:00.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.709+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f7ddc082630 con 0x7f7dec071870 2023-12-19T16:17:00.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.709+0000 7f7de9d9b640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7dcc065a60 0x7f7dcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:00.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.709+0000 7f7de9d9b640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7dcc065a60 0x7f7dcc067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7de00af000 tx=0x7f7de00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:00.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.713+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7ddc04fe80 con 0x7f7dec071870 2023-12-19T16:17:00.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.861+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dec0cb6e0 con 0x7f7dec071870 2023-12-19T16:17:00.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.861+0000 7f7ddaffd640 1 -- 172.21.15.119:0/938946648 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ddc0534a0 con 0x7f7dec071870 2023-12-19T16:17:00.867 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7dcc065a60 msgr2=0x7f7dcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7dcc065a60 0x7f7dcc067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7de00af000 tx=0x7f7de00a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 msgr2=0x7f7dec0c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 0x7f7dec0c9590 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c4d0 tx=0x7f7ddc00c8d0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 shutdown_connections 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7dcc065a60 0x7f7dcc067f20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dec0ca410 0x7f7dec0c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dec0cbff0 0x7f7dec0c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 --2- 172.21.15.119:0/938946648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dec071870 0x7f7dec0c9590 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 >> 172.21.15.119:0/938946648 conn(0x7f7dec06a2a0 msgr2=0x7f7dec0ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 shutdown_connections 2023-12-19T16:17:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:00.865+0000 7f7df0a41640 1 -- 172.21.15.119:0/938946648 wait complete. 2023-12-19T16:17:00.888 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:01.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.021+0000 7f78711bd640 1 Processor -- start 2023-12-19T16:17:01.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.021+0000 7f78711bd640 1 -- start start 2023-12-19T16:17:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78711bd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f786c0cf270 0x7f786c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78711bd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78711bd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c0d0b10 con 0x7f786c0cf650 2023-12-19T16:17:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78711bd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0d1650 con 0x7f786c0cf270 2023-12-19T16:17:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78711bd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0d0db0 con 0x7f786c0b3bf0 2023-12-19T16:17:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78709bc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f786c0cf650 0x7f786c160760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:40878/0 (socket says 172.21.15.119:40878) 2023-12-19T16:17:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f786c0cf270 0x7f786c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f78709bc640 1 -- 172.21.15.119:0/4069769173 learned_addr learned my addr 172.21.15.119:0/4069769173 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786affd640 1 -- 172.21.15.119:0/4069769173 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808091029 0 0) 0x7f786c0d0b10 con 0x7f786c0cf650 2023-12-19T16:17:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786affd640 1 -- 172.21.15.119:0/4069769173 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7854003530 con 0x7f786c0cf650 2023-12-19T16:17:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786bfff640 1 -- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 msgr2=0x7f786c15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786bfff640 1 --2- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c15fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786bfff640 1 -- 172.21.15.119:0/4069769173 >> v1:172.21.15.143:6789/0 conn(0x7f786c0cf650 legacy=0x7f786c160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786bfff640 1 -- 172.21.15.119:0/4069769173 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0d1090 con 0x7f786c0cf270 2023-12-19T16:17:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.025+0000 7f786b7fe640 1 --2- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f786bfff640 1 --2- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c0b1260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f785c0097a0 tx=0x7f785c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=991c44edb97774e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f786affd640 1 -- 172.21.15.119:0/4069769173 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0ab600 con 0x7f786c0cf270 2023-12-19T16:17:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f786affd640 1 -- 172.21.15.119:0/4069769173 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0a7050 con 0x7f786c0cf270 2023-12-19T16:17:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f786affd640 1 -- 172.21.15.119:0/4069769173 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0ab980 con 0x7f786c0cf270 2023-12-19T16:17:01.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 -- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 msgr2=0x7f786c0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 --2- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c0b1260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f785c0097a0 tx=0x7f785c01c430 comp rx=0 tx=0).stop 2023-12-19T16:17:01.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 -- 172.21.15.119:0/4069769173 shutdown_connections 2023-12-19T16:17:01.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 --2- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 --2- 172.21.15.119:0/4069769173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c0b1260 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 -- 172.21.15.119:0/4069769173 >> 172.21.15.119:0/4069769173 conn(0x7f786c09b930 msgr2=0x7f786c0d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 -- 172.21.15.119:0/4069769173 shutdown_connections 2023-12-19T16:17:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 -- 172.21.15.119:0/4069769173 wait complete. 2023-12-19T16:17:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 Processor -- start 2023-12-19T16:17:01.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.029+0000 7f78711bd640 1 -- start start 2023-12-19T16:17:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c0b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 0x7f786c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c14eb60 con 0x7f786c0cf650 2023-12-19T16:17:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0b8380 con 0x7f786c0cf270 2023-12-19T16:17:01.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0b7770 con 0x7f786c0b3bf0 2023-12-19T16:17:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 0x7f786c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 0x7f786c14e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34144/0 (socket says 172.21.15.119:34144) 2023-12-19T16:17:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 -- 172.21.15.119:0/2484241425 learned_addr learned my addr 172.21.15.119:0/2484241425 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f786bfff640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c0b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f786b7fe640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 -- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 msgr2=0x7f786c0b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c0b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 -- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 msgr2=0x7f786c15e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c15e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 -- 172.21.15.119:0/2484241425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009420 con 0x7f786c0cf650 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78709bc640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 0x7f786c14e620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f786400cad0 tx=0x7f786400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400ac30 con 0x7f786c0cf650 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400ad90 con 0x7f786c0cf650 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864012620 con 0x7f786c0cf650 2023-12-19T16:17:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0093b0 con 0x7f786c0cf650 2023-12-19T16:17:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c0b7d30 con 0x7f786c0cf650 2023-12-19T16:17:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.033+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c0af3d0 con 0x7f786c0cf650 2023-12-19T16:17:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.037+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7864007070 con 0x7f786c0cf650 2023-12-19T16:17:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.037+0000 7f7868ff9640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7858065a60 0x7f7858067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.037+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f78640833a0 con 0x7f786c0cf650 2023-12-19T16:17:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.037+0000 7f786bfff640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7858065a60 0x7f7858067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.037+0000 7f786bfff640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7858065a60 0x7f7858067f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f786c08bf70 tx=0x7f785c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.041+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f786c0af3d0 con 0x7f786c0cf650 2023-12-19T16:17:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.189+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f786c0af3d0 con 0x7f786c0cf650 2023-12-19T16:17:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.189+0000 7f7868ff9640 1 -- 172.21.15.119:0/2484241425 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7864017020 con 0x7f786c0cf650 2023-12-19T16:17:01.195 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:01.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7858065a60 msgr2=0x7f7858067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7858065a60 0x7f7858067f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f786c08bf70 tx=0x7f785c0a6000 comp rx=0 tx=0).stop 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 msgr2=0x7f786c14e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 0x7f786c14e620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f786400cad0 tx=0x7f786400cf90 comp rx=0 tx=0).stop 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 shutdown_connections 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7858065a60 0x7f7858067f20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f786c0cf270 0x7f786c15e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f786c0cf650 0x7f786c14e620 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 --2- 172.21.15.119:0/2484241425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f786c0b3bf0 0x7f786c0b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 >> 172.21.15.119:0/2484241425 conn(0x7f786c09b930 msgr2=0x7f786c15c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 shutdown_connections 2023-12-19T16:17:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.193+0000 7f78711bd640 1 -- 172.21.15.119:0/2484241425 wait complete. 2023-12-19T16:17:01.218 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 Processor -- start 2023-12-19T16:17:01.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 -- start start 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c20070820 0x7f7c200c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c200ce3b0 0x7f7c200ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200c9390 con 0x7f7c201582d0 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200ced60 con 0x7f7c200ce3b0 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c27666640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2015aee0 con 0x7f7c20070820 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25402640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7c201582d0 0x7f7c200ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52620/0 (socket says 172.21.15.119:52620) 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25402640 1 -- 172.21.15.119:0/1656924265 learned_addr learned my addr 172.21.15.119:0/1656924265 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25c03640 1 --2- 172.21.15.119:0/1656924265 >> v2:172.21.15.119:3300/0 conn(0x7f7c200ce3b0 0x7f7c200ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c24c01640 1 --2- 172.21.15.119:0/1656924265 >> v2:172.21.15.143:3300/0 conn(0x7f7c20070820 0x7f7c200c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c17fff640 1 -- 172.21.15.119:0/1656924265 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428457060 0 0) 0x7f7c200c9390 con 0x7f7c201582d0 2023-12-19T16:17:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c17fff640 1 -- 172.21.15.119:0/1656924265 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c0c003530 con 0x7f7c201582d0 2023-12-19T16:17:01.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25c03640 1 -- 172.21.15.119:0/1656924265 >> v2:172.21.15.143:3300/0 conn(0x7f7c20070820 msgr2=0x7f7c200c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:01.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25c03640 1 --2- 172.21.15.119:0/1656924265 >> v2:172.21.15.143:3300/0 conn(0x7f7c20070820 0x7f7c200c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25c03640 1 -- 172.21.15.119:0/1656924265 >> v1:172.21.15.119:6789/0 conn(0x7f7c201582d0 legacy=0x7f7c200ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.353+0000 7f7c25c03640 1 -- 172.21.15.119:0/1656924265 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2015b1c0 con 0x7f7c200ce3b0 2023-12-19T16:17:01.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c25c03640 1 --2- 172.21.15.119:0/1656924265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c200ce820 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7c2006dfa0 tx=0x7f7c1801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78c680467d42edc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c17fff640 1 -- 172.21.15.119:0/1656924265 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180a59a0 con 0x7f7c200ce3b0 2023-12-19T16:17:01.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c17fff640 1 -- 172.21.15.119:0/1656924265 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180a5b00 con 0x7f7c200ce3b0 2023-12-19T16:17:01.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c17fff640 1 -- 172.21.15.119:0/1656924265 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180a5e90 con 0x7f7c200ce3b0 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 -- 172.21.15.119:0/1656924265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 msgr2=0x7f7c200ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 --2- 172.21.15.119:0/1656924265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c200ce820 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7c2006dfa0 tx=0x7f7c1801c8e0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 -- 172.21.15.119:0/1656924265 shutdown_connections 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 --2- 172.21.15.119:0/1656924265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c200ce820 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 --2- 172.21.15.119:0/1656924265 >> v2:172.21.15.143:3300/0 conn(0x7f7c20070820 0x7f7c200c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 -- 172.21.15.119:0/1656924265 >> 172.21.15.119:0/1656924265 conn(0x7f7c2006a2a0 msgr2=0x7f7c200aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 -- 172.21.15.119:0/1656924265 shutdown_connections 2023-12-19T16:17:01.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.357+0000 7f7c27666640 1 -- 172.21.15.119:0/1656924265 wait complete. 2023-12-19T16:17:01.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 Processor -- start 2023-12-19T16:17:01.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 -- start start 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c20070820 0x7f7c200c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c20154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c201582d0 0x7f7c20154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2015ced0 con 0x7f7c200ce3b0 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20153ef0 con 0x7f7c201582d0 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c27666640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c45c0 con 0x7f7c20070820 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c24c01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c20154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c24c01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c20154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34158/0 (socket says 172.21.15.119:34158) 2023-12-19T16:17:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c201582d0 0x7f7c20154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c24c01640 1 -- 172.21.15.119:0/1281796432 learned_addr learned my addr 172.21.15.119:0/1281796432 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:01.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25402640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c20070820 0x7f7c200c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 -- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c20070820 msgr2=0x7f7c200c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c20070820 0x7f7c200c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 -- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 msgr2=0x7f7c20154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c20154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 -- 172.21.15.119:0/1281796432 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009a70 con 0x7f7c201582d0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c24c01640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c20154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c25c03640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c201582d0 0x7f7c20154780 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c180ac000 tx=0x7f7c18019680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.361+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180adce0 con 0x7f7c201582d0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180ade40 con 0x7f7c201582d0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180b9690 con 0x7f7c201582d0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c200c48a0 con 0x7f7c201582d0 2023-12-19T16:17:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2015caf0 con 0x7f7c201582d0 2023-12-19T16:17:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2015d010 con 0x7f7c201582d0 2023-12-19T16:17:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c180b97f0 con 0x7f7c201582d0 2023-12-19T16:17:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c15ffb640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c04065a60 0x7f7c04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f7c1811ea30 con 0x7f7c201582d0 2023-12-19T16:17:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.365+0000 7f7c25402640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c04065a60 0x7f7c04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.369+0000 7f7c25402640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c04065a60 0x7f7c04067f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0011f0 tx=0x7f7c1c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.369+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c180ec1c0 con 0x7f7c201582d0 2023-12-19T16:17:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.521+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f7c2004e000 con 0x7f7c201582d0 2023-12-19T16:17:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.521+0000 7f7c15ffb640 1 -- 172.21.15.119:0/1281796432 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f7c18009450 con 0x7f7c201582d0 2023-12-19T16:17:01.527 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:01.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.521+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c04065a60 msgr2=0x7f7c04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.521+0000 7f7c27666640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c04065a60 0x7f7c04067f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0011f0 tx=0x7f7c1c007d40 comp rx=0 tx=0).stop 2023-12-19T16:17:01.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.521+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c201582d0 msgr2=0x7f7c20154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.521+0000 7f7c27666640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c201582d0 0x7f7c20154780 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c180ac000 tx=0x7f7c18019680 comp rx=0 tx=0).stop 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 shutdown_connections 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7c04065a60 0x7f7c04067f20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c201582d0 0x7f7c20154780 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c200ce3b0 0x7f7c20154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 --2- 172.21.15.119:0/1281796432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c20070820 0x7f7c200c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 >> 172.21.15.119:0/1281796432 conn(0x7f7c2006a2a0 msgr2=0x7f7c200aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 shutdown_connections 2023-12-19T16:17:01.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.525+0000 7f7c27666640 1 -- 172.21.15.119:0/1281796432 wait complete. 2023-12-19T16:17:01.549 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:01.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 Processor -- start 2023-12-19T16:17:01.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 -- start start 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40cac10 0x7fc0e415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0e406fdb0 0x7fc0e4070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e415f100 con 0x7fc0e415a680 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e40707a0 con 0x7fc0e406fdb0 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e890a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40ca7d0 con 0x7fc0e40cac10 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e259c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc0e415a680 0x7fc0e415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52634/0 (socket says 172.21.15.119:52634) 2023-12-19T16:17:01.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.681+0000 7fc0e259c640 1 -- 172.21.15.119:0/3601280505 learned_addr learned my addr 172.21.15.119:0/3601280505 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0d9d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40cac10 0x7fc0e415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e2d9d640 1 --2- 172.21.15.119:0/3601280505 >> v2:172.21.15.143:3300/0 conn(0x7fc0e406fdb0 0x7fc0e4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152580256 0 0) 0x7fc0e415f100 con 0x7fc0e415a680 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d0003530 con 0x7fc0e415a680 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734441172 0 0) 0x7fc0d0003530 con 0x7fc0e415a680 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40cac10 msgr2=0x7fc0e415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40cac10 0x7fc0e415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 >> v2:172.21.15.143:3300/0 conn(0x7fc0e406fdb0 msgr2=0x7fc0e4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 --2- 172.21.15.119:0/3601280505 >> v2:172.21.15.143:3300/0 conn(0x7fc0e406fdb0 0x7fc0e4070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e415e860 con 0x7fc0e415a680 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fc0d4001a00 con 0x7fc0e415a680 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e2d9d640 1 --2- 172.21.15.119:0/3601280505 >> v2:172.21.15.143:3300/0 conn(0x7fc0e406fdb0 0x7fc0e4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 >> v1:172.21.15.119:6789/0 conn(0x7fc0e415a680 legacy=0x7fc0e415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0d0003980 0x7fc0d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0005190 0x7fc0d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40707a0 con 0x7fc0d0003980 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40ca7d0 con 0x7fc0d0005190 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d000bf20 con 0x7fc0d00047d0 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0d9d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40cac10 0x7fc0e415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e259c640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0d0003980 0x7fc0d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e2d9d640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0005190 0x7fc0d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0d9d9b640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e259c640 1 -- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d00047d0 msgr2=0x7fc0d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:01.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e259c640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e259c640 1 -- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0005190 msgr2=0x7fc0d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:01.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e259c640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0005190 0x7fc0d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e259c640 1 -- 172.21.15.119:0/3601280505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0003530 con 0x7fc0d0003980 2023-12-19T16:17:01.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.685+0000 7fc0e2d9d640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0005190 0x7fc0d000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e259c640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0d0003980 0x7fc0d0003da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400a890 tx=0x7fc0d401d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9171e446d2beb242 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40ad630 con 0x7fc0d0003980 2023-12-19T16:17:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d40a8070 con 0x7fc0d0003980 2023-12-19T16:17:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e1d9b640 1 -- 172.21.15.119:0/3601280505 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40ad9f0 con 0x7fc0d0003980 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 -- 172.21.15.119:0/3601280505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0d0003980 msgr2=0x7fc0d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 --2- 172.21.15.119:0/3601280505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0d0003980 0x7fc0d0003da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400a890 tx=0x7fc0d401d330 comp rx=0 tx=0).stop 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e2d9d640 1 -- 172.21.15.119:0/3601280505 reap_dead start 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 -- 172.21.15.119:0/3601280505 shutdown_connections 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 -- 172.21.15.119:0/3601280505 >> 172.21.15.119:0/3601280505 conn(0x7fc0e406a3e0 msgr2=0x7fc0e40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 -- 172.21.15.119:0/3601280505 shutdown_connections 2023-12-19T16:17:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 -- 172.21.15.119:0/3601280505 wait complete. 2023-12-19T16:17:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 Processor -- start 2023-12-19T16:17:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.689+0000 7fc0e890a640 1 -- start start 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0003980 0x7fc0e4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 0x7fc0e41573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40c3ff0 0x7fc0e40c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40c49e0 con 0x7fc0e4158490 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40c6630 con 0x7fc0d0003980 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4158a30 con 0x7fc0e40c3ff0 2023-12-19T16:17:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 0x7fc0e41573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0003980 0x7fc0e4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 0x7fc0e41573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34176/0 (socket says 172.21.15.119:34176) 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 -- 172.21.15.119:0/2208474341 learned_addr learned my addr 172.21.15.119:0/2208474341 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e2d9d640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40c3ff0 0x7fc0e40c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 -- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40c3ff0 msgr2=0x7fc0e40c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40c3ff0 0x7fc0e40c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 -- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0003980 msgr2=0x7fc0e4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0003980 0x7fc0e4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 -- 172.21.15.119:0/2208474341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4158d10 con 0x7fc0e4158490 2023-12-19T16:17:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0d9d9b640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 0x7fc0e41573d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0119d0 tx=0x7fc0cc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00fbb0 con 0x7fc0e4158490 2023-12-19T16:17:01.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00fd10 con 0x7fc0e4158490 2023-12-19T16:17:01.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc014680 con 0x7fc0e4158490 2023-12-19T16:17:01.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e4158ff0 con 0x7fc0e4158490 2023-12-19T16:17:01.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e41595b0 con 0x7fc0e4158490 2023-12-19T16:17:01.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e4159770 con 0x7fc0e4158490 2023-12-19T16:17:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.693+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0cc0147e0 con 0x7fc0e4158490 2023-12-19T16:17:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.697+0000 7fc0db7fe640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0c4065a90 0x7fc0c4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.697+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fc0cc083b80 con 0x7fc0e4158490 2023-12-19T16:17:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.697+0000 7fc0e259c640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0c4065a90 0x7fc0c4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.697+0000 7fc0e259c640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0c4065a90 0x7fc0c4067f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ad000 tx=0x7fc0d40b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:01.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.701+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0cc0513b0 con 0x7fc0e4158490 2023-12-19T16:17:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.861+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc0e40735b0 con 0x7fc0e4158490 2023-12-19T16:17:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.861+0000 7fc0db7fe640 1 -- 172.21.15.119:0/2208474341 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0cc022080 con 0x7fc0e4158490 2023-12-19T16:17:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:17:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.861+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0c4065a90 msgr2=0x7fc0c4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.861+0000 7fc0e890a640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0c4065a90 0x7fc0c4067f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ad000 tx=0x7fc0d40b6040 comp rx=0 tx=0).stop 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 msgr2=0x7fc0e41573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 0x7fc0e41573d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0119d0 tx=0x7fc0cc011e90 comp rx=0 tx=0).stop 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 shutdown_connections 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc0c4065a90 0x7fc0c4067f50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0e40c3ff0 0x7fc0e40c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4158490 0x7fc0e41573d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 --2- 172.21.15.119:0/2208474341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d0003980 0x7fc0e4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 >> 172.21.15.119:0/2208474341 conn(0x7fc0e406a3e0 msgr2=0x7fc0e4072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 shutdown_connections 2023-12-19T16:17:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:01.865+0000 7fc0e890a640 1 -- 172.21.15.119:0/2208474341 wait complete. 2023-12-19T16:17:01.888 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:01.888 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:01.897 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:02.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f996d640 1 Processor -- start 2023-12-19T16:17:02.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f996d640 1 -- start start 2023-12-19T16:17:02.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f996d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89f415cb30 0x7f89f406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f996d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f406c140 con 0x7f89f40cefe0 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f996d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f415cf10 con 0x7f89f415d2d0 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f996d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f415e000 con 0x7f89f415cb30 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89f415cb30 0x7f89f406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89f415cb30 0x7f89f406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34180/0 (socket says 172.21.15.119:34180) 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f2ffd640 1 -- 172.21.15.119:0/3967967994 learned_addr learned my addr 172.21.15.119:0/3967967994 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f27fc640 1 --1- 172.21.15.119:0/3967967994 >> v1:172.21.15.119:6789/0 conn(0x7f89f40cefe0 0x7f89f40cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52644/0 (socket says 172.21.15.119:52644) 2023-12-19T16:17:02.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f2ffd640 1 -- 172.21.15.119:0/3967967994 >> v1:172.21.15.143:6789/0 conn(0x7f89f415d2d0 legacy=0x7f89f415d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f2ffd640 1 -- 172.21.15.119:0/3967967994 >> v1:172.21.15.119:6789/0 conn(0x7f89f40cefe0 legacy=0x7f89f40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.073+0000 7f89f2ffd640 1 -- 172.21.15.119:0/3967967994 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f406ae40 con 0x7f89f415cb30 2023-12-19T16:17:02.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f2ffd640 1 --2- 172.21.15.119:0/3967967994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f415cb30 0x7f89f406bc00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006fd0 tx=0x7f89e401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae9bfdc04bfb8e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f1ffb640 1 -- 172.21.15.119:0/3967967994 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40aa650 con 0x7f89f415cb30 2023-12-19T16:17:02.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f1ffb640 1 -- 172.21.15.119:0/3967967994 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40aa7b0 con 0x7f89f415cb30 2023-12-19T16:17:02.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f1ffb640 1 -- 172.21.15.119:0/3967967994 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40aab40 con 0x7f89f415cb30 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 -- 172.21.15.119:0/3967967994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f415cb30 msgr2=0x7f89f406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 --2- 172.21.15.119:0/3967967994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f415cb30 0x7f89f406bc00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006fd0 tx=0x7f89e401c4f0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 -- 172.21.15.119:0/3967967994 shutdown_connections 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 --2- 172.21.15.119:0/3967967994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f415cb30 0x7f89f406bc00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 -- 172.21.15.119:0/3967967994 >> 172.21.15.119:0/3967967994 conn(0x7f89f4089fb0 msgr2=0x7f89f409b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 -- 172.21.15.119:0/3967967994 shutdown_connections 2023-12-19T16:17:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 -- 172.21.15.119:0/3967967994 wait complete. 2023-12-19T16:17:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 Processor -- start 2023-12-19T16:17:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.077+0000 7f89f996d640 1 -- start start 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 0x7f89f414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89f415cb30 0x7f89f41f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89f415d2d0 0x7f89f41f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f41560b0 con 0x7f89f40cefe0 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f41554a0 con 0x7f89f415d2d0 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4155780 con 0x7f89f415cb30 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 0x7f89f414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 0x7f89f414d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34182/0 (socket says 172.21.15.119:34182) 2023-12-19T16:17:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 -- 172.21.15.119:0/642384742 learned_addr learned my addr 172.21.15.119:0/642384742 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f37fe640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89f415d2d0 0x7f89f41f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f27fc640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89f415cb30 0x7f89f41f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 -- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89f415cb30 msgr2=0x7f89f41f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89f415cb30 0x7f89f41f8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 -- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89f415d2d0 msgr2=0x7f89f41f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89f415d2d0 0x7f89f41f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 -- 172.21.15.119:0/642384742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009480 con 0x7f89f40cefe0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f37fe640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89f415d2d0 0x7f89f41f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f2ffd640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 0x7f89f414d7e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000c10 tx=0x7f89e4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40aab20 con 0x7f89f40cefe0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40aaca0 con 0x7f89f40cefe0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4003860 con 0x7f89f40cefe0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f4155a60 con 0x7f89f40cefe0 2023-12-19T16:17:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f40c7be0 con 0x7f89f40cefe0 2023-12-19T16:17:02.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f4156390 con 0x7f89f40cefe0 2023-12-19T16:17:02.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.081+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89e40039c0 con 0x7f89f40cefe0 2023-12-19T16:17:02.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.085+0000 7f89dbfff640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89e0065a60 0x7f89e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.085+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f89e411e200 con 0x7f89f40cefe0 2023-12-19T16:17:02.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.085+0000 7f89f27fc640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89e0065a60 0x7f89e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.085+0000 7f89f27fc640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89e0065a60 0x7f89e0067f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89f4169930 tx=0x7f89e8007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.094 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.089+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f89e40eba10 con 0x7f89f40cefe0 2023-12-19T16:17:02.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.241+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f41558c0 con 0x7f89f40cefe0 2023-12-19T16:17:02.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.241+0000 7f89dbfff640 1 -- 172.21.15.119:0/642384742 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7f89f41558c0 con 0x7f89f40cefe0 2023-12-19T16:17:02.248 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:02.248 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:02.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89e0065a60 msgr2=0x7f89e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89e0065a60 0x7f89e0067f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89f4169930 tx=0x7f89e8007c90 comp rx=0 tx=0).stop 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 msgr2=0x7f89f414d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 0x7f89f414d7e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000c10 tx=0x7f89e4019290 comp rx=0 tx=0).stop 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 shutdown_connections 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f89e0065a60 0x7f89e0067f20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89f415d2d0 0x7f89f41f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89f415cb30 0x7f89f41f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 --2- 172.21.15.119:0/642384742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f40cefe0 0x7f89f414d7e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 >> 172.21.15.119:0/642384742 conn(0x7f89f4089fb0 msgr2=0x7f89f40af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 shutdown_connections 2023-12-19T16:17:02.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.245+0000 7f89f996d640 1 -- 172.21.15.119:0/642384742 wait complete. 2023-12-19T16:17:02.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:02.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:02.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 Processor -- start 2023-12-19T16:17:02.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 -- start start 2023-12-19T16:17:02.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 0x7f0b200c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0b200ce3b0 0x7f0b200ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b200c9390 con 0x7f0b20070820 2023-12-19T16:17:02.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200ced80 con 0x7f0b200ce3b0 2023-12-19T16:17:02.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b26596640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2015aee0 con 0x7f0b201582d0 2023-12-19T16:17:02.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b1f7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0b20070820 0x7f0b200ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:52648/0 (socket says 172.21.15.119:52648) 2023-12-19T16:17:02.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.405+0000 7f0b1f7fe640 1 -- 172.21.15.119:0/181162033 learned_addr learned my addr 172.21.15.119:0/181162033 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b24b33640 1 --2- 172.21.15.119:0/181162033 >> v2:172.21.15.143:3300/0 conn(0x7f0b200ce3b0 0x7f0b200ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1ffff640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 0x7f0b200c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604847872 0 0) 0x7f0b200c9390 con 0x7f0b20070820 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b08003530 con 0x7f0b20070820 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196411927 0 0) 0x7f0b08003530 con 0x7f0b20070820 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 msgr2=0x7f0b200c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 0x7f0b200c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 >> v2:172.21.15.143:3300/0 conn(0x7f0b200ce3b0 msgr2=0x7f0b200ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 --2- 172.21.15.119:0/181162033 >> v2:172.21.15.143:3300/0 conn(0x7f0b200ce3b0 0x7f0b200ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2015b1c0 con 0x7f0b20070820 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f0b14001680 con 0x7f0b20070820 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 >> v1:172.21.15.119:6789/0 conn(0x7f0b20070820 legacy=0x7f0b200ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08003980 0x7f0b08003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 0x7f0b08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200ced80 con 0x7f0b080047d0 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2015aee0 con 0x7f0b08003980 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0800fda0 con 0x7f0b201582d0 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1ffff640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08003980 0x7f0b08003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b24b33640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 0x7f0b08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1f7fe640 1 -- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 msgr2=0x7f0b08005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b201582d0 0x7f0b08005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1f7fe640 1 -- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08003980 msgr2=0x7f0b08003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08003980 0x7f0b08003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.409+0000 7f0b1f7fe640 1 -- 172.21.15.119:0/181162033 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08003530 con 0x7f0b080047d0 2023-12-19T16:17:02.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b08004c50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c210 tx=0x7f0b1401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd40a332c835150f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140a8ce0 con 0x7f0b080047d0 2023-12-19T16:17:02.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b140a8e40 con 0x7f0b080047d0 2023-12-19T16:17:02.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b1effd640 1 -- 172.21.15.119:0/181162033 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14005b00 con 0x7f0b080047d0 2023-12-19T16:17:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 -- 172.21.15.119:0/181162033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 msgr2=0x7f0b08004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 --2- 172.21.15.119:0/181162033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b08004c50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c210 tx=0x7f0b1401f3b0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b24b33640 1 -- 172.21.15.119:0/181162033 reap_dead start 2023-12-19T16:17:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 -- 172.21.15.119:0/181162033 shutdown_connections 2023-12-19T16:17:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 -- 172.21.15.119:0/181162033 >> 172.21.15.119:0/181162033 conn(0x7f0b2006a2a0 msgr2=0x7f0b200aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 -- 172.21.15.119:0/181162033 shutdown_connections 2023-12-19T16:17:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 -- 172.21.15.119:0/181162033 wait complete. 2023-12-19T16:17:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 Processor -- start 2023-12-19T16:17:02.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 -- start start 2023-12-19T16:17:02.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.413+0000 7f0b26596640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b200cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b20156770 0x7f0b2015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b20156bd0 0x7f0b2015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2014ce70 con 0x7f0b080047d0 2023-12-19T16:17:02.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2014c000 con 0x7f0b20156770 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2014c280 con 0x7f0b20156bd0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b200cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b200cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34196/0 (socket says 172.21.15.119:34196) 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 -- 172.21.15.119:0/1628692454 learned_addr learned my addr 172.21.15.119:0/1628692454 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 -- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b20156bd0 msgr2=0x7f0b2015e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b20156bd0 0x7f0b2015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b20156770 0x7f0b2015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 -- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b20156770 msgr2=0x7f0b2015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b20156770 0x7f0b2015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 -- 172.21.15.119:0/1628692454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2014c540 con 0x7f0b080047d0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b20156770 0x7f0b2015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1ffff640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b200cd3c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b10011960 tx=0x7f0b10011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000fa70 con 0x7f0b080047d0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000fbd0 con 0x7f0b080047d0 2023-12-19T16:17:02.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10014440 con 0x7f0b080047d0 2023-12-19T16:17:02.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2014c820 con 0x7f0b080047d0 2023-12-19T16:17:02.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2014d300 con 0x7f0b080047d0 2023-12-19T16:17:02.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2004e000 con 0x7f0b080047d0 2023-12-19T16:17:02.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.417+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b100145a0 con 0x7f0b080047d0 2023-12-19T16:17:02.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.421+0000 7f0b1cff9640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b0c065a90 0x7f0b0c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.421+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f0b10083b40 con 0x7f0b080047d0 2023-12-19T16:17:02.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.421+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b0c065a90 0x7f0b0c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.421+0000 7f0b1f7fe640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b0c065a90 0x7f0b0c067f50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0b140ad000 tx=0x7f0b14001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.421+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0b10051220 con 0x7f0b080047d0 2023-12-19T16:17:02.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.573+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b2015b470 con 0x7f0b080047d0 2023-12-19T16:17:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.573+0000 7f0b1cff9640 1 -- 172.21.15.119:0/1628692454 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b10022020 con 0x7f0b080047d0 2023-12-19T16:17:02.580 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b0c065a90 msgr2=0x7f0b0c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b0c065a90 0x7f0b0c067f50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0b140ad000 tx=0x7f0b14001a10 comp rx=0 tx=0).stop 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 msgr2=0x7f0b200cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b200cd3c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b10011960 tx=0x7f0b10011e20 comp rx=0 tx=0).stop 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 shutdown_connections 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b0c065a90 0x7f0b0c067f50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b20156770 0x7f0b2015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b20156bd0 0x7f0b2015e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 --2- 172.21.15.119:0/1628692454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b080047d0 0x7f0b200cd3c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 >> 172.21.15.119:0/1628692454 conn(0x7f0b2006a2a0 msgr2=0x7f0b2015a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 shutdown_connections 2023-12-19T16:17:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.577+0000 7f0b26596640 1 -- 172.21.15.119:0/1628692454 wait complete. 2023-12-19T16:17:02.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb67e1e9640 1 Processor -- start 2023-12-19T16:17:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb67e1e9640 1 -- start start 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb67e1e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6781582d0 0x7fb6780c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb67e1e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780c9390 con 0x7fb6780ce3b0 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb67e1e9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67815aee0 con 0x7fb678070820 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb67e1e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67815b1c0 con 0x7fb6781582d0 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb6777fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6781582d0 0x7fb6780c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb677fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb6780ce3b0 0x7fb6780cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45102/0 (socket says 172.21.15.119:45102) 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb677fff640 1 -- 172.21.15.119:0/3077797754 learned_addr learned my addr 172.21.15.119:0/3077797754 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb6777fe640 1 -- 172.21.15.119:0/3077797754 >> v1:172.21.15.143:6789/0 conn(0x7fb678070820 legacy=0x7fb6780ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb6777fe640 1 -- 172.21.15.119:0/3077797754 >> v1:172.21.15.119:6789/0 conn(0x7fb6780ce3b0 legacy=0x7fb6780cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb6767fc640 1 -- 172.21.15.119:0/3077797754 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39248303 0 0) 0x7fb6780c9390 con 0x7fb6780ce3b0 2023-12-19T16:17:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.737+0000 7fb6777fe640 1 -- 172.21.15.119:0/3077797754 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67815b4a0 con 0x7fb6781582d0 2023-12-19T16:17:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb6777fe640 1 --2- 172.21.15.119:0/3077797754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb6780c8e50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097c0 tx=0x7fb66801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e0100170f61e78 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb6767fc640 1 -- 172.21.15.119:0/3077797754 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680a7070 con 0x7fb6781582d0 2023-12-19T16:17:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb6767fc640 1 -- 172.21.15.119:0/3077797754 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6680ab430 con 0x7fb6781582d0 2023-12-19T16:17:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb6767fc640 1 -- 172.21.15.119:0/3077797754 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680ab7c0 con 0x7fb6781582d0 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3077797754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 msgr2=0x7fb6780c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3077797754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb6780c8e50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097c0 tx=0x7fb66801c410 comp rx=0 tx=0).stop 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3077797754 shutdown_connections 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3077797754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb6780c8e50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3077797754 >> 172.21.15.119:0/3077797754 conn(0x7fb67806a2a0 msgr2=0x7fb6780aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3077797754 shutdown_connections 2023-12-19T16:17:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.741+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3077797754 wait complete. 2023-12-19T16:17:02.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 Processor -- start 2023-12-19T16:17:02.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- start start 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb678070820 0x7fb6781501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6780ce3b0 0x7fb6780c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb678156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780ad820 con 0x7fb6781582d0 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780ad050 con 0x7fb678070820 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c1be0 con 0x7fb6780ce3b0 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb678156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb678156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60832/0 (socket says 172.21.15.119:60832) 2023-12-19T16:17:02.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 -- 172.21.15.119:0/3210607781 learned_addr learned my addr 172.21.15.119:0/3210607781 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb6777fe640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb678070820 0x7fb6781501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb676ffd640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6780ce3b0 0x7fb6780c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 -- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6780ce3b0 msgr2=0x7fb6780c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6780ce3b0 0x7fb6780c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 -- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb678070820 msgr2=0x7fb6781501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb678070820 0x7fb6781501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 -- 172.21.15.119:0/3210607781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009420 con 0x7fb6781582d0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb677fff640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb678156e10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c810 tx=0x7fb67000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000a640 con 0x7fb6781582d0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000a7c0 con 0x7fb6781582d0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6780c7430 con 0x7fb6781582d0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000ab70 con 0x7fb6781582d0 2023-12-19T16:17:02.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6780ad540 con 0x7fb6781582d0 2023-12-19T16:17:02.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.745+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67804e000 con 0x7fb6781582d0 2023-12-19T16:17:02.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.749+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb67000acd0 con 0x7fb6781582d0 2023-12-19T16:17:02.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.749+0000 7fb65ffff640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:02.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.749+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb670082950 con 0x7fb6781582d0 2023-12-19T16:17:02.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.749+0000 7fb6777fe640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:02.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.749+0000 7fb6777fe640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6680af000 tx=0x7fb668008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:02.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.753+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb670050040 con 0x7fb6781582d0 2023-12-19T16:17:02.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.901+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6780b4070 con 0x7fb6781582d0 2023-12-19T16:17:02.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb65ffff640 1 -- 172.21.15.119:0/3210607781 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb670053660 con 0x7fb6781582d0 2023-12-19T16:17:02.910 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:02.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 msgr2=0x7fb664067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6680af000 tx=0x7fb668008040 comp rx=0 tx=0).stop 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 msgr2=0x7fb678156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb678156e10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c810 tx=0x7fb67000ccd0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 shutdown_connections 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb664065a60 0x7fb664067f20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6781582d0 0x7fb678156e10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6780ce3b0 0x7fb6780c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 --2- 172.21.15.119:0/3210607781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb678070820 0x7fb6781501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 >> 172.21.15.119:0/3210607781 conn(0x7fb67806a2a0 msgr2=0x7fb678159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 shutdown_connections 2023-12-19T16:17:02.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:02.905+0000 7fb67e1e9640 1 -- 172.21.15.119:0/3210607781 wait complete. 2023-12-19T16:17:02.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:03.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879e454640 1 Processor -- start 2023-12-19T16:17:03.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879e454640 1 -- start start 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879e454640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87980afc10 0x7f87980b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879e454640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8798160800 con 0x7f879815c790 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879e454640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879815d7c0 con 0x7f879815cb70 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879e454640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8798160280 con 0x7f87980afc10 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879d452640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f879815c790 0x7f8798160c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45112/0 (socket says 172.21.15.119:45112) 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879d452640 1 -- 172.21.15.119:0/529410291 learned_addr learned my addr 172.21.15.119:0/529410291 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879cc51640 1 --2- 172.21.15.119:0/529410291 >> v2:172.21.15.119:3300/0 conn(0x7f87980afc10 0x7f87980b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f878ffff640 1 -- 172.21.15.119:0/529410291 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646162023 0 0) 0x7f8798160800 con 0x7f879815c790 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f878ffff640 1 -- 172.21.15.119:0/529410291 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8784003530 con 0x7f879815c790 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879cc51640 1 -- 172.21.15.119:0/529410291 >> v1:172.21.15.143:6789/0 conn(0x7f879815cb70 legacy=0x7f879815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879cc51640 1 -- 172.21.15.119:0/529410291 >> v1:172.21.15.119:6789/0 conn(0x7f879815c790 legacy=0x7f8798160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.065+0000 7f879cc51640 1 -- 172.21.15.119:0/529410291 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879815daa0 con 0x7f87980afc10 2023-12-19T16:17:03.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879cc51640 1 --2- 172.21.15.119:0/529410291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f87980b0090 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f87880097c0 tx=0x7f878801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c7cc6273592da5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f878ffff640 1 -- 172.21.15.119:0/529410291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880ab600 con 0x7f87980afc10 2023-12-19T16:17:03.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f878ffff640 1 -- 172.21.15.119:0/529410291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880a7050 con 0x7f87980afc10 2023-12-19T16:17:03.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f878ffff640 1 -- 172.21.15.119:0/529410291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880ab980 con 0x7f87980afc10 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 -- 172.21.15.119:0/529410291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 msgr2=0x7f87980b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 --2- 172.21.15.119:0/529410291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f87980b0090 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f87880097c0 tx=0x7f878801c3f0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 -- 172.21.15.119:0/529410291 shutdown_connections 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 --2- 172.21.15.119:0/529410291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f87980b0090 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 -- 172.21.15.119:0/529410291 >> 172.21.15.119:0/529410291 conn(0x7f879806a2a0 msgr2=0x7f87980cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 -- 172.21.15.119:0/529410291 shutdown_connections 2023-12-19T16:17:03.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.069+0000 7f879e454640 1 -- 172.21.15.119:0/529410291 wait complete. 2023-12-19T16:17:03.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 Processor -- start 2023-12-19T16:17:03.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 -- start start 2023-12-19T16:17:03.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f8798149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f879815c790 0x7f87980b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f879815cb70 0x7f8798071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798070ce0 con 0x7f87980afc10 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879814a280 con 0x7f879815cb70 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8798070110 con 0x7f879815c790 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f8798149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f8798149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60842/0 (socket says 172.21.15.119:60842) 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 -- 172.21.15.119:0/2084754303 learned_addr learned my addr 172.21.15.119:0/2084754303 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879cc51640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f879815c790 0x7f87980b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879dc53640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f879815cb70 0x7f8798071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 -- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f879815c790 msgr2=0x7f87980b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f879815c790 0x7f87980b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 -- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f879815cb70 msgr2=0x7f8798071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f879815cb70 0x7f8798071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 -- 172.21.15.119:0/2084754303 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788009420 con 0x7f87980afc10 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879dc53640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f879815cb70 0x7f8798071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879d452640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f8798149d40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f879400c420 tx=0x7f879400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794005cf0 con 0x7f87980afc10 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794005e50 con 0x7f87980afc10 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87980703b0 con 0x7f87980afc10 2023-12-19T16:17:03.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.073+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940072d0 con 0x7f87980afc10 2023-12-19T16:17:03.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798070970 con 0x7f87980afc10 2023-12-19T16:17:03.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879804e850 con 0x7f87980afc10 2023-12-19T16:17:03.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8794007430 con 0x7f87980afc10 2023-12-19T16:17:03.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f878dffb640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f877c065a60 0x7f877c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f87940829e0 con 0x7f87980afc10 2023-12-19T16:17:03.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f879cc51640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f877c065a60 0x7f877c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.077+0000 7f879cc51640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f877c065a60 0x7f877c067f20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87880ad000 tx=0x7f8788008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.081+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f87940500e0 con 0x7f87980afc10 2023-12-19T16:17:03.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87980cb8a0 con 0x7f87980afc10 2023-12-19T16:17:03.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f878dffb640 1 -- 172.21.15.119:0/2084754303 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87940170a0 con 0x7f87980afc10 2023-12-19T16:17:03.239 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:03.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f877c065a60 msgr2=0x7f877c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f877c065a60 0x7f877c067f20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87880ad000 tx=0x7f8788008040 comp rx=0 tx=0).stop 2023-12-19T16:17:03.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 msgr2=0x7f8798149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f8798149d40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f879400c420 tx=0x7f879400c8e0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 shutdown_connections 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f877c065a60 0x7f877c067f20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f879815cb70 0x7f8798071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f879815c790 0x7f87980b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 --2- 172.21.15.119:0/2084754303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980afc10 0x7f8798149d40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.233+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 >> 172.21.15.119:0/2084754303 conn(0x7f879806a2a0 msgr2=0x7f8798167f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.237+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 shutdown_connections 2023-12-19T16:17:03.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.237+0000 7f879e454640 1 -- 172.21.15.119:0/2084754303 wait complete. 2023-12-19T16:17:03.260 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:03.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.393+0000 7fbd20e66640 1 Processor -- start 2023-12-19T16:17:03.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.393+0000 7fbd20e66640 1 -- start start 2023-12-19T16:17:03.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.393+0000 7fbd20e66640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbd1c0ca410 0x7fbd1c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.393+0000 7fbd20e66640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd1c159fb0 0x7fbd1c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd20e66640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c070df0 con 0x7fbd1c071db0 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd20e66640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c15aab0 con 0x7fbd1c0ca410 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd20e66640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c15a4f0 con 0x7fbd1c159fb0 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1a59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbd1c0ca410 0x7fbd1c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1ad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbd1c071db0 0x7fbd1c0cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45120/0 (socket says 172.21.15.119:45120) 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1ad9d640 1 -- 172.21.15.119:0/2157627581 learned_addr learned my addr 172.21.15.119:0/2157627581 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd11d9b640 1 --2- 172.21.15.119:0/2157627581 >> v2:172.21.15.143:3300/0 conn(0x7fbd1c159fb0 0x7fbd1c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1a59c640 1 -- 172.21.15.119:0/2157627581 >> v2:172.21.15.143:3300/0 conn(0x7fbd1c159fb0 msgr2=0x7fbd1c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1a59c640 1 --2- 172.21.15.119:0/2157627581 >> v2:172.21.15.143:3300/0 conn(0x7fbd1c159fb0 0x7fbd1c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1a59c640 1 -- 172.21.15.119:0/2157627581 >> v1:172.21.15.119:6789/0 conn(0x7fbd1c071db0 legacy=0x7fbd1c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1a59c640 1 -- 172.21.15.119:0/2157627581 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c15a7d0 con 0x7fbd1c0ca410 2023-12-19T16:17:03.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd19d9b640 1 -- 172.21.15.119:0/2157627581 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608498693 0 0) 0x7fbd1c070df0 con 0x7fbd1c071db0 2023-12-19T16:17:03.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd1a59c640 1 --2- 172.21.15.119:0/2157627581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c0ca410 0x7fbd1c159a70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0cbeb0 tx=0x7fbd0401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc5c92f6721d22c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd19d9b640 1 -- 172.21.15.119:0/2157627581 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040a7ae0 con 0x7fbd1c0ca410 2023-12-19T16:17:03.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd19d9b640 1 -- 172.21.15.119:0/2157627581 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd040a7c40 con 0x7fbd1c0ca410 2023-12-19T16:17:03.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.397+0000 7fbd19d9b640 1 -- 172.21.15.119:0/2157627581 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040af440 con 0x7fbd1c0ca410 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- 172.21.15.119:0/2157627581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c0ca410 msgr2=0x7fbd1c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 --2- 172.21.15.119:0/2157627581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c0ca410 0x7fbd1c159a70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0cbeb0 tx=0x7fbd0401eb00 comp rx=0 tx=0).stop 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- 172.21.15.119:0/2157627581 shutdown_connections 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 --2- 172.21.15.119:0/2157627581 >> v2:172.21.15.143:3300/0 conn(0x7fbd1c159fb0 0x7fbd1c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 --2- 172.21.15.119:0/2157627581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c0ca410 0x7fbd1c159a70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- 172.21.15.119:0/2157627581 >> 172.21.15.119:0/2157627581 conn(0x7fbd1c06a2a0 msgr2=0x7fbd1c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- 172.21.15.119:0/2157627581 shutdown_connections 2023-12-19T16:17:03.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- 172.21.15.119:0/2157627581 wait complete. 2023-12-19T16:17:03.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 Processor -- start 2023-12-19T16:17:03.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- start start 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 0x7fbd1c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd1c0ca410 0x7fbd1c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd1c159fb0 0x7fbd1c0c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c14f0c0 con 0x7fbd1c071db0 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c14e4b0 con 0x7fbd1c159fb0 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd20e66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c14e790 con 0x7fbd1c0ca410 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 0x7fbd1c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 0x7fbd1c14c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60854/0 (socket says 172.21.15.119:60854) 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd1a59c640 1 -- 172.21.15.119:0/4214097208 learned_addr learned my addr 172.21.15.119:0/4214097208 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd11d9b640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd1c0ca410 0x7fbd1c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.401+0000 7fbd1ad9d640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd1c159fb0 0x7fbd1c0c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1a59c640 1 -- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd1c0ca410 msgr2=0x7fbd1c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1a59c640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd1c0ca410 0x7fbd1c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1a59c640 1 -- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd1c159fb0 msgr2=0x7fbd1c0c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1a59c640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd1c159fb0 0x7fbd1c0c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1a59c640 1 -- 172.21.15.119:0/4214097208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0400b6c0 con 0x7fbd1c071db0 2023-12-19T16:17:03.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1ad9d640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd1c159fb0 0x7fbd1c0c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd1a59c640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 0x7fbd1c14c980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbd0401b710 tx=0x7fbd0401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040a7ae0 con 0x7fbd1c071db0 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04006e20 con 0x7fbd1c071db0 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04004230 con 0x7fbd1c071db0 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c14ea70 con 0x7fbd1c071db0 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c14a2d0 con 0x7fbd1c071db0 2023-12-19T16:17:03.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c04e000 con 0x7fbd1c071db0 2023-12-19T16:17:03.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd040b6040 con 0x7fbd1c071db0 2023-12-19T16:17:03.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.405+0000 7fbd137fe640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbcfc065a60 0x7fbcfc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.409+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fbd0411e420 con 0x7fbd1c071db0 2023-12-19T16:17:03.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.409+0000 7fbd11d9b640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbcfc065a60 0x7fbcfc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.409+0000 7fbd11d9b640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbcfc065a60 0x7fbcfc067f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0b08b0 tx=0x7fbd0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.409+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd040ebb00 con 0x7fbd1c071db0 2023-12-19T16:17:03.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.561+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fbd1c04e000 con 0x7fbd1c071db0 2023-12-19T16:17:03.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.561+0000 7fbd137fe640 1 -- 172.21.15.119:0/4214097208 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7fbd040ef120 con 0x7fbd1c071db0 2023-12-19T16:17:03.569 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbcfc065a60 msgr2=0x7fbcfc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbcfc065a60 0x7fbcfc067f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0b08b0 tx=0x7fbd0c008040 comp rx=0 tx=0).stop 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 msgr2=0x7fbd1c14c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 0x7fbd1c14c980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbd0401b710 tx=0x7fbd0401d340 comp rx=0 tx=0).stop 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 shutdown_connections 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbcfc065a60 0x7fbcfc067f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd1c159fb0 0x7fbd1c0c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd1c0ca410 0x7fbd1c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 --2- 172.21.15.119:0/4214097208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1c071db0 0x7fbd1c14c980 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 >> 172.21.15.119:0/4214097208 conn(0x7fbd1c06a2a0 msgr2=0x7fbd1c157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:03.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 shutdown_connections 2023-12-19T16:17:03.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.565+0000 7fbd20e66640 1 -- 172.21.15.119:0/4214097208 wait complete. 2023-12-19T16:17:03.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:03.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 Processor -- start 2023-12-19T16:17:03.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 -- start start 2023-12-19T16:17:03.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61f41570c0 0x7f61f406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61f406c320 0x7f61f40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40c9460 con 0x7f61f40c9e30 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f406c7a0 con 0x7f61f406c320 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f9a95640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f41574a0 con 0x7f61f41570c0 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61f406c320 0x7f61f40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61f406c320 0x7f61f40c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60858/0 (socket says 172.21.15.119:60858) 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f2ffd640 1 -- 172.21.15.119:0/3870592315 learned_addr learned my addr 172.21.15.119:0/3870592315 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.721+0000 7f61f37fe640 1 --2- 172.21.15.119:0/3870592315 >> v2:172.21.15.143:3300/0 conn(0x7f61f41570c0 0x7f61f406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f2ffd640 1 -- 172.21.15.119:0/3870592315 >> v2:172.21.15.143:3300/0 conn(0x7f61f41570c0 msgr2=0x7f61f406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f2ffd640 1 --2- 172.21.15.119:0/3870592315 >> v2:172.21.15.143:3300/0 conn(0x7f61f41570c0 0x7f61f406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f2ffd640 1 -- 172.21.15.119:0/3870592315 >> v1:172.21.15.143:6789/0 conn(0x7f61f40c9e30 legacy=0x7f61f415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f2ffd640 1 -- 172.21.15.119:0/3870592315 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40c8b30 con 0x7f61f406c320 2023-12-19T16:17:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f37fe640 1 --2- 172.21.15.119:0/3870592315 >> v2:172.21.15.143:3300/0 conn(0x7f61f41570c0 0x7f61f406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:03.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f2ffd640 1 --2- 172.21.15.119:0/3870592315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f40c98f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f61f406e280 tx=0x7f61e801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd56acfc959a205 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f27fc640 1 -- 172.21.15.119:0/3870592315 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8004230 con 0x7f61f406c320 2023-12-19T16:17:03.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f27fc640 1 -- 172.21.15.119:0/3870592315 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e80a7050 con 0x7f61f406c320 2023-12-19T16:17:03.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f27fc640 1 -- 172.21.15.119:0/3870592315 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8003620 con 0x7f61f406c320 2023-12-19T16:17:03.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f9a95640 1 -- 172.21.15.119:0/3870592315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 msgr2=0x7f61f40c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f9a95640 1 --2- 172.21.15.119:0/3870592315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f40c98f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f61f406e280 tx=0x7f61e801c440 comp rx=0 tx=0).stop 2023-12-19T16:17:03.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f9a95640 1 -- 172.21.15.119:0/3870592315 shutdown_connections 2023-12-19T16:17:03.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f9a95640 1 --2- 172.21.15.119:0/3870592315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f40c98f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f9a95640 1 --2- 172.21.15.119:0/3870592315 >> v2:172.21.15.143:3300/0 conn(0x7f61f41570c0 0x7f61f406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.725+0000 7f61f9a95640 1 -- 172.21.15.119:0/3870592315 >> 172.21.15.119:0/3870592315 conn(0x7f61f406a3e0 msgr2=0x7f61f40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:03.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 -- 172.21.15.119:0/3870592315 shutdown_connections 2023-12-19T16:17:03.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 -- 172.21.15.119:0/3870592315 wait complete. 2023-12-19T16:17:03.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 Processor -- start 2023-12-19T16:17:03.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 -- start start 2023-12-19T16:17:03.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61f40c9e30 0x7f61f4152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61f41570c0 0x7f61f40cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4155ba0 con 0x7f61f406c320 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4152080 con 0x7f61f40c9e30 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f9a95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4152360 con 0x7f61f41570c0 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60872/0 (socket says 172.21.15.119:60872) 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 -- 172.21.15.119:0/4282895389 learned_addr learned my addr 172.21.15.119:0/4282895389 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f2ffd640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61f40c9e30 0x7f61f4152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f3fff640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61f41570c0 0x7f61f40cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 -- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61f41570c0 msgr2=0x7f61f40cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61f41570c0 0x7f61f40cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 -- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61f40c9e30 msgr2=0x7f61f4152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61f40c9e30 0x7f61f4152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 -- 172.21.15.119:0/4282895389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80094d0 con 0x7f61f406c320 2023-12-19T16:17:03.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.729+0000 7f61f37fe640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f4155370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61e400e810 tx=0x7f61e400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400c8d0 con 0x7f61f406c320 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400ca30 con 0x7f61f406c320 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f4152640 con 0x7f61f406c320 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400cde0 con 0x7f61f406c320 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f41558b0 con 0x7f61f406c320 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f40735b0 con 0x7f61f406c320 2023-12-19T16:17:03.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61e4013410 con 0x7f61f406c320 2023-12-19T16:17:03.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61dbfff640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61e0065a60 0x7f61e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:03.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f61e40835e0 con 0x7f61f406c320 2023-12-19T16:17:03.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.733+0000 7f61f2ffd640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61e0065a60 0x7f61e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:03.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.737+0000 7f61f2ffd640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61e0065a60 0x7f61e0067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61e80ad000 tx=0x7f61e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:03.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.737+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f61e4050cd0 con 0x7f61f406c320 2023-12-19T16:17:03.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.897+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f61f404e000 con 0x7f61f406c320 2023-12-19T16:17:03.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.897+0000 7f61dbfff640 1 -- 172.21.15.119:0/4282895389 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61e40542f0 con 0x7f61f406c320 2023-12-19T16:17:03.905 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:17:03.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61e0065a60 msgr2=0x7f61e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61e0065a60 0x7f61e0067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61e80ad000 tx=0x7f61e8009040 comp rx=0 tx=0).stop 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 msgr2=0x7f61f4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f4155370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61e400e810 tx=0x7f61e400ecd0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 shutdown_connections 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61e0065a60 0x7f61e0067f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61f40c9e30 0x7f61f4152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61f41570c0 0x7f61f40cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 --2- 172.21.15.119:0/4282895389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61f406c320 0x7f61f4155370 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 >> 172.21.15.119:0/4282895389 conn(0x7f61f406a3e0 msgr2=0x7f61f40c2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 shutdown_connections 2023-12-19T16:17:03.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:03.901+0000 7f61f9a95640 1 -- 172.21.15.119:0/4282895389 wait complete. 2023-12-19T16:17:03.925 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:17:03.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:03.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:03.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[49707]: fuse finished with error 0 and tester_r 0 2023-12-19T16:17:03.947 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:10.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:17:10.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.049 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:17:10.060 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:17:10.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.240+0000 7ffb5c57b640 1 Processor -- start 2023-12-19T16:17:10.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.240+0000 7ffb5c57b640 1 -- start start 2023-12-19T16:17:10.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5c57b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb541570c0 0x7ffb5406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5c57b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5c57b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb540c9460 con 0x7ffb5406c320 2023-12-19T16:17:10.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5c57b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5406c7a0 con 0x7ffb541570c0 2023-12-19T16:17:10.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5c57b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb541574a0 con 0x7ffb540ca000 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb541570c0 0x7ffb5406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb541570c0 0x7ffb5406bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60876/0 (socket says 172.21.15.119:60876) 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 -- 172.21.15.119:0/2068076105 learned_addr learned my addr 172.21.15.119:0/2068076105 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 -- 172.21.15.119:0/2068076105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 msgr2=0x7ffb54070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 --2- 172.21.15.119:0/2068076105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 -- 172.21.15.119:0/2068076105 >> v1:172.21.15.119:6789/0 conn(0x7ffb5406c320 legacy=0x7ffb540c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.244+0000 7ffb5a317640 1 -- 172.21.15.119:0/2068076105 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540c8b30 con 0x7ffb541570c0 2023-12-19T16:17:10.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5a317640 1 --2- 172.21.15.119:0/2068076105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb5406bde0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009870 tx=0x7ffb5001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d92c35f06716cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb59315640 1 -- 172.21.15.119:0/2068076105 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500ab680 con 0x7ffb541570c0 2023-12-19T16:17:10.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb59315640 1 -- 172.21.15.119:0/2068076105 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb500ab7e0 con 0x7ffb541570c0 2023-12-19T16:17:10.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb59315640 1 -- 172.21.15.119:0/2068076105 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500abb70 con 0x7ffb541570c0 2023-12-19T16:17:10.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 -- 172.21.15.119:0/2068076105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 msgr2=0x7ffb5406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/2068076105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb5406bde0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009870 tx=0x7ffb5001c480 comp rx=0 tx=0).stop 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 -- 172.21.15.119:0/2068076105 shutdown_connections 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/2068076105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/2068076105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb5406bde0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 -- 172.21.15.119:0/2068076105 >> 172.21.15.119:0/2068076105 conn(0x7ffb5406a3e0 msgr2=0x7ffb540afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 -- 172.21.15.119:0/2068076105 shutdown_connections 2023-12-19T16:17:10.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 -- 172.21.15.119:0/2068076105 wait complete. 2023-12-19T16:17:10.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 Processor -- start 2023-12-19T16:17:10.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.248+0000 7ffb5c57b640 1 -- start start 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb5406c320 0x7ffb54159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb540caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c5db0 con 0x7ffb541570c0 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54149b90 con 0x7ffb5406c320 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54159b30 con 0x7ffb540ca000 2023-12-19T16:17:10.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb540caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb540caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60882/0 (socket says 172.21.15.119:60882) 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 -- 172.21.15.119:0/758356182 learned_addr learned my addr 172.21.15.119:0/758356182 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5a317640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb5406c320 0x7ffb54159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb59b16640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 -- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 msgr2=0x7ffb54149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 -- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb5406c320 msgr2=0x7ffb54159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb5406c320 0x7ffb54159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 -- 172.21.15.119:0/758356182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500094d0 con 0x7ffb541570c0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5ab18640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb540caf30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00b970 tx=0x7ffb4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00cb40 con 0x7ffb541570c0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00ccc0 con 0x7ffb541570c0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c014680 con 0x7ffb541570c0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54159e10 con 0x7ffb541570c0 2023-12-19T16:17:10.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb540c62e0 con 0x7ffb541570c0 2023-12-19T16:17:10.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540735b0 con 0x7ffb541570c0 2023-12-19T16:17:10.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.252+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb4c01d3b0 con 0x7ffb541570c0 2023-12-19T16:17:10.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.256+0000 7ffb4affd640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffb38065a60 0x7ffb38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.256+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ffb4c0833c0 con 0x7ffb541570c0 2023-12-19T16:17:10.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.256+0000 7ffb5a317640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffb38065a60 0x7ffb38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.256+0000 7ffb5a317640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffb38065a60 0x7ffb38067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb500af000 tx=0x7ffb500b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.260+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb4c050ac0 con 0x7ffb541570c0 2023-12-19T16:17:10.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.440+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb540c6500 con 0x7ffb541570c0 2023-12-19T16:17:10.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb4affd640 1 -- 172.21.15.119:0/758356182 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7ffb4c019070 con 0x7ffb541570c0 2023-12-19T16:17:10.449 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-12-19T16:17:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffb38065a60 msgr2=0x7ffb38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffb38065a60 0x7ffb38067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb500af000 tx=0x7ffb500b6040 comp rx=0 tx=0).stop 2023-12-19T16:17:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 msgr2=0x7ffb540caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb540caf30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00b970 tx=0x7ffb4c00be30 comp rx=0 tx=0).stop 2023-12-19T16:17:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 shutdown_connections 2023-12-19T16:17:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffb38065a60 0x7ffb38067f20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb541570c0 0x7ffb540caf30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb540ca000 0x7ffb54149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 --2- 172.21.15.119:0/758356182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb5406c320 0x7ffb54159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 >> 172.21.15.119:0/758356182 conn(0x7ffb5406a3e0 msgr2=0x7ffb540c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 shutdown_connections 2023-12-19T16:17:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:10.444+0000 7ffb5c57b640 1 -- 172.21.15.119:0/758356182 wait complete. 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:17:10.470 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:10.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.471 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:17:10.480 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:17:10.481 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:10.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.484 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:17:10.543 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:17:10.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.546 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:17:10.599 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:17:10.599 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:17:10.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.600 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:17:10.601 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:17:10.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:17:10.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:17:10.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:17:10.601 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:17:10.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.695 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:17:10.705 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:17:10.705 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:17:10.706 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:10.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:10.706 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:17:10.772 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:17:10.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:10.773 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:10.825 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:10.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:10.825 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:10.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:17:10.938 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:17:10.938 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:17:10.999 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:17:11.001 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:17:11.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.001 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:17:11.053 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:17:11.053 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:17:11.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:17:11.122 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:17:11.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:17:11.185 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:17:11.187 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:17:11.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.188 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:17:11.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:17:11.188+0000 7f29fcc4e580 -1 init, newargv = 0x55badf04fec0 newargc=15 2023-12-19T16:17:11.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[50273]: starting ceph client 2023-12-19T16:17:11.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[50273]: starting fuse 2023-12-19T16:17:11.205 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:17:11.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:17:11.206 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:17:11.206 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:17:11.206 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:17:11.206 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:17:11.206 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:17:11.207 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:17:11.208 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:17:11.327 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.50273.asok 2023-12-19T16:17:11.512 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50273.asok 2023-12-19T16:17:11.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.513 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50273.asok status 2023-12-19T16:17:11.680 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:17:11.680 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "50273", 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5832, 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:17:11.681 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5832 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2980177682 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:17:11.682 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2980177682 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5832 192.168.0.1:0/2980177682", 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/2980177682", 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 18, 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 42, 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:17:11.683 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:17:11.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.695 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:17:11.695 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:11.704 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:17:11.705 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:11.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.705 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:11.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.773 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-12-19T16:17:11.824 INFO:teuthology.orchestra.run.smithi119.stderr:setfattr: layoutfile: Permission denied 2023-12-19T16:17:11.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:11.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:11.825 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-12-19T16:17:11.879 INFO:teuthology.orchestra.run.smithi119.stderr:setfattr: layoutdir: Permission denied 2023-12-19T16:17:11.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:11.881 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:11.881 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:11.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.116+0000 7eff9bf09640 1 Processor -- start 2023-12-19T16:17:12.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.116+0000 7eff9bf09640 1 -- start start 2023-12-19T16:17:12.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9bf09640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7eff9406c4f0 0x7eff940c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9bf09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff940c9e30 0x7eff94070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9bf09640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940c9460 con 0x7eff941570c0 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9bf09640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff941574a0 con 0x7eff9406c4f0 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9bf09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c8b30 con 0x7eff940c9e30 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7eff9406c4f0 0x7eff940c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7eff9406c4f0 0x7eff940c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60894/0 (socket says 172.21.15.119:60894) 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 -- 172.21.15.119:0/1109906714 learned_addr learned my addr 172.21.15.119:0/1109906714 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff99ca5640 1 --1- 172.21.15.119:0/1109906714 >> v1:172.21.15.119:6789/0 conn(0x7eff941570c0 0x7eff9406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45142/0 (socket says 172.21.15.119:45142) 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9a4a6640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff940c9e30 0x7eff94070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 -- 172.21.15.119:0/1109906714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff940c9e30 msgr2=0x7eff94070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff940c9e30 0x7eff94070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 -- 172.21.15.119:0/1109906714 >> v1:172.21.15.119:6789/0 conn(0x7eff941570c0 legacy=0x7eff9406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff994a4640 1 -- 172.21.15.119:0/1109906714 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940c8e10 con 0x7eff9406c4f0 2023-12-19T16:17:12.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.120+0000 7eff9a4a6640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff940c9e30 0x7eff94070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff994a4640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940c98f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7eff84009870 tx=0x7eff8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2821e790f34ccf61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff98ca3640 1 -- 172.21.15.119:0/1109906714 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840ad640 con 0x7eff9406c4f0 2023-12-19T16:17:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff98ca3640 1 -- 172.21.15.119:0/1109906714 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840ad7a0 con 0x7eff9406c4f0 2023-12-19T16:17:12.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff98ca3640 1 -- 172.21.15.119:0/1109906714 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840adb30 con 0x7eff9406c4f0 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 -- 172.21.15.119:0/1109906714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 msgr2=0x7eff940c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940c98f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7eff84009870 tx=0x7eff8401c480 comp rx=0 tx=0).stop 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 -- 172.21.15.119:0/1109906714 shutdown_connections 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff940c9e30 0x7eff94070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 --2- 172.21.15.119:0/1109906714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940c98f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 -- 172.21.15.119:0/1109906714 >> 172.21.15.119:0/1109906714 conn(0x7eff9406a3e0 msgr2=0x7eff940afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 -- 172.21.15.119:0/1109906714 shutdown_connections 2023-12-19T16:17:12.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 -- 172.21.15.119:0/1109906714 wait complete. 2023-12-19T16:17:12.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 Processor -- start 2023-12-19T16:17:12.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.124+0000 7eff9bf09640 1 -- start start 2023-12-19T16:17:12.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff940c9e30 0x7eff940cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff941570c0 0x7eff940cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c13a0 con 0x7eff9406c4f0 2023-12-19T16:17:12.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940ac9b0 con 0x7eff940c9e30 2023-12-19T16:17:12.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940abda0 con 0x7eff941570c0 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60906/0 (socket says 172.21.15.119:60906) 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 -- 172.21.15.119:0/3564664135 learned_addr learned my addr 172.21.15.119:0/3564664135 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff994a4640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff940c9e30 0x7eff940cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 -- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff941570c0 msgr2=0x7eff940cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff941570c0 0x7eff940cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 -- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff940c9e30 msgr2=0x7eff940cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff940c9e30 0x7eff940cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 -- 172.21.15.119:0/3564664135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840094d0 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff994a4640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff940c9e30 0x7eff940cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff99ca5640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940ace40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c490 tx=0x7eff9000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90007480 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900075e0 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940ac080 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90004a10 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff940ac640 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940735b0 con 0x7eff9406c4f0 2023-12-19T16:17:12.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.128+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff90004b70 con 0x7eff9406c4f0 2023-12-19T16:17:12.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.132+0000 7eff8a7fc640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7eff78065a60 0x7eff78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.132+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7eff90082720 con 0x7eff9406c4f0 2023-12-19T16:17:12.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.132+0000 7eff994a4640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7eff78065a60 0x7eff78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.132+0000 7eff994a4640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7eff78065a60 0x7eff78067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff840af000 tx=0x7eff840a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.136+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff9004fd70 con 0x7eff9406c4f0 2023-12-19T16:17:12.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.288+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff9404e000 con 0x7eff9406c4f0 2023-12-19T16:17:12.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.288+0000 7eff8a7fc640 1 -- 172.21.15.119:0/3564664135 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7eff90053390 con 0x7eff9406c4f0 2023-12-19T16:17:12.293 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:12.293 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7eff78065a60 msgr2=0x7eff78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7eff78065a60 0x7eff78067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff840af000 tx=0x7eff840a7070 comp rx=0 tx=0).stop 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 msgr2=0x7eff940ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940ace40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c490 tx=0x7eff9000c950 comp rx=0 tx=0).stop 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 shutdown_connections 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7eff78065a60 0x7eff78067f20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff940c9e30 0x7eff940cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff941570c0 0x7eff940cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 --2- 172.21.15.119:0/3564664135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff9406c4f0 0x7eff940ace40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 >> 172.21.15.119:0/3564664135 conn(0x7eff9406a3e0 msgr2=0x7eff940c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 shutdown_connections 2023-12-19T16:17:12.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.292+0000 7eff9bf09640 1 -- 172.21.15.119:0/3564664135 wait complete. 2023-12-19T16:17:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:12.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:12.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 Processor -- start 2023-12-19T16:17:12.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 -- start start 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb00815cae0 0x7fb0080d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 0x7fb0080ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00815cec0 con 0x7fb0080cf170 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080d0530 con 0x7fb00815cae0 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb00de8c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080d0810 con 0x7fb0080cde90 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb007fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb0080cf170 0x7fb00806add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45158/0 (socket says 172.21.15.119:45158) 2023-12-19T16:17:12.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb007fff640 1 -- 172.21.15.119:0/1347084736 learned_addr learned my addr 172.21.15.119:0/1347084736 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb006ffd640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 0x7fb0080ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0077fe640 1 --2- 172.21.15.119:0/1347084736 >> v2:172.21.15.143:3300/0 conn(0x7fb00815cae0 0x7fb0080d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695439510 0 0) 0x7fb00815cec0 con 0x7fb0080cf170 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff0003530 con 0x7fb0080cf170 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 467281066 0 0) 0x7faff0003530 con 0x7fb0080cf170 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 msgr2=0x7fb0080ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.458 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 0x7fb0080ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 >> v2:172.21.15.143:3300/0 conn(0x7fb00815cae0 msgr2=0x7fb0080d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 --2- 172.21.15.119:0/1347084736 >> v2:172.21.15.143:3300/0 conn(0x7fb00815cae0 0x7fb0080d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080d0af0 con 0x7fb0080cf170 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.452+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fb000001a00 con 0x7fb0080cf170 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 >> v1:172.21.15.119:6789/0 conn(0x7fb0080cf170 legacy=0x7fb00806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 0x7faff0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faff0003f00 0x7faff00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff0004d10 0x7faff0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080d0530 con 0x7faff0004d10 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080d0810 con 0x7faff0003f00 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff000b990 con 0x7fb0080cde90 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff0004d10 0x7faff0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0077fe640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 0x7faff0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb006ffd640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faff0003f00 0x7faff00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 -- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 msgr2=0x7faff0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0080cde90 0x7faff0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 -- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faff0003f00 msgr2=0x7faff00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faff0003f00 0x7faff00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 -- 172.21.15.119:0/1347084736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0003530 con 0x7faff0004d10 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb006ffd640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faff0003f00 0x7faff00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:12.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb007fff640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff0004d10 0x7faff0005190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb00000a830 tx=0x7fb00001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9246e4848fadca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000ad630 con 0x7faff0004d10 2023-12-19T16:17:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0000a8070 con 0x7faff0004d10 2023-12-19T16:17:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.456+0000 7fb0067fc640 1 -- 172.21.15.119:0/1347084736 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000ada30 con 0x7faff0004d10 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- 172.21.15.119:0/1347084736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff0004d10 msgr2=0x7faff0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1347084736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff0004d10 0x7faff0005190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb00000a830 tx=0x7fb00001d300 comp rx=0 tx=0).stop 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb007fff640 1 -- 172.21.15.119:0/1347084736 reap_dead start 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- 172.21.15.119:0/1347084736 shutdown_connections 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- 172.21.15.119:0/1347084736 >> 172.21.15.119:0/1347084736 conn(0x7fb008089fb0 msgr2=0x7fb0080d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- 172.21.15.119:0/1347084736 shutdown_connections 2023-12-19T16:17:12.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- 172.21.15.119:0/1347084736 wait complete. 2023-12-19T16:17:12.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 Processor -- start 2023-12-19T16:17:12.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- start start 2023-12-19T16:17:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faff0004d10 0x7fb0080cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 0x7fb00809fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0080a0080 0x7fb0080b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081f3de0 con 0x7fb0081f2f40 2023-12-19T16:17:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081f34b0 con 0x7fb0080a0080 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb00de8c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081f3790 con 0x7faff0004d10 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb006ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 0x7fb00809fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb006ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 0x7fb00809fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60930/0 (socket says 172.21.15.119:60930) 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.460+0000 7fb006ffd640 1 -- 172.21.15.119:0/1364106191 learned_addr learned my addr 172.21.15.119:0/1364106191 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb0077fe640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faff0004d10 0x7fb0080cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb007fff640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0080a0080 0x7fb0080b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb006ffd640 1 -- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faff0004d10 msgr2=0x7fb0080cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb006ffd640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faff0004d10 0x7fb0080cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb006ffd640 1 -- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0080a0080 msgr2=0x7fb0080b7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb006ffd640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0080a0080 0x7fb0080b7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb006ffd640 1 -- 172.21.15.119:0/1364106191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0081f3a70 con 0x7fb0081f2f40 2023-12-19T16:17:12.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb006ffd640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 0x7fb00809fb40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faffc0115f0 tx=0x7faffc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc004220 con 0x7fb0081f2f40 2023-12-19T16:17:12.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc004380 con 0x7fb0081f2f40 2023-12-19T16:17:12.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc00f8f0 con 0x7fb0081f2f40 2023-12-19T16:17:12.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0080cc060 con 0x7fb0081f2f40 2023-12-19T16:17:12.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0080b8440 con 0x7fb0081f2f40 2023-12-19T16:17:12.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0080b86c0 con 0x7fb0081f2f40 2023-12-19T16:17:12.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faffc00fa50 con 0x7fb0081f2f40 2023-12-19T16:17:12.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fafeffff640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faff4065a60 0x7faff4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7faffc083730 con 0x7fb0081f2f40 2023-12-19T16:17:12.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.464+0000 7fb0077fe640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faff4065a60 0x7faff4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.468+0000 7fb0077fe640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faff4065a60 0x7faff4067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faff8009b80 tx=0x7faff8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.468+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb0080b86c0 con 0x7fb0081f2f40 2023-12-19T16:17:12.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.616+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0080b86c0 con 0x7fb0081f2f40 2023-12-19T16:17:12.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fafeffff640 1 -- 172.21.15.119:0/1364106191 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0080b86c0 con 0x7fb0081f2f40 2023-12-19T16:17:12.622 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faff4065a60 msgr2=0x7faff4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faff4065a60 0x7faff4067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faff8009b80 tx=0x7faff8008040 comp rx=0 tx=0).stop 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 msgr2=0x7fb00809fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 0x7fb00809fb40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faffc0115f0 tx=0x7faffc011ab0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 shutdown_connections 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7faff4065a60 0x7faff4067f20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0080a0080 0x7fb0080b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0081f2f40 0x7fb00809fb40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 --2- 172.21.15.119:0/1364106191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faff0004d10 0x7fb0080cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 >> 172.21.15.119:0/1364106191 conn(0x7fb008089fb0 msgr2=0x7fb00815f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 shutdown_connections 2023-12-19T16:17:12.624 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.620+0000 7fb00de8c640 1 -- 172.21.15.119:0/1364106191 wait complete. 2023-12-19T16:17:12.643 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:12.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde42d11640 1 Processor -- start 2023-12-19T16:17:12.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde42d11640 1 -- start start 2023-12-19T16:17:12.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde42d11640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fde3c0cde90 0x7fde3c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde42d11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c15cec0 con 0x7fde3c0cf170 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde42d11640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0d0530 con 0x7fde3c15cae0 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde42d11640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c0d0810 con 0x7fde3c0cde90 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde412ae640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fde3c0cf170 0x7fde3c06add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:44128/0 (socket says 172.21.15.119:44128) 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde412ae640 1 -- 172.21.15.119:0/1730935892 learned_addr learned my addr 172.21.15.119:0/1730935892 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3bfff640 1 --2- 172.21.15.119:0/1730935892 >> v2:172.21.15.143:3300/0 conn(0x7fde3c0cde90 0x7fde3c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950960396 0 0) 0x7fde3c15cec0 con 0x7fde3c0cf170 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde2c003530 con 0x7fde3c0cf170 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633628078 0 0) 0x7fde3c0d0530 con 0x7fde3c15cae0 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde3c15cec0 con 0x7fde3c15cae0 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3bfff640 1 -- 172.21.15.119:0/1730935892 >> v1:172.21.15.143:6789/0 conn(0x7fde3c15cae0 legacy=0x7fde3c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3bfff640 1 -- 172.21.15.119:0/1730935892 >> v1:172.21.15.119:6789/0 conn(0x7fde3c0cf170 legacy=0x7fde3c06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.780+0000 7fde3bfff640 1 -- 172.21.15.119:0/1730935892 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0d0af0 con 0x7fde3c0cde90 2023-12-19T16:17:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde3bfff640 1 --2- 172.21.15.119:0/1730935892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cde90 0x7fde3c0ce2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde280097c0 tx=0x7fde2801ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a60aa31f70a1b58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280ab670 con 0x7fde3c0cde90 2023-12-19T16:17:12.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde280ab7d0 con 0x7fde3c0cde90 2023-12-19T16:17:12.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde3b7fe640 1 -- 172.21.15.119:0/1730935892 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280abb40 con 0x7fde3c0cde90 2023-12-19T16:17:12.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 -- 172.21.15.119:0/1730935892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cde90 msgr2=0x7fde3c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 --2- 172.21.15.119:0/1730935892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cde90 0x7fde3c0ce2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde280097c0 tx=0x7fde2801ceb0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 -- 172.21.15.119:0/1730935892 shutdown_connections 2023-12-19T16:17:12.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 --2- 172.21.15.119:0/1730935892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cde90 0x7fde3c0ce2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 -- 172.21.15.119:0/1730935892 >> 172.21.15.119:0/1730935892 conn(0x7fde3c089fb0 msgr2=0x7fde3c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 -- 172.21.15.119:0/1730935892 shutdown_connections 2023-12-19T16:17:12.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.784+0000 7fde42d11640 1 -- 172.21.15.119:0/1730935892 wait complete. 2023-12-19T16:17:12.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 Processor -- start 2023-12-19T16:17:12.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 -- start start 2023-12-19T16:17:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde3c0cde90 0x7fde3c0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cf170 0x7fde3c0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 0x7fde3c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c15a0d0 con 0x7fde3c15cae0 2023-12-19T16:17:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c1593a0 con 0x7fde3c0cf170 2023-12-19T16:17:12.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c159c40 con 0x7fde3c0cde90 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 0x7fde3c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 0x7fde3c0c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34706/0 (socket says 172.21.15.119:34706) 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 -- 172.21.15.119:0/2328666814 learned_addr learned my addr 172.21.15.119:0/2328666814 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde3bfff640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cf170 0x7fde3c0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde40aad640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde3c0cde90 0x7fde3c0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 -- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde3c0cde90 msgr2=0x7fde3c0b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde3c0cde90 0x7fde3c0b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 -- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cf170 msgr2=0x7fde3c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cf170 0x7fde3c0c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 -- 172.21.15.119:0/2328666814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009420 con 0x7fde3c15cae0 2023-12-19T16:17:12.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde412ae640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 0x7fde3c0c9df0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fde3400cad0 tx=0x7fde3400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3400ac30 con 0x7fde3c15cae0 2023-12-19T16:17:12.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3400ad90 con 0x7fde3c15cae0 2023-12-19T16:17:12.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34012620 con 0x7fde3c15cae0 2023-12-19T16:17:12.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c0cfb10 con 0x7fde3c15cae0 2023-12-19T16:17:12.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.788+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c1595f0 con 0x7fde3c15cae0 2023-12-19T16:17:12.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.792+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c159dd0 con 0x7fde3c15cae0 2023-12-19T16:17:12.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.792+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde34007070 con 0x7fde3c15cae0 2023-12-19T16:17:12.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.792+0000 7fde397fa640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde20065a90 0x7fde20067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.792+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fde340832f0 con 0x7fde3c15cae0 2023-12-19T16:17:12.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.792+0000 7fde40aad640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde20065a90 0x7fde20067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.792+0000 7fde40aad640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde20065a90 0x7fde20067f50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde30007fd0 tx=0x7fde30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.796+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fde34050a80 con 0x7fde3c15cae0 2023-12-19T16:17:12.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.944+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde3c04e000 con 0x7fde3c15cae0 2023-12-19T16:17:12.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.944+0000 7fde397fa640 1 -- 172.21.15.119:0/2328666814 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde340540a0 con 0x7fde3c15cae0 2023-12-19T16:17:12.949 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde20065a90 msgr2=0x7fde20067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde20065a90 0x7fde20067f50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde30007fd0 tx=0x7fde30009040 comp rx=0 tx=0).stop 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 msgr2=0x7fde3c0c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 0x7fde3c0c9df0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fde3400cad0 tx=0x7fde3400cf90 comp rx=0 tx=0).stop 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 shutdown_connections 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde20065a90 0x7fde20067f50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde3c0cf170 0x7fde3c0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c15cae0 0x7fde3c0c9df0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 --2- 172.21.15.119:0/2328666814 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde3c0cde90 0x7fde3c0b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 >> 172.21.15.119:0/2328666814 conn(0x7fde3c089fb0 msgr2=0x7fde3c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 shutdown_connections 2023-12-19T16:17:12.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:12.948+0000 7fde42d11640 1 -- 172.21.15.119:0/2328666814 wait complete. 2023-12-19T16:17:12.969 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:13.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 Processor -- start 2023-12-19T16:17:13.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 -- start start 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff33c071870 0x7ff33c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff33c0cbff0 0x7ff33c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0cc930 con 0x7ff33c0ca410 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c15aab0 con 0x7ff33c071870 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff340f96640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c070df0 con 0x7ff33c0cbff0 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff339d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff33c071870 0x7ff33c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff339d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff33c071870 0x7ff33c071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34712/0 (socket says 172.21.15.119:34712) 2023-12-19T16:17:13.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff339d9b640 1 -- 172.21.15.119:0/4279166531 learned_addr learned my addr 172.21.15.119:0/4279166531 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:13.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.108+0000 7ff33ad9d640 1 --2- 172.21.15.119:0/4279166531 >> v2:172.21.15.143:3300/0 conn(0x7ff33c0cbff0 0x7ff33c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff339d9b640 1 -- 172.21.15.119:0/4279166531 >> v2:172.21.15.143:3300/0 conn(0x7ff33c0cbff0 msgr2=0x7ff33c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:13.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff339d9b640 1 --2- 172.21.15.119:0/4279166531 >> v2:172.21.15.143:3300/0 conn(0x7ff33c0cbff0 0x7ff33c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff339d9b640 1 -- 172.21.15.119:0/4279166531 >> v1:172.21.15.143:6789/0 conn(0x7ff33c0ca410 legacy=0x7ff33c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff339d9b640 1 -- 172.21.15.119:0/4279166531 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c15a4f0 con 0x7ff33c071870 2023-12-19T16:17:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff339d9b640 1 --2- 172.21.15.119:0/4279166531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c071d00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0c1ef0 tx=0x7ff33001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4786edda38b89efb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.116 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff33959a640 1 -- 172.21.15.119:0/4279166531 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3300aa430 con 0x7ff33c071870 2023-12-19T16:17:13.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff33959a640 1 -- 172.21.15.119:0/4279166531 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3300aa590 con 0x7ff33c071870 2023-12-19T16:17:13.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff33959a640 1 -- 172.21.15.119:0/4279166531 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3300aa920 con 0x7ff33c071870 2023-12-19T16:17:13.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff340f96640 1 -- 172.21.15.119:0/4279166531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 msgr2=0x7ff33c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.112+0000 7ff340f96640 1 --2- 172.21.15.119:0/4279166531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c071d00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0c1ef0 tx=0x7ff33001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- 172.21.15.119:0/4279166531 shutdown_connections 2023-12-19T16:17:13.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 --2- 172.21.15.119:0/4279166531 >> v2:172.21.15.143:3300/0 conn(0x7ff33c0cbff0 0x7ff33c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 --2- 172.21.15.119:0/4279166531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c071d00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- 172.21.15.119:0/4279166531 >> 172.21.15.119:0/4279166531 conn(0x7ff33c06a2a0 msgr2=0x7ff33c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- 172.21.15.119:0/4279166531 shutdown_connections 2023-12-19T16:17:13.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- 172.21.15.119:0/4279166531 wait complete. 2023-12-19T16:17:13.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 Processor -- start 2023-12-19T16:17:13.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- start start 2023-12-19T16:17:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff33c0ca410 0x7ff33c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff33c0cbff0 0x7ff33c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1588c0 con 0x7ff33c071870 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c158ba0 con 0x7ff33c0ca410 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff340f96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c158e80 con 0x7ff33c0cbff0 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34718/0 (socket says 172.21.15.119:34718) 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 -- 172.21.15.119:0/3326847038 learned_addr learned my addr 172.21.15.119:0/3326847038 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff339d9b640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff33c0ca410 0x7ff33c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33ad9d640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff33c0cbff0 0x7ff33c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 -- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff33c0cbff0 msgr2=0x7ff33c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff33c0cbff0 0x7ff33c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 -- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff33c0ca410 msgr2=0x7ff33c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff33c0ca410 0x7ff33c1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff33a59c640 1 -- 172.21.15.119:0/3326847038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300094d0 con 0x7ff33c071870 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.116+0000 7ff339d9b640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff33c0ca410 0x7ff33c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff33a59c640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c152ad0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c450 tx=0x7ff32c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0052d0 con 0x7ff33c071870 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c005450 con 0x7ff33c071870 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c012870 con 0x7ff33c071870 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c159160 con 0x7ff33c071870 2023-12-19T16:17:13.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c14e080 con 0x7ff33c071870 2023-12-19T16:17:13.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c14e270 con 0x7ff33c071870 2023-12-19T16:17:13.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff32c0129d0 con 0x7ff33c071870 2023-12-19T16:17:13.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff32affd640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff31c065a90 0x7ff31c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ff32c082f20 con 0x7ff33c071870 2023-12-19T16:17:13.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.120+0000 7ff339d9b640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff31c065a90 0x7ff31c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.124+0000 7ff339d9b640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff31c065a90 0x7ff31c067f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff3300ae000 tx=0x7ff3300a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.124+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff32c050610 con 0x7ff33c071870 2023-12-19T16:17:13.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff33c04e000 con 0x7ff33c071870 2023-12-19T16:17:13.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff32affd640 1 -- 172.21.15.119:0/3326847038 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff32c053c30 con 0x7ff33c071870 2023-12-19T16:17:13.279 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff31c065a90 msgr2=0x7ff31c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff31c065a90 0x7ff31c067f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff3300ae000 tx=0x7ff3300a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 msgr2=0x7ff33c152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c152ad0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c450 tx=0x7ff32c00c910 comp rx=0 tx=0).stop 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 shutdown_connections 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff31c065a90 0x7ff31c067f50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff33c0ca410 0x7ff33c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff33c0cbff0 0x7ff33c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 --2- 172.21.15.119:0/3326847038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff33c071870 0x7ff33c152ad0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 >> 172.21.15.119:0/3326847038 conn(0x7ff33c06a2a0 msgr2=0x7ff33c0c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 shutdown_connections 2023-12-19T16:17:13.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.276+0000 7ff340f96640 1 -- 172.21.15.119:0/3326847038 wait complete. 2023-12-19T16:17:13.299 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 Processor -- start 2023-12-19T16:17:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 -- start start 2023-12-19T16:17:13.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ca410 0x7fac2c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac2c159fb0 0x7fac2c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c070df0 con 0x7fac2c071db0 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c15aab0 con 0x7fac2c159fb0 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.436+0000 7fac310c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c15a4f0 con 0x7fac2c0ca410 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac2c159fb0 0x7fac2c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac2c159fb0 0x7fac2c071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34720/0 (socket says 172.21.15.119:34720) 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 -- 172.21.15.119:0/1181201641 learned_addr learned my addr 172.21.15.119:0/1181201641 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2ad9d640 1 --2- 172.21.15.119:0/1181201641 >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ca410 0x7fac2c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 -- 172.21.15.119:0/1181201641 >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ca410 msgr2=0x7fac2c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 --2- 172.21.15.119:0/1181201641 >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ca410 0x7fac2c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 -- 172.21.15.119:0/1181201641 >> v1:172.21.15.143:6789/0 conn(0x7fac2c071db0 legacy=0x7fac2c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 -- 172.21.15.119:0/1181201641 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c15a7d0 con 0x7fac2c159fb0 2023-12-19T16:17:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2ad9d640 1 --2- 172.21.15.119:0/1181201641 >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ca410 0x7fac2c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:13.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2259c640 1 --2- 172.21.15.119:0/1181201641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c071870 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0cbfa0 tx=0x7fac1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54b0fdc50d74cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2a59c640 1 -- 172.21.15.119:0/1181201641 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140ac640 con 0x7fac2c159fb0 2023-12-19T16:17:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2a59c640 1 -- 172.21.15.119:0/1181201641 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac140ac7a0 con 0x7fac2c159fb0 2023-12-19T16:17:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.440+0000 7fac2a59c640 1 -- 172.21.15.119:0/1181201641 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140acb30 con 0x7fac2c159fb0 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- 172.21.15.119:0/1181201641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 msgr2=0x7fac2c071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 --2- 172.21.15.119:0/1181201641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c071870 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0cbfa0 tx=0x7fac1401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- 172.21.15.119:0/1181201641 shutdown_connections 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 --2- 172.21.15.119:0/1181201641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c071870 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 --2- 172.21.15.119:0/1181201641 >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ca410 0x7fac2c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- 172.21.15.119:0/1181201641 >> 172.21.15.119:0/1181201641 conn(0x7fac2c06a2a0 msgr2=0x7fac2c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- 172.21.15.119:0/1181201641 shutdown_connections 2023-12-19T16:17:13.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- 172.21.15.119:0/1181201641 wait complete. 2023-12-19T16:17:13.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 Processor -- start 2023-12-19T16:17:13.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- start start 2023-12-19T16:17:13.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c071db0 0x7fac2c1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ca410 0x7fac2c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c146de0 con 0x7fac2c159fb0 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c7e30 con 0x7fac2c0ca410 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.444+0000 7fac310c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c7220 con 0x7fac2c071db0 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34722/0 (socket says 172.21.15.119:34722) 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 -- 172.21.15.119:0/458377017 learned_addr learned my addr 172.21.15.119:0/458377017 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2259c640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ca410 0x7fac2c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2ad9d640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c071db0 0x7fac2c1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 -- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c071db0 msgr2=0x7fac2c1468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c071db0 0x7fac2c1468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 -- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ca410 msgr2=0x7fac2c1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ca410 0x7fac2c1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 -- 172.21.15.119:0/458377017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140094d0 con 0x7fac2c159fb0 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2ad9d640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c071db0 0x7fac2c1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:13.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac2b59e640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c154b00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c730 tx=0x7fac2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24003b80 con 0x7fac2c159fb0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24003ce0 con 0x7fac2c159fb0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400aa30 con 0x7fac2c159fb0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c0c7500 con 0x7fac2c159fb0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c0c7ac0 con 0x7fac2c159fb0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c0c7fc0 con 0x7fac2c159fb0 2023-12-19T16:17:13.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac2400ab90 con 0x7fac2c159fb0 2023-12-19T16:17:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac23fff640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac0c065a60 0x7fac0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.448+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fac240831b0 con 0x7fac2c159fb0 2023-12-19T16:17:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.452+0000 7fac2ad9d640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac0c065a60 0x7fac0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.452+0000 7fac2ad9d640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac0c065a60 0x7fac0c067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009970 tx=0x7fac1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.452+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac24050800 con 0x7fac2c159fb0 2023-12-19T16:17:13.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.604+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fac2c04e000 con 0x7fac2c159fb0 2023-12-19T16:17:13.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.604+0000 7fac23fff640 1 -- 172.21.15.119:0/458377017 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7fac24053e20 con 0x7fac2c159fb0 2023-12-19T16:17:13.608 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:13.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac0c065a60 msgr2=0x7fac0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac0c065a60 0x7fac0c067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009970 tx=0x7fac1c008040 comp rx=0 tx=0).stop 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 msgr2=0x7fac2c154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c154b00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c730 tx=0x7fac2400cbf0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 shutdown_connections 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac0c065a60 0x7fac0c067f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ca410 0x7fac2c1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c159fb0 0x7fac2c154b00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 --2- 172.21.15.119:0/458377017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c071db0 0x7fac2c1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 >> 172.21.15.119:0/458377017 conn(0x7fac2c06a2a0 msgr2=0x7fac2c157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 shutdown_connections 2023-12-19T16:17:13.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.608+0000 7fac310c4640 1 -- 172.21.15.119:0/458377017 wait complete. 2023-12-19T16:17:13.629 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:13.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.764+0000 7f73feff0640 1 Processor -- start 2023-12-19T16:17:13.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.764+0000 7f73feff0640 1 -- start start 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.764+0000 7f73feff0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f80cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.764+0000 7f73feff0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f73f80cb340 0x7f73f80cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.764+0000 7f73feff0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f806fdb0 con 0x7f73f8160cc0 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73feff0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f81654a0 con 0x7f73f80cb340 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73feff0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81610a0 con 0x7f73f80c1280 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f73f80cb340 0x7f73f80cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f73f80cb340 0x7f73f80cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34732/0 (socket says 172.21.15.119:34732) 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 -- 172.21.15.119:0/2464658486 learned_addr learned my addr 172.21.15.119:0/2464658486 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fcd8c640 1 --1- 172.21.15.119:0/2464658486 >> v1:172.21.15.119:6789/0 conn(0x7f73f8160cc0 0x7f73f80cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:44144/0 (socket says 172.21.15.119:44144) 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73f7fff640 1 --2- 172.21.15.119:0/2464658486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f80cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 -- 172.21.15.119:0/2464658486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 msgr2=0x7f73f80cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 --2- 172.21.15.119:0/2464658486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f80cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 -- 172.21.15.119:0/2464658486 >> v1:172.21.15.119:6789/0 conn(0x7f73f8160cc0 legacy=0x7f73f80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 -- 172.21.15.119:0/2464658486 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8164820 con 0x7f73f80cb340 2023-12-19T16:17:13.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73f77fe640 1 -- 172.21.15.119:0/2464658486 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824380820 0 0) 0x7f73f806fdb0 con 0x7f73f8160cc0 2023-12-19T16:17:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73fd58d640 1 --2- 172.21.15.119:0/2464658486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f80cc940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009e80 tx=0x7f73f001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454855538a93b24d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73f77fe640 1 -- 172.21.15.119:0/2464658486 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a5670 con 0x7f73f80cb340 2023-12-19T16:17:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73f77fe640 1 -- 172.21.15.119:0/2464658486 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00a57d0 con 0x7f73f80cb340 2023-12-19T16:17:13.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.768+0000 7f73f77fe640 1 -- 172.21.15.119:0/2464658486 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a5b60 con 0x7f73f80cb340 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- 172.21.15.119:0/2464658486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 msgr2=0x7f73f80cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 --2- 172.21.15.119:0/2464658486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f80cc940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009e80 tx=0x7f73f001c8a0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- 172.21.15.119:0/2464658486 shutdown_connections 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 --2- 172.21.15.119:0/2464658486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f80cc940 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 --2- 172.21.15.119:0/2464658486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f80cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- 172.21.15.119:0/2464658486 >> 172.21.15.119:0/2464658486 conn(0x7f73f806a3e0 msgr2=0x7f73f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- 172.21.15.119:0/2464658486 shutdown_connections 2023-12-19T16:17:13.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- 172.21.15.119:0/2464658486 wait complete. 2023-12-19T16:17:13.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 Processor -- start 2023-12-19T16:17:13.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- start start 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f81637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f8070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73f8160cc0 0x7f73f80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8161eb0 con 0x7f73f80cb340 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81612a0 con 0x7f73f8160cc0 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73feff0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8161580 con 0x7f73f80c1280 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f8070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f8070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34748/0 (socket says 172.21.15.119:34748) 2023-12-19T16:17:13.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.772+0000 7f73f7fff640 1 -- 172.21.15.119:0/1630307296 learned_addr learned my addr 172.21.15.119:0/1630307296 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73fd58d640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73f8160cc0 0x7f73f80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73fcd8c640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f81637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f7fff640 1 -- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 msgr2=0x7f73f81637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f7fff640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f81637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f7fff640 1 -- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73f8160cc0 msgr2=0x7f73f80707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f7fff640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73f8160cc0 0x7f73f80707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f7fff640 1 -- 172.21.15.119:0/1630307296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009b30 con 0x7f73f80cb340 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f7fff640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f8070290 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f73e400d800 tx=0x7f73e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400b6c0 con 0x7f73f80cb340 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400b820 con 0x7f73f80cb340 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400bb90 con 0x7f73f80cb340 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8161860 con 0x7f73f80cb340 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80ad990 con 0x7f73f80cb340 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f80735b0 con 0x7f73f80cb340 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73e400bcf0 con 0x7f73f80cb340 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f57fa640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73dc065a60 0x7f73dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f73e40839f0 con 0x7f73f80cb340 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.776+0000 7f73fcd8c640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73dc065a60 0x7f73dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.780+0000 7f73fcd8c640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73dc065a60 0x7f73dc067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73ec000f70 tx=0x7f73ec007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.780+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f73e40510e0 con 0x7f73f80cb340 2023-12-19T16:17:13.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.940+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73f80cf2d0 con 0x7f73f80cb340 2023-12-19T16:17:13.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.940+0000 7f73f57fa640 1 -- 172.21.15.119:0/1630307296 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73e4011340 con 0x7f73f80cb340 2023-12-19T16:17:13.944 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:17:13.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73dc065a60 msgr2=0x7f73dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73dc065a60 0x7f73dc067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73ec000f70 tx=0x7f73ec007c10 comp rx=0 tx=0).stop 2023-12-19T16:17:13.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 msgr2=0x7f73f8070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f8070290 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f73e400d800 tx=0x7f73e400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 shutdown_connections 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f73dc065a60 0x7f73dc067f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73f8160cc0 0x7f73f80707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73f80cb340 0x7f73f8070290 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 --2- 172.21.15.119:0/1630307296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73f80c1280 0x7f73f81637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 >> 172.21.15.119:0/1630307296 conn(0x7f73f806a3e0 msgr2=0x7f73f80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 shutdown_connections 2023-12-19T16:17:13.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:13.944+0000 7f73feff0640 1 -- 172.21.15.119:0/1630307296 wait complete. 2023-12-19T16:17:13.965 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:13.965 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:13.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:14.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.148+0000 7f03f0196640 1 Processor -- start 2023-12-19T16:17:14.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.148+0000 7f03f0196640 1 -- start start 2023-12-19T16:17:14.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03f0196640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 0x7f03e8070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03f0196640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e8070b80 con 0x7f03e815c800 2023-12-19T16:17:14.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03f0196640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e8070e60 con 0x7f03e80cb180 2023-12-19T16:17:14.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03f0196640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8071140 con 0x7f03e8158c20 2023-12-19T16:17:14.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ed731640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f03e815c800 0x7f03e80caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:44158/0 (socket says 172.21.15.119:44158) 2023-12-19T16:17:14.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ed731640 1 -- 172.21.15.119:0/1933640462 learned_addr learned my addr 172.21.15.119:0/1933640462 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03edf32640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 0x7f03e8070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177979706 0 0) 0x7f03e8070b80 con 0x7f03e815c800 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d4003530 con 0x7f03e815c800 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687633165 0 0) 0x7f03d4003530 con 0x7f03e815c800 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 msgr2=0x7f03e8070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 0x7f03e8070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 >> v1:172.21.15.143:6789/0 conn(0x7f03e80cb180 legacy=0x7f03e80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8071420 con 0x7f03e815c800 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f03d8001680 con 0x7f03e815c800 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 >> v1:172.21.15.119:6789/0 conn(0x7f03e815c800 legacy=0x7f03e80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 0x7f03d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d4003f30 0x7f03d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03d4004d10 0x7f03d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8071140 con 0x7f03d4004d10 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d400dd30 con 0x7f03d4003f30 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d400def0 con 0x7f03e8158c20 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ee733640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03d4004d10 0x7f03d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ed731640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d4003f30 0x7f03d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03edf32640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 0x7f03d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ee733640 1 -- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 msgr2=0x7f03d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ee733640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03e8158c20 0x7f03d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ee733640 1 -- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d4003f30 msgr2=0x7f03d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ee733640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d4003f30 0x7f03d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.152+0000 7f03ee733640 1 -- 172.21.15.119:0/1933640462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4003530 con 0x7f03d4004d10 2023-12-19T16:17:14.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03ee733640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03d4004d10 0x7f03d4005190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f03e0001e40 tx=0x7f03e001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929bb5548ecf09da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0003b80 con 0x7f03d4004d10 2023-12-19T16:17:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0003ce0 con 0x7f03d4004d10 2023-12-19T16:17:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03ecf30640 1 -- 172.21.15.119:0/1933640462 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00052c0 con 0x7f03d4004d10 2023-12-19T16:17:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03f0196640 1 -- 172.21.15.119:0/1933640462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03d4004d10 msgr2=0x7f03d4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03f0196640 1 --2- 172.21.15.119:0/1933640462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03d4004d10 0x7f03d4005190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f03e0001e40 tx=0x7f03e001c740 comp rx=0 tx=0).stop 2023-12-19T16:17:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03ee733640 1 -- 172.21.15.119:0/1933640462 reap_dead start 2023-12-19T16:17:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03f0196640 1 -- 172.21.15.119:0/1933640462 shutdown_connections 2023-12-19T16:17:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03f0196640 1 -- 172.21.15.119:0/1933640462 >> 172.21.15.119:0/1933640462 conn(0x7f03e806a3e0 msgr2=0x7f03e80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03f0196640 1 -- 172.21.15.119:0/1933640462 shutdown_connections 2023-12-19T16:17:14.160 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.156+0000 7f03f0196640 1 -- 172.21.15.119:0/1933640462 wait complete. 2023-12-19T16:17:14.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 Processor -- start 2023-12-19T16:17:14.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- start start 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d4004d10 0x7f03e80c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 0x7f03e80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8142d40 0x7f03e814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e80c6340 con 0x7f03e81428c0 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e80c6620 con 0x7f03e8142d40 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e80c6900 con 0x7f03d4004d10 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 0x7f03e80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 0x7f03e80b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34764/0 (socket says 172.21.15.119:34764) 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 -- 172.21.15.119:0/4267488881 learned_addr learned my addr 172.21.15.119:0/4267488881 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ee733640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8142d40 0x7f03e814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03edf32640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d4004d10 0x7f03e80c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 -- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d4004d10 msgr2=0x7f03e80c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d4004d10 0x7f03e80c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 -- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8142d40 msgr2=0x7f03e814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8142d40 0x7f03e814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 -- 172.21.15.119:0/4267488881 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80c6be0 con 0x7f03e81428c0 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ee733640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8142d40 0x7f03e814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03edf32640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d4004d10 0x7f03e80c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03ed731640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 0x7f03e80b0ff0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f03d8004880 tx=0x7f03d8012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80109c0 con 0x7f03e81428c0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8010b40 con 0x7f03e81428c0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e80b1530 con 0x7f03e81428c0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8012e80 con 0x7f03e81428c0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e81506c0 con 0x7f03e81428c0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.160+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e80735b0 con 0x7f03e81428c0 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.164+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f03d8016480 con 0x7f03e81428c0 2023-12-19T16:17:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.164+0000 7f03de7fc640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f03cc065a60 0x7f03cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.164+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f03d8086a00 con 0x7f03e81428c0 2023-12-19T16:17:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.164+0000 7f03edf32640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f03cc065a60 0x7f03cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.164+0000 7f03edf32640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f03cc065a60 0x7f03cc067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009be0 tx=0x7f03e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.168+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f03d80540e0 con 0x7f03e81428c0 2023-12-19T16:17:14.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.320+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03e804e000 con 0x7f03e81428c0 2023-12-19T16:17:14.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.320+0000 7f03de7fc640 1 -- 172.21.15.119:0/4267488881 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7f03d8057700 con 0x7f03e81428c0 2023-12-19T16:17:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:14.324 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f03cc065a60 msgr2=0x7f03cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f03cc065a60 0x7f03cc067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009be0 tx=0x7f03e4008040 comp rx=0 tx=0).stop 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 msgr2=0x7f03e80b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 0x7f03e80b0ff0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f03d8004880 tx=0x7f03d8012c90 comp rx=0 tx=0).stop 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 shutdown_connections 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f03cc065a60 0x7f03cc067f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8142d40 0x7f03e814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03e81428c0 0x7f03e80b0ff0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 --2- 172.21.15.119:0/4267488881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d4004d10 0x7f03e80c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 >> 172.21.15.119:0/4267488881 conn(0x7f03e806a3e0 msgr2=0x7f03e80b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 shutdown_connections 2023-12-19T16:17:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.324+0000 7f03f0196640 1 -- 172.21.15.119:0/4267488881 wait complete. 2023-12-19T16:17:14.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:14.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:14.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3251df0640 1 Processor -- start 2023-12-19T16:17:14.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3251df0640 1 -- start start 2023-12-19T16:17:14.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3251df0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f324c071870 0x7f324c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3251df0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c070df0 con 0x7f324c0ca410 2023-12-19T16:17:14.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3251df0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c15a4f0 con 0x7f324c0cbff0 2023-12-19T16:17:14.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3251df0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c15aab0 con 0x7f324c071870 2023-12-19T16:17:14.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f324b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f324c0ca410 0x7f324c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:44160/0 (socket says 172.21.15.119:44160) 2023-12-19T16:17:14.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f324b7fe640 1 -- 172.21.15.119:0/485625488 learned_addr learned my addr 172.21.15.119:0/485625488 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:14.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3243fff640 1 --2- 172.21.15.119:0/485625488 >> v2:172.21.15.119:3300/0 conn(0x7f324c071870 0x7f324c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3243fff640 1 -- 172.21.15.119:0/485625488 >> v1:172.21.15.143:6789/0 conn(0x7f324c0cbff0 legacy=0x7f324c0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3243fff640 1 -- 172.21.15.119:0/485625488 >> v1:172.21.15.119:6789/0 conn(0x7f324c0ca410 legacy=0x7f324c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f3243fff640 1 -- 172.21.15.119:0/485625488 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c15a7d0 con 0x7f324c071870 2023-12-19T16:17:14.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.484+0000 7f324affd640 1 -- 172.21.15.119:0/485625488 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198175731 0 0) 0x7f324c070df0 con 0x7f324c0ca410 2023-12-19T16:17:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3243fff640 1 --2- 172.21.15.119:0/485625488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c071d00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f32340097c0 tx=0x7f323401e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288a68378b57336d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f324affd640 1 -- 172.21.15.119:0/485625488 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340ab5f0 con 0x7f324c071870 2023-12-19T16:17:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f324affd640 1 -- 172.21.15.119:0/485625488 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32340ab750 con 0x7f324c071870 2023-12-19T16:17:14.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f324affd640 1 -- 172.21.15.119:0/485625488 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340abae0 con 0x7f324c071870 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 -- 172.21.15.119:0/485625488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 msgr2=0x7f324c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 --2- 172.21.15.119:0/485625488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c071d00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f32340097c0 tx=0x7f323401e620 comp rx=0 tx=0).stop 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 -- 172.21.15.119:0/485625488 shutdown_connections 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 --2- 172.21.15.119:0/485625488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c071d00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 -- 172.21.15.119:0/485625488 >> 172.21.15.119:0/485625488 conn(0x7f324c06a2a0 msgr2=0x7f324c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 -- 172.21.15.119:0/485625488 shutdown_connections 2023-12-19T16:17:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.488+0000 7f3251df0640 1 -- 172.21.15.119:0/485625488 wait complete. 2023-12-19T16:17:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 Processor -- start 2023-12-19T16:17:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- start start 2023-12-19T16:17:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f324c0ca410 0x7f324c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f324c0cbff0 0x7f324c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15c580 con 0x7f324c071870 2023-12-19T16:17:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c150790 con 0x7f324c0cbff0 2023-12-19T16:17:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c14bd30 con 0x7f324c0ca410 2023-12-19T16:17:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34774/0 (socket says 172.21.15.119:34774) 2023-12-19T16:17:14.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 -- 172.21.15.119:0/127870359 learned_addr learned my addr 172.21.15.119:0/127870359 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 -- 172.21.15.119:0/127870359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f324c0ca410 msgr2=0x7f324c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f324c0ca410 0x7f324c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 -- 172.21.15.119:0/127870359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f324c0cbff0 msgr2=0x7f324c14b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f324c0cbff0 0x7f324c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 -- 172.21.15.119:0/127870359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234009420 con 0x7f324c071870 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f324b7fe640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c159030 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f323c0011f0 tx=0x7f323c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0074e0 con 0x7f324c071870 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c007640 con 0x7f324c071870 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c004a10 con 0x7f324c071870 2023-12-19T16:17:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c15bce0 con 0x7f324c071870 2023-12-19T16:17:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c15c2a0 con 0x7f324c071870 2023-12-19T16:17:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.492+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c04e000 con 0x7f324c071870 2023-12-19T16:17:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.496+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f323c004b70 con 0x7f324c071870 2023-12-19T16:17:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.496+0000 7f3248ff9640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f322c065a60 0x7f322c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.496+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f323c082780 con 0x7f324c071870 2023-12-19T16:17:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.496+0000 7f3243fff640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f322c065a60 0x7f322c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.496+0000 7f3243fff640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f322c065a60 0x7f322c067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f32340b0000 tx=0x7f3234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.500+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f323c04fe60 con 0x7f324c071870 2023-12-19T16:17:14.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.652+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f324c156a50 con 0x7f324c071870 2023-12-19T16:17:14.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.652+0000 7f3248ff9640 1 -- 172.21.15.119:0/127870359 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f323c0180a0 con 0x7f324c071870 2023-12-19T16:17:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:14.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f322c065a60 msgr2=0x7f322c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f322c065a60 0x7f322c067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f32340b0000 tx=0x7f3234008040 comp rx=0 tx=0).stop 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 msgr2=0x7f324c159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c159030 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f323c0011f0 tx=0x7f323c00c9b0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 shutdown_connections 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f322c065a60 0x7f322c067f20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f324c0cbff0 0x7f324c14b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f324c0ca410 0x7f324c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 --2- 172.21.15.119:0/127870359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f324c071870 0x7f324c159030 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 >> 172.21.15.119:0/127870359 conn(0x7f324c06a2a0 msgr2=0x7f324c0aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 shutdown_connections 2023-12-19T16:17:14.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.656+0000 7f3251df0640 1 -- 172.21.15.119:0/127870359 wait complete. 2023-12-19T16:17:14.677 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:14.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 Processor -- start 2023-12-19T16:17:14.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 -- start start 2023-12-19T16:17:14.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fda7c1582d0 0x7fda7c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c0ce3b0 0x7fda7c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0c9390 con 0x7fda7c070820 2023-12-19T16:17:14.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0ced80 con 0x7fda7c1582d0 2023-12-19T16:17:14.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda80a8c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c15aee0 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fda7c1582d0 0x7fda7c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7ad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c0ce3b0 0x7fda7c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda71d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fda7c070820 0x7fda7c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:42068/0 (socket says 172.21.15.119:42068) 2023-12-19T16:17:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda71d9b640 1 -- 172.21.15.119:0/1518968211 learned_addr learned my addr 172.21.15.119:0/1518968211 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:14.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fda7c1582d0 0x7fda7c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:42316/0 (socket says 172.21.15.119:42316) 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda79d9b640 1 -- 172.21.15.119:0/1518968211 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527468628 0 0) 0x7fda7c0c9390 con 0x7fda7c070820 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda79d9b640 1 -- 172.21.15.119:0/1518968211 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003530 con 0x7fda7c070820 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7a59c640 1 -- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c0ce3b0 msgr2=0x7fda7c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7a59c640 1 --2- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c0ce3b0 0x7fda7c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7a59c640 1 -- 172.21.15.119:0/1518968211 >> v1:172.21.15.143:6789/0 conn(0x7fda7c070820 legacy=0x7fda7c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7a59c640 1 -- 172.21.15.119:0/1518968211 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c15b1c0 con 0x7fda7c1582d0 2023-12-19T16:17:14.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.816+0000 7fda7ad9d640 1 --2- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c0ce3b0 0x7fda7c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:14.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda7a59c640 1 --2- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c0c8e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0097c0 tx=0x7fda6c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c27db5558c248334 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda79d9b640 1 -- 172.21.15.119:0/1518968211 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0ab650 con 0x7fda7c1582d0 2023-12-19T16:17:14.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda79d9b640 1 -- 172.21.15.119:0/1518968211 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c0ab7b0 con 0x7fda7c1582d0 2023-12-19T16:17:14.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda79d9b640 1 -- 172.21.15.119:0/1518968211 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0abb40 con 0x7fda7c1582d0 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 -- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 msgr2=0x7fda7c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 --2- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c0c8e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0097c0 tx=0x7fda6c01c450 comp rx=0 tx=0).stop 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 -- 172.21.15.119:0/1518968211 shutdown_connections 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 --2- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c0ce3b0 0x7fda7c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 --2- 172.21.15.119:0/1518968211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c0c8e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 -- 172.21.15.119:0/1518968211 >> 172.21.15.119:0/1518968211 conn(0x7fda7c06a2a0 msgr2=0x7fda7c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 -- 172.21.15.119:0/1518968211 shutdown_connections 2023-12-19T16:17:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.820+0000 7fda80a8c640 1 -- 172.21.15.119:0/1518968211 wait complete. 2023-12-19T16:17:14.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 Processor -- start 2023-12-19T16:17:14.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 -- start start 2023-12-19T16:17:14.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c070820 0x7fda7c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 0x7fda7c14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c1bf0 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c1610 con 0x7fda7c1582d0 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c145280 con 0x7fda7c070820 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 0x7fda7c14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 0x7fda7c14e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34780/0 (socket says 172.21.15.119:34780) 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 -- 172.21.15.119:0/4220788006 learned_addr learned my addr 172.21.15.119:0/4220788006 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda7a59c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c070820 0x7fda7c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda7ad9d640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 -- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c070820 msgr2=0x7fda7c157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c070820 0x7fda7c157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 -- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 msgr2=0x7fda7c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 -- 172.21.15.119:0/4220788006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009420 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda71d9b640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 0x7fda7c14e2c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fda6400cbf0 tx=0x7fda6400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400aca0 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6400ae00 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c009420 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64012620 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.824+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c145560 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.828+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c0c6730 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.828+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda64007070 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.828+0000 7fda737fe640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fda5c065a60 0x7fda5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.828+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fda64083380 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.828+0000 7fda7a59c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fda5c065a60 0x7fda5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.828+0000 7fda7a59c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fda5c065a60 0x7fda5c067f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0af000 tx=0x7fda6c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.832+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fda64050b10 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.980+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda7c0c1d30 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda737fe640 1 -- 172.21.15.119:0/4220788006 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda64054130 con 0x7fda7c0ce3b0 2023-12-19T16:17:14.985 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fda5c065a60 msgr2=0x7fda5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fda5c065a60 0x7fda5c067f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0af000 tx=0x7fda6c0a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:14.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 msgr2=0x7fda7c14e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 0x7fda7c14e2c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fda6400cbf0 tx=0x7fda6400a060 comp rx=0 tx=0).stop 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 shutdown_connections 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fda5c065a60 0x7fda5c067f20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda7c1582d0 0x7fda7c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7c0ce3b0 0x7fda7c14e2c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 --2- 172.21.15.119:0/4220788006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7c070820 0x7fda7c157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 >> 172.21.15.119:0/4220788006 conn(0x7fda7c06a2a0 msgr2=0x7fda7c14e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 shutdown_connections 2023-12-19T16:17:14.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:14.984+0000 7fda80a8c640 1 -- 172.21.15.119:0/4220788006 wait complete. 2023-12-19T16:17:15.006 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:15.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 Processor -- start 2023-12-19T16:17:15.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 -- start start 2023-12-19T16:17:15.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd4940ca410 0x7fd494159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4940cbff0 0x7fd4940cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4940cc930 con 0x7fd494159fb0 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49415aab0 con 0x7fd4940cbff0 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd499bbc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd494070df0 con 0x7fd4940ca410 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4940cbff0 0x7fd4940cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4940cbff0 0x7fd4940cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34792/0 (socket says 172.21.15.119:34792) 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 -- 172.21.15.119:0/4187902148 learned_addr learned my addr 172.21.15.119:0/4187902148 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd4937fe640 1 --2- 172.21.15.119:0/4187902148 >> v2:172.21.15.143:3300/0 conn(0x7fd4940ca410 0x7fd494159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 -- 172.21.15.119:0/4187902148 >> v2:172.21.15.143:3300/0 conn(0x7fd4940ca410 msgr2=0x7fd494159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 --2- 172.21.15.119:0/4187902148 >> v2:172.21.15.143:3300/0 conn(0x7fd4940ca410 0x7fd494159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 -- 172.21.15.119:0/4187902148 >> v1:172.21.15.143:6789/0 conn(0x7fd494159fb0 legacy=0x7fd494071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.144+0000 7fd493fff640 1 -- 172.21.15.119:0/4187902148 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49415a4f0 con 0x7fd4940cbff0 2023-12-19T16:17:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd493fff640 1 --2- 172.21.15.119:0/4187902148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940cc3f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd4940cbfa0 tx=0x7fd48c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a500ef662cc91bed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd4927fc640 1 -- 172.21.15.119:0/4187902148 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0a5860 con 0x7fd4940cbff0 2023-12-19T16:17:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd4927fc640 1 -- 172.21.15.119:0/4187902148 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c0a59c0 con 0x7fd4940cbff0 2023-12-19T16:17:15.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd4927fc640 1 -- 172.21.15.119:0/4187902148 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0a5d50 con 0x7fd4940cbff0 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 -- 172.21.15.119:0/4187902148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 msgr2=0x7fd4940cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 --2- 172.21.15.119:0/4187902148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940cc3f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd4940cbfa0 tx=0x7fd48c01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 -- 172.21.15.119:0/4187902148 shutdown_connections 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 --2- 172.21.15.119:0/4187902148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940cc3f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 --2- 172.21.15.119:0/4187902148 >> v2:172.21.15.143:3300/0 conn(0x7fd4940ca410 0x7fd494159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 -- 172.21.15.119:0/4187902148 >> 172.21.15.119:0/4187902148 conn(0x7fd49406a2a0 msgr2=0x7fd4940aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 -- 172.21.15.119:0/4187902148 shutdown_connections 2023-12-19T16:17:15.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.148+0000 7fd499bbc640 1 -- 172.21.15.119:0/4187902148 wait complete. 2023-12-19T16:17:15.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 Processor -- start 2023-12-19T16:17:15.153 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 -- start start 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 0x7fd4941f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd494159fb0 0x7fd4941532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940adad0 con 0x7fd4940cbff0 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f9a30 con 0x7fd4940ca410 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd494151d40 con 0x7fd494159fb0 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd492ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 0x7fd4941f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 0x7fd4941f94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:42326/0 (socket says 172.21.15.119:42326) 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 -- 172.21.15.119:0/3326781137 learned_addr learned my addr 172.21.15.119:0/3326781137 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd493fff640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd494159fb0 0x7fd4941532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 -- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd494159fb0 msgr2=0x7fd4941532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd494159fb0 0x7fd4941532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 -- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 msgr2=0x7fd4940c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 -- 172.21.15.119:0/3326781137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009b30 con 0x7fd4940ca410 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd492ffd640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd4937fe640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 0x7fd4941f94f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4840086b0 tx=0x7fd484008b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484010070 con 0x7fd4940ca410 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48400d900 con 0x7fd4940ca410 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400dc90 con 0x7fd4940ca410 2023-12-19T16:17:15.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4940add20 con 0x7fd4940ca410 2023-12-19T16:17:15.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.152+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940ae2e0 con 0x7fd4940ca410 2023-12-19T16:17:15.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.156+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49404e000 con 0x7fd4940ca410 2023-12-19T16:17:15.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.156+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd48401e440 con 0x7fd4940ca410 2023-12-19T16:17:15.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.156+0000 7fd47bfff640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd480065a60 0x7fd480067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.156+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd484082ff0 con 0x7fd4940ca410 2023-12-19T16:17:15.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.156+0000 7fd492ffd640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd480065a60 0x7fd480067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.156+0000 7fd492ffd640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd480065a60 0x7fd480067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd4940c4f10 tx=0x7fd488009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.160+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd484050890 con 0x7fd4940ca410 2023-12-19T16:17:15.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.312+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd494152500 con 0x7fd4940ca410 2023-12-19T16:17:15.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.312+0000 7fd47bfff640 1 -- 172.21.15.119:0/3326781137 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd484019070 con 0x7fd4940ca410 2023-12-19T16:17:15.316 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:15.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd480065a60 msgr2=0x7fd480067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd480065a60 0x7fd480067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd4940c4f10 tx=0x7fd488009040 comp rx=0 tx=0).stop 2023-12-19T16:17:15.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 msgr2=0x7fd4941f94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 0x7fd4941f94f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4840086b0 tx=0x7fd484008b70 comp rx=0 tx=0).stop 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 shutdown_connections 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd480065a60 0x7fd480067f20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd494159fb0 0x7fd4941532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4940cbff0 0x7fd4940c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 --2- 172.21.15.119:0/3326781137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4940ca410 0x7fd4941f94f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 >> 172.21.15.119:0/3326781137 conn(0x7fd49406a2a0 msgr2=0x7fd494152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 shutdown_connections 2023-12-19T16:17:15.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.316+0000 7fd499bbc640 1 -- 172.21.15.119:0/3326781137 wait complete. 2023-12-19T16:17:15.337 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:15.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.476+0000 7fd148718640 1 Processor -- start 2023-12-19T16:17:15.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.476+0000 7fd148718640 1 -- start start 2023-12-19T16:17:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.476+0000 7fd148718640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1400cf880 0x7fd1400ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd148718640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14015cec0 con 0x7fd14015cae0 2023-12-19T16:17:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd148718640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400d0530 con 0x7fd1400cde90 2023-12-19T16:17:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd148718640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400d0810 con 0x7fd1400cf880 2023-12-19T16:17:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1464b4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd14015cae0 0x7fd1400d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:44172/0 (socket says 172.21.15.119:44172) 2023-12-19T16:17:15.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1464b4640 1 -- 172.21.15.119:0/2591801511 learned_addr learned my addr 172.21.15.119:0/2591801511 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:15.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 --2- 172.21.15.119:0/2591801511 >> v2:172.21.15.143:3300/0 conn(0x7fd1400cf880 0x7fd1400ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846493934 0 0) 0x7fd14015cec0 con 0x7fd14015cae0 2023-12-19T16:17:15.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c003530 con 0x7fd14015cae0 2023-12-19T16:17:15.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1067479223 0 0) 0x7fd12c003530 con 0x7fd14015cae0 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 >> v2:172.21.15.143:3300/0 conn(0x7fd1400cf880 msgr2=0x7fd1400ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 --2- 172.21.15.119:0/2591801511 >> v2:172.21.15.143:3300/0 conn(0x7fd1400cf880 0x7fd1400ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 >> v1:172.21.15.143:6789/0 conn(0x7fd1400cde90 legacy=0x7fd1400cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400d0af0 con 0x7fd14015cae0 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7fd13c001800 con 0x7fd14015cae0 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 >> v1:172.21.15.119:6789/0 conn(0x7fd14015cae0 legacy=0x7fd1400d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd12c003980 0x7fd12c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd12c0047d0 0x7fd12c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd12c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400d0810 con 0x7fd12c005190 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c00c030 con 0x7fd12c0047d0 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c00c1f0 con 0x7fd12c003980 2023-12-19T16:17:15.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd12c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd1464b4640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd12c003980 0x7fd12c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd145cb3640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd12c0047d0 0x7fd12c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 -- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd12c003980 msgr2=0x7fd12c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd12c003980 0x7fd12c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 -- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd12c0047d0 msgr2=0x7fd12c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd12c0047d0 0x7fd12c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd146cb5640 1 -- 172.21.15.119:0/2591801511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c003530 con 0x7fd12c005190 2023-12-19T16:17:15.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.480+0000 7fd145cb3640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd12c0047d0 0x7fd12c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd146cb5640 1 -- 172.21.15.119:0/2591801511 reap_dead start 2023-12-19T16:17:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd146cb5640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd12c00b990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1400d27b0 tx=0x7fd13801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1afe947a166397 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a5c50 con 0x7fd12c005190 2023-12-19T16:17:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800f040 con 0x7fd12c005190 2023-12-19T16:17:15.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd1454b2640 1 -- 172.21.15.119:0/2591801511 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380ad440 con 0x7fd12c005190 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 -- 172.21.15.119:0/2591801511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 msgr2=0x7fd12c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd12c00b990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1400d27b0 tx=0x7fd13801cc40 comp rx=0 tx=0).stop 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 -- 172.21.15.119:0/2591801511 shutdown_connections 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 --2- 172.21.15.119:0/2591801511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd12c00b990 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 -- 172.21.15.119:0/2591801511 >> 172.21.15.119:0/2591801511 conn(0x7fd140089fb0 msgr2=0x7fd1400d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 -- 172.21.15.119:0/2591801511 shutdown_connections 2023-12-19T16:17:15.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 -- 172.21.15.119:0/2591801511 wait complete. 2023-12-19T16:17:15.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 Processor -- start 2023-12-19T16:17:15.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.484+0000 7fd148718640 1 -- start start 2023-12-19T16:17:15.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd1401f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1400cb570 0x7fd14015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd14015d0c0 0x7fd1400b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c9950 con 0x7fd12c005190 2023-12-19T16:17:15.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401f2350 con 0x7fd1400cb570 2023-12-19T16:17:15.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401f2630 con 0x7fd14015d0c0 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd1401f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd1401f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34822/0 (socket says 172.21.15.119:34822) 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 -- 172.21.15.119:0/2638561050 learned_addr learned my addr 172.21.15.119:0/2638561050 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd145cb3640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1400cb570 0x7fd14015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd146cb5640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd14015d0c0 0x7fd1400b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 -- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd14015d0c0 msgr2=0x7fd1400b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd14015d0c0 0x7fd1400b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 -- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1400cb570 msgr2=0x7fd14015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1400cb570 0x7fd14015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 -- 172.21.15.119:0/2638561050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1401f2910 con 0x7fd12c005190 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd1464b4640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd1401f1d00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00e780 tx=0x7fd13c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00ee30 con 0x7fd12c005190 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c0072e0 con 0x7fd12c005190 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c007670 con 0x7fd12c005190 2023-12-19T16:17:15.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1401f2bf0 con 0x7fd12c005190 2023-12-19T16:17:15.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1400cb9f0 con 0x7fd12c005190 2023-12-19T16:17:15.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400c9ac0 con 0x7fd12c005190 2023-12-19T16:17:15.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.488+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd13c0057b0 con 0x7fd12c005190 2023-12-19T16:17:15.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.492+0000 7fd136ffd640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd124065a60 0x7fd124067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.492+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd13c0834a0 con 0x7fd12c005190 2023-12-19T16:17:15.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.492+0000 7fd145cb3640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd124065a60 0x7fd124067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.492+0000 7fd145cb3640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd124065a60 0x7fd124067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c10 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.496+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd13c050b00 con 0x7fd12c005190 2023-12-19T16:17:15.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.644+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd14004e000 con 0x7fd12c005190 2023-12-19T16:17:15.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.644+0000 7fd136ffd640 1 -- 172.21.15.119:0/2638561050 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd13c054120 con 0x7fd12c005190 2023-12-19T16:17:15.649 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd124065a60 msgr2=0x7fd124067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd124065a60 0x7fd124067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c10 tx=0x7fd130009040 comp rx=0 tx=0).stop 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 msgr2=0x7fd1401f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd1401f1d00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00e780 tx=0x7fd13c00ec40 comp rx=0 tx=0).stop 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 shutdown_connections 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fd124065a60 0x7fd124067f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1400cb570 0x7fd14015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd14015d0c0 0x7fd1400b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 --2- 172.21.15.119:0/2638561050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd12c005190 0x7fd1401f1d00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 >> 172.21.15.119:0/2638561050 conn(0x7fd140089fb0 msgr2=0x7fd1400b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 shutdown_connections 2023-12-19T16:17:15.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.648+0000 7fd148718640 1 -- 172.21.15.119:0/2638561050 wait complete. 2023-12-19T16:17:15.670 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 Processor -- start 2023-12-19T16:17:15.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 -- start start 2023-12-19T16:17:15.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcc6c15a680 0x7fcc6c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc6c06fdb0 0x7fcc6c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6c15f100 con 0x7fcc6c0cac10 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c070780 con 0x7fcc6c15a680 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.808+0000 7fcc73d8f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c0ca7d0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcc6c15a680 0x7fcc6c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcc6c15a680 0x7fcc6c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34838/0 (socket says 172.21.15.119:34838) 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 -- 172.21.15.119:0/585356698 learned_addr learned my addr 172.21.15.119:0/585356698 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc7232c640 1 --2- 172.21.15.119:0/585356698 >> v2:172.21.15.143:3300/0 conn(0x7fcc6c06fdb0 0x7fcc6c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 -- 172.21.15.119:0/585356698 >> v2:172.21.15.143:3300/0 conn(0x7fcc6c06fdb0 msgr2=0x7fcc6c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 --2- 172.21.15.119:0/585356698 >> v2:172.21.15.143:3300/0 conn(0x7fcc6c06fdb0 0x7fcc6c070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 -- 172.21.15.119:0/585356698 >> v1:172.21.15.143:6789/0 conn(0x7fcc6c0cac10 legacy=0x7fcc6c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 -- 172.21.15.119:0/585356698 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c15e860 con 0x7fcc6c15a680 2023-12-19T16:17:15.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc71b2b640 1 --2- 172.21.15.119:0/585356698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c15a680 0x7fcc6c15e160 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009870 tx=0x7fcc6801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fafc8a75c7e7b8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc70b29640 1 -- 172.21.15.119:0/585356698 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a7070 con 0x7fcc6c15a680 2023-12-19T16:17:15.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc70b29640 1 -- 172.21.15.119:0/585356698 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680ab430 con 0x7fcc6c15a680 2023-12-19T16:17:15.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.812+0000 7fcc70b29640 1 -- 172.21.15.119:0/585356698 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680ab7c0 con 0x7fcc6c15a680 2023-12-19T16:17:15.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- 172.21.15.119:0/585356698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c15a680 msgr2=0x7fcc6c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/585356698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c15a680 0x7fcc6c15e160 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009870 tx=0x7fcc6801c430 comp rx=0 tx=0).stop 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- 172.21.15.119:0/585356698 shutdown_connections 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/585356698 >> v2:172.21.15.143:3300/0 conn(0x7fcc6c06fdb0 0x7fcc6c070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/585356698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c15a680 0x7fcc6c15e160 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- 172.21.15.119:0/585356698 >> 172.21.15.119:0/585356698 conn(0x7fcc6c06a3e0 msgr2=0x7fcc6c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- 172.21.15.119:0/585356698 shutdown_connections 2023-12-19T16:17:15.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- 172.21.15.119:0/585356698 wait complete. 2023-12-19T16:17:15.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 Processor -- start 2023-12-19T16:17:15.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- start start 2023-12-19T16:17:15.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 0x7fcc6c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc6c0cac10 0x7fcc6c159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc6c15a680 0x7fcc6c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0c49d0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0c3dc0 con 0x7fcc6c0cac10 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc73d8f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0c40a0 con 0x7fcc6c15a680 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 0x7fcc6c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 0x7fcc6c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34848/0 (socket says 172.21.15.119:34848) 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 -- 172.21.15.119:0/3941185567 learned_addr learned my addr 172.21.15.119:0/3941185567 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc7232c640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc6c15a680 0x7fcc6c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc7132a640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc6c0cac10 0x7fcc6c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 -- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc6c15a680 msgr2=0x7fcc6c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc6c15a680 0x7fcc6c0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 -- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc6c0cac10 msgr2=0x7fcc6c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc6c0cac10 0x7fcc6c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc71b2b640 1 -- 172.21.15.119:0/3941185567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680094d0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc7132a640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc6c0cac10 0x7fcc6c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.816+0000 7fcc7232c640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc6c15a680 0x7fcc6c0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc71b2b640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 0x7fcc6c14fa90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcc680ad040 tx=0x7fcc680191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680bc070 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680abe10 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680b4870 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c0c4380 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c14ffd0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c0735b0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc680b49d0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc627fc640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcc50065a60 0x7fcc50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fcc6811cdb0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc7132a640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcc50065a60 0x7fcc50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.820+0000 7fcc7132a640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcc50065a60 0x7fcc50067f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cdc10 tx=0x7fcc5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.824+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcc68121070 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.984+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcc6c04e000 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.984+0000 7fcc627fc640 1 -- 172.21.15.119:0/3941185567 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcc680ea5b0 con 0x7fcc6c06fdb0 2023-12-19T16:17:15.989 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcc50065a60 msgr2=0x7fcc50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcc50065a60 0x7fcc50067f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cdc10 tx=0x7fcc5c008040 comp rx=0 tx=0).stop 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 msgr2=0x7fcc6c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 0x7fcc6c14fa90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcc680ad040 tx=0x7fcc680191d0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 shutdown_connections 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcc50065a60 0x7fcc50067f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc6c0cac10 0x7fcc6c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc6c15a680 0x7fcc6c0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 --2- 172.21.15.119:0/3941185567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc6c06fdb0 0x7fcc6c14fa90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 >> 172.21.15.119:0/3941185567 conn(0x7fcc6c06a3e0 msgr2=0x7fcc6c15aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 shutdown_connections 2023-12-19T16:17:15.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:15.988+0000 7fcc73d8f640 1 -- 172.21.15.119:0/3941185567 wait complete. 2023-12-19T16:17:16.010 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:17:16.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:16.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:16.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[50273]: fuse finished with error 0 and tester_r 0 2023-12-19T16:17:16.031 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:18.578 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:18.583 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:22.133 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:17:22.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:22.133 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:17:22.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-12-19T16:17:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.340+0000 7f9830866640 1 Processor -- start 2023-12-19T16:17:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.340+0000 7f9830866640 1 -- start start 2023-12-19T16:17:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9830866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9830866640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f982c0ad900 0x7f982c0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9830866640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0ca2e0 con 0x7f982c0c9b40 2023-12-19T16:17:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9830866640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c0ca000 con 0x7f982c0ad900 2023-12-19T16:17:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9830866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c070700 con 0x7f982c158f20 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f982c0ad900 0x7f982c0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f982a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f982c0ad900 0x7f982c0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:42372/0 (socket says 172.21.15.119:42372) 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 -- 172.21.15.119:0/1465031138 learned_addr learned my addr 172.21.15.119:0/1465031138 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f982ad9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f982c0c9b40 0x7f982c06bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:42104/0 (socket says 172.21.15.119:42104) 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 -- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 msgr2=0x7f982c0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 --2- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 -- 172.21.15.119:0/1465031138 >> v1:172.21.15.143:6789/0 conn(0x7f982c0c9b40 legacy=0x7f982c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9821d9b640 1 -- 172.21.15.119:0/1465031138 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0709e0 con 0x7f982c0ad900 2023-12-19T16:17:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.344+0000 7f9829d9b640 1 -- 172.21.15.119:0/1465031138 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100092509 0 0) 0x7f982c0ca2e0 con 0x7f982c0c9b40 2023-12-19T16:17:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9821d9b640 1 --2- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0ad900 0x7f982c0cc350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f981401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b31c01369aba022a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9829d9b640 1 -- 172.21.15.119:0/1465031138 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140ab600 con 0x7f982c0ad900 2023-12-19T16:17:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9829d9b640 1 -- 172.21.15.119:0/1465031138 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98140ab760 con 0x7f982c0ad900 2023-12-19T16:17:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9829d9b640 1 -- 172.21.15.119:0/1465031138 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140abaf0 con 0x7f982c0ad900 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 -- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0ad900 msgr2=0x7f982c0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 --2- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0ad900 0x7f982c0cc350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f981401c510 comp rx=0 tx=0).stop 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 -- 172.21.15.119:0/1465031138 shutdown_connections 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 --2- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0ad900 0x7f982c0cc350 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 --2- 172.21.15.119:0/1465031138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 -- 172.21.15.119:0/1465031138 >> 172.21.15.119:0/1465031138 conn(0x7f982c0ce450 msgr2=0x7f982c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 -- 172.21.15.119:0/1465031138 shutdown_connections 2023-12-19T16:17:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 -- 172.21.15.119:0/1465031138 wait complete. 2023-12-19T16:17:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 Processor -- start 2023-12-19T16:17:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.348+0000 7f9830866640 1 -- start start 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 0x7f982c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0c9b40 0x7f982c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c142630 con 0x7f982c0ad900 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c15b4c0 con 0x7f982c0c9b40 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c142350 con 0x7f982c158f20 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 0x7f982c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 0x7f982c15c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34864/0 (socket says 172.21.15.119:34864) 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 -- 172.21.15.119:0/745636741 learned_addr learned my addr 172.21.15.119:0/745636741 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9821d9b640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0c9b40 0x7f982c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982ad9d640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 -- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 msgr2=0x7f982c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 -- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0c9b40 msgr2=0x7f982c1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0c9b40 0x7f982c1599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 -- 172.21.15.119:0/745636741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140094d0 con 0x7f982c0ad900 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982ad9d640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f982a59c640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 0x7f982c15c240 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f981c00e870 tx=0x7f981c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c009510 con 0x7f982c0ad900 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c00eec0 con 0x7f982c0ad900 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00cb40 con 0x7f982c0ad900 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c15b760 con 0x7f982c0ad900 2023-12-19T16:17:22.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c15bd20 con 0x7f982c0ad900 2023-12-19T16:17:22.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c0cf1a0 con 0x7f982c0ad900 2023-12-19T16:17:22.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.352+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f981c00cca0 con 0x7f982c0ad900 2023-12-19T16:17:22.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.356+0000 7f98237fe640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f980c065a60 0x7f980c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.356+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f981c083500 con 0x7f982c0ad900 2023-12-19T16:17:22.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.356+0000 7f9821d9b640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f980c065a60 0x7f980c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.356+0000 7f9821d9b640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f980c065a60 0x7f980c067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f98140af000 tx=0x7f98140b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.360+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f981c050ca0 con 0x7f982c0ad900 2023-12-19T16:17:22.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.564+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f982c066e70 con 0x7f982c0ad900 2023-12-19T16:17:22.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.568+0000 7f98237fe640 1 -- 172.21.15.119:0/745636741 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+0 (secure 0 0 0) 0x7f981c0542c0 con 0x7f982c0ad900 2023-12-19T16:17:22.572 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f980c065a60 msgr2=0x7f980c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f980c065a60 0x7f980c067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f98140af000 tx=0x7f98140b6040 comp rx=0 tx=0).stop 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 msgr2=0x7f982c15c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 0x7f982c15c240 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f981c00e870 tx=0x7f981c00ec70 comp rx=0 tx=0).stop 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 shutdown_connections 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f980c065a60 0x7f980c067f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f982c0c9b40 0x7f982c1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f982c158f20 0x7f982c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 --2- 172.21.15.119:0/745636741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f982c0ad900 0x7f982c15c240 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 >> 172.21.15.119:0/745636741 conn(0x7f982c0ce450 msgr2=0x7f982c06bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 shutdown_connections 2023-12-19T16:17:22.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.572+0000 7f9830866640 1 -- 172.21.15.119:0/745636741 wait complete. 2023-12-19T16:17:22.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:17:22.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.728+0000 7fef076f2640 1 Processor -- start 2023-12-19T16:17:22.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.728+0000 7fef076f2640 1 -- start start 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef076f2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef000c1280 0x7fef000cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef076f2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0006fdb0 con 0x7fef000cb340 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef076f2640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef00164820 con 0x7fef00160cc0 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef076f2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef001654a0 con 0x7fef000c1280 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef000c1280 0x7fef000cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef000c1280 0x7fef000cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48504/0 (socket says 172.21.15.119:48504) 2023-12-19T16:17:22.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 -- 172.21.15.119:0/2592041330 learned_addr learned my addr 172.21.15.119:0/2592041330 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 -- 172.21.15.119:0/2592041330 >> v1:172.21.15.143:6789/0 conn(0x7fef00160cc0 legacy=0x7fef000cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 -- 172.21.15.119:0/2592041330 >> v1:172.21.15.119:6789/0 conn(0x7fef000cb340 legacy=0x7fef000cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 -- 172.21.15.119:0/2592041330 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00164b00 con 0x7fef000c1280 2023-12-19T16:17:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.732+0000 7fef04c8d640 1 --2- 172.21.15.119:0/2592041330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000cc400 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feef0009870 tx=0x7feef001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90a22238c6946b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7feef7fff640 1 -- 172.21.15.119:0/2592041330 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00ab600 con 0x7fef000c1280 2023-12-19T16:17:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7feef7fff640 1 -- 172.21.15.119:0/2592041330 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00a7050 con 0x7fef000c1280 2023-12-19T16:17:22.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7feef7fff640 1 -- 172.21.15.119:0/2592041330 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00ab980 con 0x7fef000c1280 2023-12-19T16:17:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- 172.21.15.119:0/2592041330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 msgr2=0x7fef000cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 --2- 172.21.15.119:0/2592041330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000cc400 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feef0009870 tx=0x7feef001c4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- 172.21.15.119:0/2592041330 shutdown_connections 2023-12-19T16:17:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 --2- 172.21.15.119:0/2592041330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000cc400 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- 172.21.15.119:0/2592041330 >> 172.21.15.119:0/2592041330 conn(0x7fef0006a3e0 msgr2=0x7fef000afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- 172.21.15.119:0/2592041330 shutdown_connections 2023-12-19T16:17:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- 172.21.15.119:0/2592041330 wait complete. 2023-12-19T16:17:22.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 Processor -- start 2023-12-19T16:17:22.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- start start 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef000cb340 0x7fef00164060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef00160cc0 0x7fef00161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001645a0 con 0x7fef000c1280 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000b24b0 con 0x7fef000cb340 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef076f2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000b2790 con 0x7fef00160cc0 2023-12-19T16:17:22.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef0548e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef0548e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48510/0 (socket says 172.21.15.119:48510) 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.736+0000 7fef0548e640 1 -- 172.21.15.119:0/3787861617 learned_addr learned my addr 172.21.15.119:0/3787861617 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef04c8d640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef000cb340 0x7fef00164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef0548e640 1 -- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef00160cc0 msgr2=0x7fef00161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef0548e640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef00160cc0 0x7fef00161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef0548e640 1 -- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef000cb340 msgr2=0x7fef00164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef0548e640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef000cb340 0x7fef00164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef0548e640 1 -- 172.21.15.119:0/3787861617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094d0 con 0x7fef000c1280 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef04c8d640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef000cb340 0x7fef00164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef0548e640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000b1e40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feefc00c3c0 tx=0x7feefc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0052d0 con 0x7fef000c1280 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc005430 con 0x7fef000c1280 2023-12-19T16:17:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000b2a70 con 0x7fef000c1280 2023-12-19T16:17:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc003840 con 0x7fef000c1280 2023-12-19T16:17:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000b3030 con 0x7fef000c1280 2023-12-19T16:17:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef000735b0 con 0x7fef000c1280 2023-12-19T16:17:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feefc0039a0 con 0x7fef000c1280 2023-12-19T16:17:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7feef5ffb640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feee4065a90 0x7feee4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7feefc082970 con 0x7fef000c1280 2023-12-19T16:17:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.740+0000 7fef04c8d640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feee4065a90 0x7feee4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.744+0000 7fef04c8d640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feee4065a90 0x7feee4067f50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feef00ad000 tx=0x7feef0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.744+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feefc050050 con 0x7fef000c1280 2023-12-19T16:17:22.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.928+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef00160540 con 0x7fef000c1280 2023-12-19T16:17:22.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.928+0000 7feef5ffb640 1 -- 172.21.15.119:0/3787861617 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7feefc017070 con 0x7fef000c1280 2023-12-19T16:17:22.933 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feee4065a90 msgr2=0x7feee4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feee4065a90 0x7feee4067f50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feef00ad000 tx=0x7feef0008040 comp rx=0 tx=0).stop 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 msgr2=0x7fef000b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000b1e40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feefc00c3c0 tx=0x7feefc00c880 comp rx=0 tx=0).stop 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 shutdown_connections 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7feee4065a90 0x7feee4067f50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef000cb340 0x7fef00164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef00160cc0 0x7fef00161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 --2- 172.21.15.119:0/3787861617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef000c1280 0x7fef000b1e40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 >> 172.21.15.119:0/3787861617 conn(0x7fef0006a3e0 msgr2=0x7fef000ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 shutdown_connections 2023-12-19T16:17:22.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:22.932+0000 7fef076f2640 1 -- 172.21.15.119:0/3787861617 wait complete. 2023-12-19T16:17:22.953 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:17:22.954 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:22.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:22.954 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.964 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42316sec preferred_lft 42316sec 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:17:22.965 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:17:22.966 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.967 INFO:teuthology.orchestra.run.smithi119.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:22.967 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:17:22.967 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:17:22.967 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:22.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:22.967 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:17:23.023 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:17:23.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:23.026 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:17:23.083 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:17:23.083 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:17:23.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:23.084 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:17:23.084 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:17:23.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:17:23.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:17:23.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:17:23.085 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:17:23.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:23.176 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:17:23.185 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:17:23.185 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:17:23.185 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:23.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:23.185 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:17:23.249 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:17:23.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:23.249 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:23.305 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:23.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:23.306 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:23.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:17:23.422 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:17:23.422 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:17:23.483 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:17:23.485 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:17:23.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:23.486 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:17:23.541 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:17:23.541 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:17:23.588 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:17:23.609 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:17:23.609 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:17:23.674 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:17:23.676 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:17:23.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:23.677 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:17:23.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:17:23.680+0000 7fe755e1a580 -1 init, newargv = 0x5597b9ea6150 newargc=15 2023-12-19T16:17:23.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[50727]: starting ceph client 2023-12-19T16:17:23.692 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[50727]: starting fuse 2023-12-19T16:17:23.694 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:17:23.694 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:17:23.694 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:17:23.694 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:17:23.694 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:17:23.694 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:17:23.695 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:17:23.696 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:17:23.696 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:17:23.696 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:17:23.696 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:23.696 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:17:23.696 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:17:23.819 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.50727.asok 2023-12-19T16:17:24.003 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50727.asok 2023-12-19T16:17:24.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:24.004 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50727.asok status 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "50727", 2023-12-19T16:17:24.174 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5928, 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5928 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:17:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3533437932 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3533437932 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5928 192.168.0.1:0/3533437932", 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/3533437932", 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 18, 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 42, 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:17:24.176 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:17:24.177 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:17:24.177 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:17:24.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:24.189 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:17:24.189 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:24.198 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:17:24.198 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:24.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:24.198 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:24.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:24.265 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-12-19T16:17:24.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:24.322 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-12-19T16:17:24.380 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:24.380 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:24.429 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:24.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 Processor -- start 2023-12-19T16:17:24.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 -- start start 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015cb30 0x7fb5b006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb5b00cefe0 0x7fb5b00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b006c140 con 0x7fb5b015d2d0 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b015cf10 con 0x7fb5b00cefe0 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b7e63640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015e000 con 0x7fb5b015cb30 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b6400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb5b015d2d0 0x7fb5b015d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35842/0 (socket says 172.21.15.119:35842) 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b6400640 1 -- 172.21.15.119:0/3302565547 learned_addr learned my addr 172.21.15.119:0/3302565547 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b5bff640 1 --2- 172.21.15.119:0/3302565547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015cb30 0x7fb5b006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b53fe640 1 --2- 172.21.15.119:0/3302565547 >> v2:172.21.15.143:3300/0 conn(0x7fb5b00cefe0 0x7fb5b00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b4bfd640 1 -- 172.21.15.119:0/3302565547 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446527676 0 0) 0x7fb5b006c140 con 0x7fb5b015d2d0 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b4bfd640 1 -- 172.21.15.119:0/3302565547 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c003530 con 0x7fb5b015d2d0 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b5bff640 1 -- 172.21.15.119:0/3302565547 >> v2:172.21.15.143:3300/0 conn(0x7fb5b00cefe0 msgr2=0x7fb5b00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:24.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b5bff640 1 --2- 172.21.15.119:0/3302565547 >> v2:172.21.15.143:3300/0 conn(0x7fb5b00cefe0 0x7fb5b00cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b5bff640 1 -- 172.21.15.119:0/3302565547 >> v1:172.21.15.119:6789/0 conn(0x7fb5b015d2d0 legacy=0x7fb5b015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.608+0000 7fb5b5bff640 1 -- 172.21.15.119:0/3302565547 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00cf960 con 0x7fb5b015cb30 2023-12-19T16:17:24.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b5bff640 1 --2- 172.21.15.119:0/3302565547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015cb30 0x7fb5b006bc00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0097a0 tx=0x7fb5ac01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7342b3b7f340d9a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b4bfd640 1 -- 172.21.15.119:0/3302565547 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0a7070 con 0x7fb5b015cb30 2023-12-19T16:17:24.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b4bfd640 1 -- 172.21.15.119:0/3302565547 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0ab430 con 0x7fb5b015cb30 2023-12-19T16:17:24.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b4bfd640 1 -- 172.21.15.119:0/3302565547 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0ab7a0 con 0x7fb5b015cb30 2023-12-19T16:17:24.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 -- 172.21.15.119:0/3302565547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015cb30 msgr2=0x7fb5b006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/3302565547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015cb30 0x7fb5b006bc00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0097a0 tx=0x7fb5ac01c430 comp rx=0 tx=0).stop 2023-12-19T16:17:24.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 -- 172.21.15.119:0/3302565547 shutdown_connections 2023-12-19T16:17:24.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/3302565547 >> v2:172.21.15.143:3300/0 conn(0x7fb5b00cefe0 0x7fb5b00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/3302565547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015cb30 0x7fb5b006bc00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 -- 172.21.15.119:0/3302565547 >> 172.21.15.119:0/3302565547 conn(0x7fb5b0089fb0 msgr2=0x7fb5b009b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:24.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 -- 172.21.15.119:0/3302565547 shutdown_connections 2023-12-19T16:17:24.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.612+0000 7fb5b7e63640 1 -- 172.21.15.119:0/3302565547 wait complete. 2023-12-19T16:17:24.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 Processor -- start 2023-12-19T16:17:24.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 -- start start 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 0x7fb5b00cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5b015cb30 0x7fb5b00c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015d2d0 0x7fb5b00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00caac0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00caee0 con 0x7fb5b015cb30 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c9ba0 con 0x7fb5b015d2d0 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 0x7fb5b00cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 0x7fb5b00cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48526/0 (socket says 172.21.15.119:48526) 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 -- 172.21.15.119:0/2456479248 learned_addr learned my addr 172.21.15.119:0/2456479248 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b53fe640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5b015cb30 0x7fb5b00c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b6400640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015d2d0 0x7fb5b00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 -- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015d2d0 msgr2=0x7fb5b00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015d2d0 0x7fb5b00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 -- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5b015cb30 msgr2=0x7fb5b00c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5b015cb30 0x7fb5b00c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 -- 172.21.15.119:0/2456479248 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0093b0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b53fe640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5b015cb30 0x7fb5b00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:24.621 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b5bff640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 0x7fb5b00cc050 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ad040 tx=0x7fb5ac0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0b45f0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0b4750 con 0x7fb5b00cefe0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0b4ac0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00c9e40 con 0x7fb5b00cefe0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.616+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00ca400 con 0x7fb5b00cefe0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.620+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b006a7c0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.620+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5ac0b4c20 con 0x7fb5b00cefe0 2023-12-19T16:17:24.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.620+0000 7fb5a67fc640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb594065a60 0x7fb594067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.620+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb5ac11d9e0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.620+0000 7fb5b53fe640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb594065a60 0x7fb594067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.620+0000 7fb5b53fe640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb594065a60 0x7fb594067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00cc660 tx=0x7fb5a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.627 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.624+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb5ac0eaf20 con 0x7fb5b00cefe0 2023-12-19T16:17:24.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.776+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b004e000 con 0x7fb5b00cefe0 2023-12-19T16:17:24.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.776+0000 7fb5a67fc640 1 -- 172.21.15.119:0/2456479248 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7fb5ac006dc0 con 0x7fb5b00cefe0 2023-12-19T16:17:24.780 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:24.780 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb594065a60 msgr2=0x7fb594067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb594065a60 0x7fb594067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00cc660 tx=0x7fb5a0008040 comp rx=0 tx=0).stop 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 msgr2=0x7fb5b00cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 0x7fb5b00cc050 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ad040 tx=0x7fb5ac0191d0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 shutdown_connections 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb594065a60 0x7fb594067f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5b015cb30 0x7fb5b00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5b015d2d0 0x7fb5b00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 --2- 172.21.15.119:0/2456479248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5b00cefe0 0x7fb5b00cc050 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 >> 172.21.15.119:0/2456479248 conn(0x7fb5b0089fb0 msgr2=0x7fb5b015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 shutdown_connections 2023-12-19T16:17:24.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.780+0000 7fb5b7e63640 1 -- 172.21.15.119:0/2456479248 wait complete. 2023-12-19T16:17:24.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:24.801 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:24.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.936+0000 7f779cab6640 1 Processor -- start 2023-12-19T16:17:24.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.936+0000 7f779cab6640 1 -- start start 2023-12-19T16:17:24.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779cab6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f77980ceac0 0x7f7798164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779cab6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798164e60 0x7f77980cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779cab6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980cc980 con 0x7f7798160a60 2023-12-19T16:17:24.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779cab6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980cc090 con 0x7f77980ceac0 2023-12-19T16:17:24.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779cab6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980cc330 con 0x7f7798164e60 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779659c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7798160a60 0x7f77980ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:46884/0 (socket says 172.21.15.119:46884) 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779659c640 1 -- 172.21.15.119:0/4017751378 learned_addr learned my addr 172.21.15.119:0/4017751378 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f7796d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798164e60 0x7f77980cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f7795d9b640 1 --2- 172.21.15.119:0/4017751378 >> v2:172.21.15.143:3300/0 conn(0x7f77980ceac0 0x7f7798164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f779559a640 1 -- 172.21.15.119:0/4017751378 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940190997 0 0) 0x7f77980cc980 con 0x7f7798160a60 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f7796d9d640 1 -- 172.21.15.119:0/4017751378 >> v2:172.21.15.143:3300/0 conn(0x7f77980ceac0 msgr2=0x7f7798164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:24.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f7796d9d640 1 --2- 172.21.15.119:0/4017751378 >> v2:172.21.15.143:3300/0 conn(0x7f77980ceac0 0x7f7798164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f7796d9d640 1 -- 172.21.15.119:0/4017751378 >> v1:172.21.15.143:6789/0 conn(0x7f7798160a60 legacy=0x7f77980ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.940+0000 7f7796d9d640 1 -- 172.21.15.119:0/4017751378 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980cc610 con 0x7f7798164e60 2023-12-19T16:17:24.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f7796d9d640 1 --2- 172.21.15.119:0/4017751378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798164e60 0x7f77980cce10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7790009d90 tx=0x7f779001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837dbcc159f1a535 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779559a640 1 -- 172.21.15.119:0/4017751378 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900a59f0 con 0x7f7798164e60 2023-12-19T16:17:24.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779559a640 1 -- 172.21.15.119:0/4017751378 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77900a5b50 con 0x7f7798164e60 2023-12-19T16:17:24.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779559a640 1 -- 172.21.15.119:0/4017751378 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900ad440 con 0x7f7798164e60 2023-12-19T16:17:24.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 -- 172.21.15.119:0/4017751378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798164e60 msgr2=0x7f77980cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 --2- 172.21.15.119:0/4017751378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798164e60 0x7f77980cce10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7790009d90 tx=0x7f779001c950 comp rx=0 tx=0).stop 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 -- 172.21.15.119:0/4017751378 shutdown_connections 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 --2- 172.21.15.119:0/4017751378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798164e60 0x7f77980cce10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 --2- 172.21.15.119:0/4017751378 >> v2:172.21.15.143:3300/0 conn(0x7f77980ceac0 0x7f7798164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 -- 172.21.15.119:0/4017751378 >> 172.21.15.119:0/4017751378 conn(0x7f779806a2a0 msgr2=0x7f77980aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 -- 172.21.15.119:0/4017751378 shutdown_connections 2023-12-19T16:17:24.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.944+0000 7f779cab6640 1 -- 172.21.15.119:0/4017751378 wait complete. 2023-12-19T16:17:24.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 Processor -- start 2023-12-19T16:17:24.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- start start 2023-12-19T16:17:24.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77980ceac0 0x7f77981632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798160a60 0x7f779815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 0x7f77980c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c6660 con 0x7f7798164e60 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c6050 con 0x7f77980ceac0 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77981622e0 con 0x7f7798160a60 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 0x7f77980c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 0x7f77980c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48530/0 (socket says 172.21.15.119:48530) 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 -- 172.21.15.119:0/968101616 learned_addr learned my addr 172.21.15.119:0/968101616 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779659c640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77980ceac0 0x7f77981632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7795d9b640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798160a60 0x7f779815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 -- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798160a60 msgr2=0x7f779815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798160a60 0x7f779815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 -- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77980ceac0 msgr2=0x7f77981632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77980ceac0 0x7f77981632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 -- 172.21.15.119:0/968101616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009a70 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7796d9d640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 0x7f77980c7830 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f77900b0040 tx=0x7f77900196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900add90 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790009450 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900b7650 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77980c48d0 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7798162000 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.948+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980c67a0 con 0x7f7798164e60 2023-12-19T16:17:24.953 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.952+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77900b4050 con 0x7f7798164e60 2023-12-19T16:17:24.954 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.952+0000 7f7786ffd640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7778065a60 0x7f7778067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.952+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f779011ea10 con 0x7f7798164e60 2023-12-19T16:17:24.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.952+0000 7f779659c640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7778065a60 0x7f7778067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.952+0000 7f779659c640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7778065a60 0x7f7778067f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7788007fd0 tx=0x7f7788007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:24.956+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77980c67a0 con 0x7f7798164e60 2023-12-19T16:17:25.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77980c67a0 con 0x7f7798164e60 2023-12-19T16:17:25.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f7786ffd640 1 -- 172.21.15.119:0/968101616 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77980c67a0 con 0x7f7798164e60 2023-12-19T16:17:25.110 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7778065a60 msgr2=0x7f7778067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7778065a60 0x7f7778067f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7788007fd0 tx=0x7f7788007d60 comp rx=0 tx=0).stop 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 msgr2=0x7f77980c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 0x7f77980c7830 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f77900b0040 tx=0x7f77900196f0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 shutdown_connections 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7778065a60 0x7f7778067f20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7798164e60 0x7f77980c7830 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7798160a60 0x7f779815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 --2- 172.21.15.119:0/968101616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77980ceac0 0x7f77981632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 >> 172.21.15.119:0/968101616 conn(0x7f779806a2a0 msgr2=0x7f77980c8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 shutdown_connections 2023-12-19T16:17:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.108+0000 7f779cab6640 1 -- 172.21.15.119:0/968101616 wait complete. 2023-12-19T16:17:25.131 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:25.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae51483640 1 Processor -- start 2023-12-19T16:17:25.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae51483640 1 -- start start 2023-12-19T16:17:25.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae51483640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c06bdf0 0x7fae4c0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae51483640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c15d8c0 con 0x7fae4c0cb810 2023-12-19T16:17:25.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae51483640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c15dba0 con 0x7fae4c06c1d0 2023-12-19T16:17:25.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae51483640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c15de80 con 0x7fae4c06bdf0 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fae4c0cb810 0x7fae4c15d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35852/0 (socket says 172.21.15.119:35852) 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4b7fe640 1 -- 172.21.15.119:0/893894634 learned_addr learned my addr 172.21.15.119:0/893894634 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4bfff640 1 --2- 172.21.15.119:0/893894634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c06bdf0 0x7fae4c0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4affd640 1 -- 172.21.15.119:0/893894634 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25006468 0 0) 0x7fae4c15d8c0 con 0x7fae4c0cb810 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4affd640 1 -- 172.21.15.119:0/893894634 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae34003530 con 0x7fae4c0cb810 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4affd640 1 -- 172.21.15.119:0/893894634 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75330885 0 0) 0x7fae4c15dba0 con 0x7fae4c06c1d0 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4bfff640 1 -- 172.21.15.119:0/893894634 >> v1:172.21.15.143:6789/0 conn(0x7fae4c06c1d0 legacy=0x7fae4c14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4bfff640 1 -- 172.21.15.119:0/893894634 >> v1:172.21.15.119:6789/0 conn(0x7fae4c0cb810 legacy=0x7fae4c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.268+0000 7fae4bfff640 1 -- 172.21.15.119:0/893894634 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0c8880 con 0x7fae4c06bdf0 2023-12-19T16:17:25.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae4bfff640 1 --2- 172.21.15.119:0/893894634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c06bdf0 0x7fae4c0c9080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097f0 tx=0x7fae3c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af46a9a3533e74be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae4affd640 1 -- 172.21.15.119:0/893894634 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0aa610 con 0x7fae4c06bdf0 2023-12-19T16:17:25.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae4affd640 1 -- 172.21.15.119:0/893894634 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c0a6040 con 0x7fae4c06bdf0 2023-12-19T16:17:25.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae4affd640 1 -- 172.21.15.119:0/893894634 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0aa990 con 0x7fae4c06bdf0 2023-12-19T16:17:25.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 -- 172.21.15.119:0/893894634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c06bdf0 msgr2=0x7fae4c0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 --2- 172.21.15.119:0/893894634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c06bdf0 0x7fae4c0c9080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097f0 tx=0x7fae3c01c490 comp rx=0 tx=0).stop 2023-12-19T16:17:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 -- 172.21.15.119:0/893894634 shutdown_connections 2023-12-19T16:17:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 --2- 172.21.15.119:0/893894634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c06bdf0 0x7fae4c0c9080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 -- 172.21.15.119:0/893894634 >> 172.21.15.119:0/893894634 conn(0x7fae4c06a2a0 msgr2=0x7fae4c0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 -- 172.21.15.119:0/893894634 shutdown_connections 2023-12-19T16:17:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.272+0000 7fae51483640 1 -- 172.21.15.119:0/893894634 wait complete. 2023-12-19T16:17:25.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 Processor -- start 2023-12-19T16:17:25.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 -- start start 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 0x7fae4c0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae4c06c1d0 0x7fae4c0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c0cb810 0x7fae4c14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0b1600 con 0x7fae4c06bdf0 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0b2be0 con 0x7fae4c06c1d0 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0b1da0 con 0x7fae4c0cb810 2023-12-19T16:17:25.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 0x7fae4c0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 0x7fae4c0b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48536/0 (socket says 172.21.15.119:48536) 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 -- 172.21.15.119:0/234316488 learned_addr learned my addr 172.21.15.119:0/234316488 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4b7fe640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae4c06c1d0 0x7fae4c0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae50c82640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c0cb810 0x7fae4c14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 -- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c0cb810 msgr2=0x7fae4c14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c0cb810 0x7fae4c14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 -- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae4c06c1d0 msgr2=0x7fae4c0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae4c06c1d0 0x7fae4c0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 -- 172.21.15.119:0/234316488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c009420 con 0x7fae4c06bdf0 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae50c82640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c0cb810 0x7fae4c14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4b7fe640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae4c06c1d0 0x7fae4c0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae4bfff640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 0x7fae4c0b26a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097f0 tx=0x7fae3c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0be410 con 0x7fae4c06bdf0 2023-12-19T16:17:25.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c0be590 con 0x7fae4c06bdf0 2023-12-19T16:17:25.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0be940 con 0x7fae4c06bdf0 2023-12-19T16:17:25.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c0b17e0 con 0x7fae4c06bdf0 2023-12-19T16:17:25.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.276+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c0ac630 con 0x7fae4c06bdf0 2023-12-19T16:17:25.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.280+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c0b1be0 con 0x7fae4c06bdf0 2023-12-19T16:17:25.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.280+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae3c0beaa0 con 0x7fae4c06bdf0 2023-12-19T16:17:25.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.280+0000 7fae48ff9640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae38065a60 0x7fae38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.280+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fae3c11dda0 con 0x7fae4c06bdf0 2023-12-19T16:17:25.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.280+0000 7fae4b7fe640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae38065a60 0x7fae38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.280+0000 7fae4b7fe640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae38065a60 0x7fae38067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae4c1592c0 tx=0x7fae40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.284+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae3c0eb480 con 0x7fae4c06bdf0 2023-12-19T16:17:25.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae4c04e850 con 0x7fae4c06bdf0 2023-12-19T16:17:25.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae48ff9640 1 -- 172.21.15.119:0/234316488 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae3c0eeaa0 con 0x7fae4c06bdf0 2023-12-19T16:17:25.442 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae38065a60 msgr2=0x7fae38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae38065a60 0x7fae38067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae4c1592c0 tx=0x7fae40009040 comp rx=0 tx=0).stop 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 msgr2=0x7fae4c0b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 0x7fae4c0b26a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097f0 tx=0x7fae3c01acd0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 shutdown_connections 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fae38065a60 0x7fae38067f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae4c06c1d0 0x7fae4c0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae4c0cb810 0x7fae4c14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 --2- 172.21.15.119:0/234316488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae4c06bdf0 0x7fae4c0b26a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 >> 172.21.15.119:0/234316488 conn(0x7fae4c06a2a0 msgr2=0x7fae4c072880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 shutdown_connections 2023-12-19T16:17:25.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.440+0000 7fae51483640 1 -- 172.21.15.119:0/234316488 wait complete. 2023-12-19T16:17:25.466 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:25.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf6e317640 1 Processor -- start 2023-12-19T16:17:25.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf6e317640 1 -- start start 2023-12-19T16:17:25.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf6e317640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcf680ca410 0x7fcf68159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf6e317640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf68070df0 con 0x7fcf68159fb0 2023-12-19T16:17:25.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf6e317640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6815a4f0 con 0x7fcf680cbff0 2023-12-19T16:17:25.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf6e317640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6815aab0 con 0x7fcf680ca410 2023-12-19T16:17:25.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf67fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcf680ca410 0x7fcf68159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf67fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcf680ca410 0x7fcf68159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48546/0 (socket says 172.21.15.119:48546) 2023-12-19T16:17:25.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf67fff640 1 -- 172.21.15.119:0/2191908326 learned_addr learned my addr 172.21.15.119:0/2191908326 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:25.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf677fe640 1 --1- 172.21.15.119:0/2191908326 >> v1:172.21.15.119:6789/0 conn(0x7fcf68159fb0 0x7fcf68071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35866/0 (socket says 172.21.15.119:35866) 2023-12-19T16:17:25.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf67fff640 1 -- 172.21.15.119:0/2191908326 >> v1:172.21.15.143:6789/0 conn(0x7fcf680cbff0 legacy=0x7fcf680ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf67fff640 1 -- 172.21.15.119:0/2191908326 >> v1:172.21.15.119:6789/0 conn(0x7fcf68159fb0 legacy=0x7fcf68071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf66ffd640 1 -- 172.21.15.119:0/2191908326 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073530202 0 0) 0x7fcf68070df0 con 0x7fcf68159fb0 2023-12-19T16:17:25.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.604+0000 7fcf67fff640 1 -- 172.21.15.119:0/2191908326 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6815a7d0 con 0x7fcf680ca410 2023-12-19T16:17:25.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf67fff640 1 --2- 172.21.15.119:0/2191908326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680ca410 0x7fcf68159a70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800bb10 tx=0x7fcf5801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baff017e0b7cb56c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf66ffd640 1 -- 172.21.15.119:0/2191908326 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580a7b70 con 0x7fcf680ca410 2023-12-19T16:17:25.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf66ffd640 1 -- 172.21.15.119:0/2191908326 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf580a7cd0 con 0x7fcf680ca410 2023-12-19T16:17:25.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf66ffd640 1 -- 172.21.15.119:0/2191908326 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580af660 con 0x7fcf680ca410 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 -- 172.21.15.119:0/2191908326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680ca410 msgr2=0x7fcf68159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 --2- 172.21.15.119:0/2191908326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680ca410 0x7fcf68159a70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800bb10 tx=0x7fcf5801eba0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 -- 172.21.15.119:0/2191908326 shutdown_connections 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 --2- 172.21.15.119:0/2191908326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680ca410 0x7fcf68159a70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 -- 172.21.15.119:0/2191908326 >> 172.21.15.119:0/2191908326 conn(0x7fcf6806a2a0 msgr2=0x7fcf680aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 -- 172.21.15.119:0/2191908326 shutdown_connections 2023-12-19T16:17:25.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 -- 172.21.15.119:0/2191908326 wait complete. 2023-12-19T16:17:25.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.608+0000 7fcf6e317640 1 Processor -- start 2023-12-19T16:17:25.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- start start 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf680ca410 0x7fcf680adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680cbff0 0x7fcf680af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf68159fb0 0x7fcf68151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680af700 con 0x7fcf680cbff0 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68151770 con 0x7fcf680ca410 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680ae120 con 0x7fcf68159fb0 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680cbff0 0x7fcf680af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680cbff0 0x7fcf680af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48554/0 (socket says 172.21.15.119:48554) 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf677fe640 1 -- 172.21.15.119:0/1336572267 learned_addr learned my addr 172.21.15.119:0/1336572267 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf680ca410 0x7fcf680adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6c8b4640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf68159fb0 0x7fcf68151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 -- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf68159fb0 msgr2=0x7fcf68151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf68159fb0 0x7fcf68151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 -- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680cbff0 msgr2=0x7fcf680af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680cbff0 0x7fcf680af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 -- 172.21.15.119:0/1336572267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5800b770 con 0x7fcf680ca410 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf67fff640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf680ca410 0x7fcf680adad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcf580ae000 tx=0x7fcf5801b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580a7b70 con 0x7fcf680ca410 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf580ba440 con 0x7fcf680ca410 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580ba810 con 0x7fcf680ca410 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf680ae400 con 0x7fcf680ca410 2023-12-19T16:17:25.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680ae9c0 con 0x7fcf680ca410 2023-12-19T16:17:25.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.612+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf68159e20 con 0x7fcf680ca410 2023-12-19T16:17:25.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.616+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf580b93e0 con 0x7fcf680ca410 2023-12-19T16:17:25.618 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.616+0000 7fcf64ff9640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcf54065a60 0x7fcf54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.619 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.616+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fcf580a7e40 con 0x7fcf680ca410 2023-12-19T16:17:25.619 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.616+0000 7fcf677fe640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcf54065a60 0x7fcf54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.619 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.616+0000 7fcf677fe640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcf54065a60 0x7fcf54067f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c000f70 tx=0x7fcf5c007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.620+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcf580eb560 con 0x7fcf680ca410 2023-12-19T16:17:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.768+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf6804e000 con 0x7fcf680ca410 2023-12-19T16:17:25.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.768+0000 7fcf64ff9640 1 -- 172.21.15.119:0/1336572267 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf580bf020 con 0x7fcf680ca410 2023-12-19T16:17:25.772 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:25.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcf54065a60 msgr2=0x7fcf54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcf54065a60 0x7fcf54067f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c000f70 tx=0x7fcf5c007df0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf680ca410 msgr2=0x7fcf680adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf680ca410 0x7fcf680adad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcf580ae000 tx=0x7fcf5801b940 comp rx=0 tx=0).stop 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 shutdown_connections 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcf54065a60 0x7fcf54067f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf68159fb0 0x7fcf68151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf680cbff0 0x7fcf680af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 --2- 172.21.15.119:0/1336572267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf680ca410 0x7fcf680adad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 >> 172.21.15.119:0/1336572267 conn(0x7fcf6806a2a0 msgr2=0x7fcf6814e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 shutdown_connections 2023-12-19T16:17:25.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.772+0000 7fcf6e317640 1 -- 172.21.15.119:0/1336572267 wait complete. 2023-12-19T16:17:25.794 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 Processor -- start 2023-12-19T16:17:25.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 -- start start 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f375c0ca410 0x7f375c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f375c159fb0 0x7f375c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c070df0 con 0x7f375c071db0 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c15aab0 con 0x7f375c0ca410 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f376316d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c15a4f0 con 0x7f375c159fb0 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f375c0ca410 0x7f375c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f375c0ca410 0x7f375c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48558/0 (socket says 172.21.15.119:48558) 2023-12-19T16:17:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 -- 172.21.15.119:0/4027945726 learned_addr learned my addr 172.21.15.119:0/4027945726 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f375bfff640 1 --2- 172.21.15.119:0/4027945726 >> v2:172.21.15.143:3300/0 conn(0x7f375c159fb0 0x7f375c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 -- 172.21.15.119:0/4027945726 >> v2:172.21.15.143:3300/0 conn(0x7f375c159fb0 msgr2=0x7f375c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 --2- 172.21.15.119:0/4027945726 >> v2:172.21.15.143:3300/0 conn(0x7f375c159fb0 0x7f375c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 -- 172.21.15.119:0/4027945726 >> v1:172.21.15.119:6789/0 conn(0x7f375c071db0 legacy=0x7f375c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f375b7fe640 1 -- 172.21.15.119:0/4027945726 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803285230 0 0) 0x7f375c070df0 con 0x7f375c071db0 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f3760f09640 1 -- 172.21.15.119:0/4027945726 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c15a7d0 con 0x7f375c0ca410 2023-12-19T16:17:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.932+0000 7f375bfff640 1 --2- 172.21.15.119:0/4027945726 >> v2:172.21.15.143:3300/0 conn(0x7f375c159fb0 0x7f375c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:25.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f3760f09640 1 --2- 172.21.15.119:0/4027945726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c159a70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f375c0cbeb0 tx=0x7f375001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c735c194979c4f41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f375b7fe640 1 -- 172.21.15.119:0/4027945726 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500ac640 con 0x7f375c0ca410 2023-12-19T16:17:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f375b7fe640 1 -- 172.21.15.119:0/4027945726 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37500ac7a0 con 0x7f375c0ca410 2023-12-19T16:17:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f375b7fe640 1 -- 172.21.15.119:0/4027945726 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500acb30 con 0x7f375c0ca410 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 -- 172.21.15.119:0/4027945726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 msgr2=0x7f375c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 --2- 172.21.15.119:0/4027945726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c159a70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f375c0cbeb0 tx=0x7f375001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 -- 172.21.15.119:0/4027945726 shutdown_connections 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 --2- 172.21.15.119:0/4027945726 >> v2:172.21.15.143:3300/0 conn(0x7f375c159fb0 0x7f375c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 --2- 172.21.15.119:0/4027945726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c159a70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 -- 172.21.15.119:0/4027945726 >> 172.21.15.119:0/4027945726 conn(0x7f375c06a2a0 msgr2=0x7f375c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 -- 172.21.15.119:0/4027945726 shutdown_connections 2023-12-19T16:17:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 -- 172.21.15.119:0/4027945726 wait complete. 2023-12-19T16:17:25.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.936+0000 7f376316d640 1 Processor -- start 2023-12-19T16:17:25.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- start start 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f375c071db0 0x7f375c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c0ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f375c159fb0 0x7f375c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0aec80 con 0x7f375c0ca410 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0ae7f0 con 0x7f375c071db0 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0adbe0 con 0x7f375c159fb0 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c0ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c0ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48560/0 (socket says 172.21.15.119:48560) 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 -- 172.21.15.119:0/3208270700 learned_addr learned my addr 172.21.15.119:0/3208270700 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:25.943 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f3760f09640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f375c071db0 0x7f375c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376170a640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f375c159fb0 0x7f375c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 -- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f375c159fb0 msgr2=0x7f375c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f375c159fb0 0x7f375c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 -- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f375c071db0 msgr2=0x7f375c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f375c071db0 0x7f375c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.944 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 -- 172.21.15.119:0/3208270700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500094d0 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f375bfff640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c0ac730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f374800e810 tx=0x7f374800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800c8d0 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374800ca30 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800cdc0 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c0adec0 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c0ae480 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.940+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c0ae960 con 0x7f375c0ca410 2023-12-19T16:17:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.944+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3748013410 con 0x7f375c0ca410 2023-12-19T16:17:25.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.944+0000 7f37597fa640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3740065a60 0x7f3740067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.944+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3748083180 con 0x7f375c0ca410 2023-12-19T16:17:25.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.944+0000 7f3760f09640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3740065a60 0x7f3740067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.944+0000 7f3760f09640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3740065a60 0x7f3740067f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37500ae000 tx=0x7f3750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:25.948+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3748050920 con 0x7f375c0ca410 2023-12-19T16:17:26.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.096+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f375c0cc680 con 0x7f375c0ca410 2023-12-19T16:17:26.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f37597fa640 1 -- 172.21.15.119:0/3208270700 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f3748053f40 con 0x7f375c0ca410 2023-12-19T16:17:26.102 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:26.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3740065a60 msgr2=0x7f3740067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3740065a60 0x7f3740067f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37500ae000 tx=0x7f3750008040 comp rx=0 tx=0).stop 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 msgr2=0x7f375c0ac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c0ac730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f374800e810 tx=0x7f374800ecd0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 shutdown_connections 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3740065a60 0x7f3740067f20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f375c159fb0 0x7f375c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f375c0ca410 0x7f375c0ac730 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 --2- 172.21.15.119:0/3208270700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f375c071db0 0x7f375c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 >> 172.21.15.119:0/3208270700 conn(0x7f375c06a2a0 msgr2=0x7f375c157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 shutdown_connections 2023-12-19T16:17:26.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.100+0000 7f376316d640 1 -- 172.21.15.119:0/3208270700 wait complete. 2023-12-19T16:17:26.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:26.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.256+0000 7f0b6cda2640 1 Processor -- start 2023-12-19T16:17:26.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.256+0000 7f0b6cda2640 1 -- start start 2023-12-19T16:17:26.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b6cda2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0b6806fb60 0x7f0b6806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b6cda2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680cc6c0 0x7f0b680ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b6cda2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680cbc70 con 0x7f0b680afd10 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b6cda2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680c3bb0 con 0x7f0b6806fb60 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b6cda2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c3e90 con 0x7f0b680cc6c0 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0b680afd10 0x7f0b680b00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35884/0 (socket says 172.21.15.119:35884) 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 -- 172.21.15.119:0/2794867102 learned_addr learned my addr 172.21.15.119:0/2794867102 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b67fff640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680cc6c0 0x7f0b680ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/2794867102 >> v2:172.21.15.143:3300/0 conn(0x7f0b6806fb60 0x7f0b6806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257469631 0 0) 0x7f0b680cbc70 con 0x7f0b680afd10 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b54005740 con 0x7f0b680afd10 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 248782542 0 0) 0x7f0b54005740 con 0x7f0b680afd10 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680cc6c0 msgr2=0x7f0b680ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680cc6c0 0x7f0b680ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 >> v2:172.21.15.143:3300/0 conn(0x7f0b6806fb60 msgr2=0x7f0b6806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 --2- 172.21.15.119:0/2794867102 >> v2:172.21.15.143:3300/0 conn(0x7f0b6806fb60 0x7f0b6806ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680cbec0 con 0x7f0b680afd10 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f0b58001680 con 0x7f0b680afd10 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 >> v1:172.21.15.119:6789/0 conn(0x7f0b680afd10 legacy=0x7f0b680b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b54005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b540069e0 0x7f0b54006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b540073a0 0x7f0b5400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c3bb0 con 0x7f0b54005b90 2023-12-19T16:17:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c3e90 con 0x7f0b540073a0 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5400e0e0 con 0x7f0b540069e0 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b67fff640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680cc6c0 0x7f0b680ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/2794867102 >> v2:172.21.15.143:3300/0 conn(0x7f0b6806fb60 0x7f0b6806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b54005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b67fff640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b540073a0 0x7f0b5400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b540069e0 0x7f0b54006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 -- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b540069e0 msgr2=0x7f0b54006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b540069e0 0x7f0b54006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 -- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b540073a0 msgr2=0x7f0b5400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b540073a0 0x7f0b5400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b677fe640 1 -- 172.21.15.119:0/2794867102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54005740 con 0x7f0b54005b90 2023-12-19T16:17:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.260+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b540069e0 0x7f0b54006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b677fe640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b54005fb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c270 tx=0x7f0b5801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b072ccc63ffb8710 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580a5930 con 0x7f0b54005b90 2023-12-19T16:17:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580a5a90 con 0x7f0b54005b90 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b66ffd640 1 -- 172.21.15.119:0/2794867102 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580a5e60 con 0x7f0b54005b90 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 -- 172.21.15.119:0/2794867102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 msgr2=0x7f0b54005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/2794867102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b54005fb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c270 tx=0x7f0b5801cc30 comp rx=0 tx=0).stop 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b67fff640 1 -- 172.21.15.119:0/2794867102 reap_dead start 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 -- 172.21.15.119:0/2794867102 shutdown_connections 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 -- 172.21.15.119:0/2794867102 >> 172.21.15.119:0/2794867102 conn(0x7f0b680ce130 msgr2=0x7f0b680ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 -- 172.21.15.119:0/2794867102 shutdown_connections 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 -- 172.21.15.119:0/2794867102 wait complete. 2023-12-19T16:17:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 Processor -- start 2023-12-19T16:17:26.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.264+0000 7f0b6cda2640 1 -- start start 2023-12-19T16:17:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b6813ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680c6860 0x7f0b680c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b680c53d0 0x7f0b680c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6813d3a0 con 0x7f0b54005b90 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681e8df0 con 0x7f0b680c53d0 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681e90d0 con 0x7f0b680c6860 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b6813ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b6813ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48580/0 (socket says 172.21.15.119:48580) 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 -- 172.21.15.119:0/68171715 learned_addr learned my addr 172.21.15.119:0/68171715 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680c6860 0x7f0b680c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b67fff640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b680c53d0 0x7f0b680c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 -- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680c6860 msgr2=0x7f0b680c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680c6860 0x7f0b680c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 -- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b680c53d0 msgr2=0x7f0b680c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b680c53d0 0x7f0b680c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 -- 172.21.15.119:0/68171715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b681e93b0 con 0x7f0b54005b90 2023-12-19T16:17:26.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b67fff640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b680c53d0 0x7f0b680c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:26.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b677fe640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b6813ce60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c190 tx=0x7f0b54007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58004c00 con 0x7f0b54005b90 2023-12-19T16:17:26.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580b3070 con 0x7f0b54005b90 2023-12-19T16:17:26.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b681e9690 con 0x7f0b54005b90 2023-12-19T16:17:26.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580070d0 con 0x7f0b54005b90 2023-12-19T16:17:26.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b680c7220 con 0x7f0b54005b90 2023-12-19T16:17:26.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6804e850 con 0x7f0b54005b90 2023-12-19T16:17:26.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.268+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b58007230 con 0x7f0b54005b90 2023-12-19T16:17:26.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.272+0000 7f0b64ff9640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b48065ae0 0x7f0b48067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.272+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f0b580b5070 con 0x7f0b54005b90 2023-12-19T16:17:26.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.272+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b48065ae0 0x7f0b48067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.272+0000 7f0b5ffff640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b48065ae0 0x7f0b48067fa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b4550 tx=0x7f0b50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.276+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0b580eb000 con 0x7f0b54005b90 2023-12-19T16:17:26.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0b681e9210 con 0x7f0b54005b90 2023-12-19T16:17:26.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b64ff9640 1 -- 172.21.15.119:0/68171715 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0b681e9210 con 0x7f0b54005b90 2023-12-19T16:17:26.442 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b48065ae0 msgr2=0x7f0b48067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b48065ae0 0x7f0b48067fa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b4550 tx=0x7f0b50008040 comp rx=0 tx=0).stop 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 msgr2=0x7f0b6813ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b6813ce60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c190 tx=0x7f0b54007a10 comp rx=0 tx=0).stop 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 shutdown_connections 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0b48065ae0 0x7f0b48067fa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b680c53d0 0x7f0b680c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b680c6860 0x7f0b680c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 --2- 172.21.15.119:0/68171715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b54005b90 0x7f0b6813ce60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 >> 172.21.15.119:0/68171715 conn(0x7f0b680ce130 msgr2=0x7f0b68070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 shutdown_connections 2023-12-19T16:17:26.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.440+0000 7f0b6cda2640 1 -- 172.21.15.119:0/68171715 wait complete. 2023-12-19T16:17:26.463 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:26.463 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:26.472 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:26.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f030752d640 1 Processor -- start 2023-12-19T16:17:26.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f030752d640 1 -- start start 2023-12-19T16:17:26.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f030752d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f030006fb60 0x7f030006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f030752d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000cbc70 con 0x7f03000cc6c0 2023-12-19T16:17:26.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f030752d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000c3bb0 con 0x7f03000afd10 2023-12-19T16:17:26.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f030752d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03000c3e90 con 0x7f030006fb60 2023-12-19T16:17:26.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0306d2c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f03000cc6c0 0x7f03000c2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35888/0 (socket says 172.21.15.119:35888) 2023-12-19T16:17:26.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0306d2c640 1 -- 172.21.15.119:0/3521413221 learned_addr learned my addr 172.21.15.119:0/3521413221 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:26.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0305d2a640 1 --2- 172.21.15.119:0/3521413221 >> v2:172.21.15.143:3300/0 conn(0x7f030006fb60 0x7f030006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0305529640 1 -- 172.21.15.119:0/3521413221 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152464400 0 0) 0x7f03000cbc70 con 0x7f03000cc6c0 2023-12-19T16:17:26.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0305529640 1 -- 172.21.15.119:0/3521413221 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02ec005740 con 0x7f03000cc6c0 2023-12-19T16:17:26.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0305d2a640 1 -- 172.21.15.119:0/3521413221 >> v1:172.21.15.143:6789/0 conn(0x7f03000afd10 legacy=0x7f03000b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0305d2a640 1 -- 172.21.15.119:0/3521413221 >> v1:172.21.15.119:6789/0 conn(0x7f03000cc6c0 legacy=0x7f03000c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.648+0000 7f0305d2a640 1 -- 172.21.15.119:0/3521413221 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000cbec0 con 0x7f030006fb60 2023-12-19T16:17:26.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f0305d2a640 1 --2- 172.21.15.119:0/3521413221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f030006fb60 0x7f030006ffe0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02f00097c0 tx=0x7f02f001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2a31bcdba8d56c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f0305529640 1 -- 172.21.15.119:0/3521413221 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f00ab600 con 0x7f030006fb60 2023-12-19T16:17:26.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f0305529640 1 -- 172.21.15.119:0/3521413221 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f00a7050 con 0x7f030006fb60 2023-12-19T16:17:26.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f0305529640 1 -- 172.21.15.119:0/3521413221 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f00ab980 con 0x7f030006fb60 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 -- 172.21.15.119:0/3521413221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f030006fb60 msgr2=0x7f030006ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 --2- 172.21.15.119:0/3521413221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f030006fb60 0x7f030006ffe0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02f00097c0 tx=0x7f02f001c450 comp rx=0 tx=0).stop 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 -- 172.21.15.119:0/3521413221 shutdown_connections 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 --2- 172.21.15.119:0/3521413221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f030006fb60 0x7f030006ffe0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 -- 172.21.15.119:0/3521413221 >> 172.21.15.119:0/3521413221 conn(0x7f03000ce130 msgr2=0x7f03000ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 -- 172.21.15.119:0/3521413221 shutdown_connections 2023-12-19T16:17:26.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.652+0000 7f030752d640 1 -- 172.21.15.119:0/3521413221 wait complete. 2023-12-19T16:17:26.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 Processor -- start 2023-12-19T16:17:26.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- start start 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f030006fb60 0x7f0300158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03000afd10 0x7f03000b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 0x7f03001f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001f5c90 con 0x7f03000cc6c0 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001f5f70 con 0x7f03000afd10 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03001f6250 con 0x7f030006fb60 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 0x7f03001f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 0x7f03001f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48588/0 (socket says 172.21.15.119:48588) 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 -- 172.21.15.119:0/2178799809 learned_addr learned my addr 172.21.15.119:0/2178799809 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0305d2a640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03000afd10 0x7f03000b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030652b640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f030006fb60 0x7f0300158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 -- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f030006fb60 msgr2=0x7f0300158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f030006fb60 0x7f0300158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 -- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03000afd10 msgr2=0x7f03000b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03000afd10 0x7f03000b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 -- 172.21.15.119:0/2178799809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f0009420 con 0x7f03000cc6c0 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0305d2a640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03000afd10 0x7f03000b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:26.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030652b640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f030006fb60 0x7f0300158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:26.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f0306d2c640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 0x7f03001f52e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f02f800caa0 tx=0x7f02f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800ac00 con 0x7f03000cc6c0 2023-12-19T16:17:26.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800ad60 con 0x7f03000cc6c0 2023-12-19T16:17:26.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8012620 con 0x7f03000cc6c0 2023-12-19T16:17:26.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03001611f0 con 0x7f03000cc6c0 2023-12-19T16:17:26.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0300159250 con 0x7f03000cc6c0 2023-12-19T16:17:26.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.656+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030004e850 con 0x7f03000cc6c0 2023-12-19T16:17:26.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.660+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f02f8007070 con 0x7f03000cc6c0 2023-12-19T16:17:26.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.660+0000 7f02f6ffd640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f02e4065a60 0x7f02e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.660+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f02f8083440 con 0x7f03000cc6c0 2023-12-19T16:17:26.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.660+0000 7f030652b640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f02e4065a60 0x7f02e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.660+0000 7f030652b640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f02e4065a60 0x7f02e4067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02fc000f70 tx=0x7f02fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.664+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f02f8050b20 con 0x7f03000cc6c0 2023-12-19T16:17:26.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03001616a0 con 0x7f03000cc6c0 2023-12-19T16:17:26.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f02f6ffd640 1 -- 172.21.15.119:0/2178799809 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7f02f8054140 con 0x7f03000cc6c0 2023-12-19T16:17:26.819 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f02e4065a60 msgr2=0x7f02e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f02e4065a60 0x7f02e4067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02fc000f70 tx=0x7f02fc009040 comp rx=0 tx=0).stop 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 msgr2=0x7f03001f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 0x7f03001f52e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f02f800caa0 tx=0x7f02f800cf60 comp rx=0 tx=0).stop 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 shutdown_connections 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f02e4065a60 0x7f02e4067f20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03000afd10 0x7f03000b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000cc6c0 0x7f03001f52e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 --2- 172.21.15.119:0/2178799809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f030006fb60 0x7f0300158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 >> 172.21.15.119:0/2178799809 conn(0x7f03000ce130 msgr2=0x7f0300141880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 shutdown_connections 2023-12-19T16:17:26.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.816+0000 7f030752d640 1 -- 172.21.15.119:0/2178799809 wait complete. 2023-12-19T16:17:26.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:26.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.976+0000 7fb70c339640 1 Processor -- start 2023-12-19T16:17:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.976+0000 7fb70c339640 1 -- start start 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb70c339640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb704070820 0x7fb7040c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb70c339640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb7040ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb70c339640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7040c9390 con 0x7fb7041582d0 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb70c339640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7040ced80 con 0x7fb704070820 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb70c339640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70415aee0 con 0x7fb7040ce3b0 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb704070820 0x7fb7040c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb704070820 0x7fb7040c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48590/0 (socket says 172.21.15.119:48590) 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 -- 172.21.15.119:0/4165275694 learned_addr learned my addr 172.21.15.119:0/4165275694 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb70a8d6640 1 --2- 172.21.15.119:0/4165275694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb7040ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 -- 172.21.15.119:0/4165275694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 msgr2=0x7fb7040ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 --2- 172.21.15.119:0/4165275694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb7040ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 -- 172.21.15.119:0/4165275694 >> v1:172.21.15.119:6789/0 conn(0x7fb7041582d0 legacy=0x7fb7040ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7098d4640 1 -- 172.21.15.119:0/4165275694 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70415b1c0 con 0x7fb704070820 2023-12-19T16:17:26.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.980+0000 7fb7090d3640 1 -- 172.21.15.119:0/4165275694 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71771610 0 0) 0x7fb7040c9390 con 0x7fb7041582d0 2023-12-19T16:17:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb7098d4640 1 --2- 172.21.15.119:0/4165275694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb704070820 0x7fb7040c8e50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009870 tx=0x7fb6f401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0703f8ed0fafc73 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb7090d3640 1 -- 172.21.15.119:0/4165275694 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40aa670 con 0x7fb704070820 2023-12-19T16:17:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb7090d3640 1 -- 172.21.15.119:0/4165275694 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f40aa7d0 con 0x7fb704070820 2023-12-19T16:17:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb7090d3640 1 -- 172.21.15.119:0/4165275694 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40aab60 con 0x7fb704070820 2023-12-19T16:17:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 -- 172.21.15.119:0/4165275694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb704070820 msgr2=0x7fb7040c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 --2- 172.21.15.119:0/4165275694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb704070820 0x7fb7040c8e50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009870 tx=0x7fb6f401c510 comp rx=0 tx=0).stop 2023-12-19T16:17:26.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 -- 172.21.15.119:0/4165275694 shutdown_connections 2023-12-19T16:17:26.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 --2- 172.21.15.119:0/4165275694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb7040ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 --2- 172.21.15.119:0/4165275694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb704070820 0x7fb7040c8e50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 -- 172.21.15.119:0/4165275694 >> 172.21.15.119:0/4165275694 conn(0x7fb70406a2a0 msgr2=0x7fb7040aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 -- 172.21.15.119:0/4165275694 shutdown_connections 2023-12-19T16:17:26.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 -- 172.21.15.119:0/4165275694 wait complete. 2023-12-19T16:17:26.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 Processor -- start 2023-12-19T16:17:26.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.984+0000 7fb70c339640 1 -- start start 2023-12-19T16:17:26.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb704070820 0x7fb704157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb704149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 0x7fb704164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70414adb0 con 0x7fb7041582d0 2023-12-19T16:17:26.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70414a360 con 0x7fb704070820 2023-12-19T16:17:26.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041568c0 con 0x7fb7040ce3b0 2023-12-19T16:17:26.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 0x7fb704164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 0x7fb704164830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48596/0 (socket says 172.21.15.119:48596) 2023-12-19T16:17:26.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 -- 172.21.15.119:0/3915002820 learned_addr learned my addr 172.21.15.119:0/3915002820 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:26.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a0d5640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb704070820 0x7fb704157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb7098d4640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb704149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 -- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 msgr2=0x7fb704149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb704149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 -- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb704070820 msgr2=0x7fb704157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb704070820 0x7fb704157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 -- 172.21.15.119:0/3915002820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40094d0 con 0x7fb7041582d0 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb7098d4640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb704149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70a8d6640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 0x7fb704164830 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00efc0 tx=0x7fb6fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc014480 con 0x7fb7041582d0 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00f040 con 0x7fb7041582d0 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb704156ba0 con 0x7fb7041582d0 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc014820 con 0x7fb7041582d0 2023-12-19T16:17:26.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb704157160 con 0x7fb7041582d0 2023-12-19T16:17:26.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.988+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb704157ea0 con 0x7fb7041582d0 2023-12-19T16:17:26.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.992+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6fc014980 con 0x7fb7041582d0 2023-12-19T16:17:26.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.992+0000 7fb6faffd640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb6e8065a60 0x7fb6e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.992+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb6fc083e60 con 0x7fb7041582d0 2023-12-19T16:17:26.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.992+0000 7fb70a0d5640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb6e8065a60 0x7fb6e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.992+0000 7fb70a0d5640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb6e8065a60 0x7fb6e8067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb700007fd0 tx=0x7fb700009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:26.996+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb6fc051600 con 0x7fb7041582d0 2023-12-19T16:17:27.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.144+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7040ce050 con 0x7fb7041582d0 2023-12-19T16:17:27.148 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.144+0000 7fb6faffd640 1 -- 172.21.15.119:0/3915002820 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6fc0180a0 con 0x7fb7041582d0 2023-12-19T16:17:27.148 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:27.150 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb6e8065a60 msgr2=0x7fb6e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.150 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb6e8065a60 0x7fb6e8067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb700007fd0 tx=0x7fb700009040 comp rx=0 tx=0).stop 2023-12-19T16:17:27.150 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 msgr2=0x7fb704164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.150 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 0x7fb704164830 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00efc0 tx=0x7fb6fc00c490 comp rx=0 tx=0).stop 2023-12-19T16:17:27.150 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 shutdown_connections 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb6e8065a60 0x7fb6e8067f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7041582d0 0x7fb704164830 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7040ce3b0 0x7fb704149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 --2- 172.21.15.119:0/3915002820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb704070820 0x7fb704157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 >> 172.21.15.119:0/3915002820 conn(0x7fb70406a2a0 msgr2=0x7fb704154180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 shutdown_connections 2023-12-19T16:17:27.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.148+0000 7fb70c339640 1 -- 172.21.15.119:0/3915002820 wait complete. 2023-12-19T16:17:27.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:27.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.304+0000 7f023e066640 1 Processor -- start 2023-12-19T16:17:27.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f023e066640 1 -- start start 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f023e066640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02381598d0 0x7f02380ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f023e066640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f02380ce8d0 0x7f0238070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f023e066640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380c9730 con 0x7f0238153020 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f023e066640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380ced60 con 0x7f02380ce8d0 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f023e066640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c8e00 con 0x7f02381598d0 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f02377fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0238153020 0x7f02380c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35892/0 (socket says 172.21.15.119:35892) 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f02377fe640 1 -- 172.21.15.119:0/361746192 learned_addr learned my addr 172.21.15.119:0/361746192 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f0237fff640 1 --2- 172.21.15.119:0/361746192 >> v2:172.21.15.119:3300/0 conn(0x7f02380ce8d0 0x7f0238070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f022ffff640 1 --2- 172.21.15.119:0/361746192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02381598d0 0x7f02380ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f0237fff640 1 -- 172.21.15.119:0/361746192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02381598d0 msgr2=0x7f02380ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:27.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f0237fff640 1 --2- 172.21.15.119:0/361746192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02381598d0 0x7f02380ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f0237fff640 1 -- 172.21.15.119:0/361746192 >> v1:172.21.15.119:6789/0 conn(0x7f0238153020 legacy=0x7f02380c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.308+0000 7f0237fff640 1 -- 172.21.15.119:0/361746192 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380c90e0 con 0x7f02380ce8d0 2023-12-19T16:17:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f0237fff640 1 --2- 172.21.15.119:0/361746192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02380ce8d0 0x7f0238070590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f023000be30 tx=0x7f023001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91afa95780711ac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f0236ffd640 1 -- 172.21.15.119:0/361746192 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023000b2d0 con 0x7f02380ce8d0 2023-12-19T16:17:27.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f0236ffd640 1 -- 172.21.15.119:0/361746192 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300a5750 con 0x7f02380ce8d0 2023-12-19T16:17:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f0236ffd640 1 -- 172.21.15.119:0/361746192 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300a5b00 con 0x7f02380ce8d0 2023-12-19T16:17:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 -- 172.21.15.119:0/361746192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02380ce8d0 msgr2=0x7f0238070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 --2- 172.21.15.119:0/361746192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02380ce8d0 0x7f0238070590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f023000be30 tx=0x7f023001c870 comp rx=0 tx=0).stop 2023-12-19T16:17:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 -- 172.21.15.119:0/361746192 shutdown_connections 2023-12-19T16:17:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 --2- 172.21.15.119:0/361746192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02380ce8d0 0x7f0238070590 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 --2- 172.21.15.119:0/361746192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02381598d0 0x7f02380ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 -- 172.21.15.119:0/361746192 >> 172.21.15.119:0/361746192 conn(0x7f023806a2a0 msgr2=0x7f02380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 -- 172.21.15.119:0/361746192 shutdown_connections 2023-12-19T16:17:27.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.312+0000 7f023e066640 1 -- 172.21.15.119:0/361746192 wait complete. 2023-12-19T16:17:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 Processor -- start 2023-12-19T16:17:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- start start 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02380ce8d0 0x7f02380b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0238153020 0x7f023815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 0x7f023815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c2c00 con 0x7f02381598d0 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c3090 con 0x7f0238153020 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c1ff0 con 0x7f02380ce8d0 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 0x7f023815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 0x7f023815b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48614/0 (socket says 172.21.15.119:48614) 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 -- 172.21.15.119:0/1205397647 learned_addr learned my addr 172.21.15.119:0/1205397647 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f022ffff640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0238153020 0x7f023815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f02377fe640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02380ce8d0 0x7f02380b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 -- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02380ce8d0 msgr2=0x7f02380b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02380ce8d0 0x7f02380b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 -- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0238153020 msgr2=0x7f023815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0238153020 0x7f023815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 -- 172.21.15.119:0/1205397647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023000ba90 con 0x7f02381598d0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0237fff640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 0x7f023815b990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f023001a4a0 tx=0x7f02300092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300a5ac0 con 0x7f02381598d0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300a5c20 con 0x7f02381598d0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230003e30 con 0x7f02381598d0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380c22d0 con 0x7f02381598d0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02380c2890 con 0x7f02381598d0 2023-12-19T16:17:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.316+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02380c3200 con 0x7f02381598d0 2023-12-19T16:17:27.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.320+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0230004040 con 0x7f02381598d0 2023-12-19T16:17:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.320+0000 7f0234ff9640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.320+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f023011e4e0 con 0x7f02381598d0 2023-12-19T16:17:27.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.320+0000 7f02377fe640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.320+0000 7f02377fe640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0228005890 tx=0x7f0228009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.324+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f02300ebda0 con 0x7f02381598d0 2023-12-19T16:17:27.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.476+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02380c3200 con 0x7f02381598d0 2023-12-19T16:17:27.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.476+0000 7f0234ff9640 1 -- 172.21.15.119:0/1205397647 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02300ef3c0 con 0x7f02381598d0 2023-12-19T16:17:27.483 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 msgr2=0x7f0218067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0228005890 tx=0x7f0228009040 comp rx=0 tx=0).stop 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 msgr2=0x7f023815b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 0x7f023815b990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f023001a4a0 tx=0x7f02300092f0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 shutdown_connections 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0238153020 0x7f023815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02381598d0 0x7f023815b990 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 --2- 172.21.15.119:0/1205397647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02380ce8d0 0x7f02380b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 >> 172.21.15.119:0/1205397647 conn(0x7f023806a2a0 msgr2=0x7f0238070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 shutdown_connections 2023-12-19T16:17:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.480+0000 7f023e066640 1 -- 172.21.15.119:0/1205397647 wait complete. 2023-12-19T16:17:27.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:27.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 Processor -- start 2023-12-19T16:17:27.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 -- start start 2023-12-19T16:17:27.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f44640cbff0 0x7f44640cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4464070df0 con 0x7f4464159fb0 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446415aab0 con 0x7f44640cbff0 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4468f52640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640cc980 con 0x7f44640ca410 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4459d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4464159fb0 0x7f4464071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35902/0 (socket says 172.21.15.119:35902) 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4459d9b640 1 -- 172.21.15.119:0/648491915 learned_addr learned my addr 172.21.15.119:0/648491915 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f446259c640 1 --2- 172.21.15.119:0/648491915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4462d9d640 1 --2- 172.21.15.119:0/648491915 >> v2:172.21.15.143:3300/0 conn(0x7f44640cbff0 0x7f44640cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4461d9b640 1 -- 172.21.15.119:0/648491915 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773009729 0 0) 0x7f4464070df0 con 0x7f4464159fb0 2023-12-19T16:17:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4461d9b640 1 -- 172.21.15.119:0/648491915 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4450003530 con 0x7f4464159fb0 2023-12-19T16:17:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f446259c640 1 -- 172.21.15.119:0/648491915 >> v2:172.21.15.143:3300/0 conn(0x7f44640cbff0 msgr2=0x7f44640cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f446259c640 1 --2- 172.21.15.119:0/648491915 >> v2:172.21.15.143:3300/0 conn(0x7f44640cbff0 0x7f44640cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f4461d9b640 1 -- 172.21.15.119:0/648491915 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770816384 0 0) 0x7f4450003530 con 0x7f4464159fb0 2023-12-19T16:17:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f446259c640 1 -- 172.21.15.119:0/648491915 >> v1:172.21.15.119:6789/0 conn(0x7f4464159fb0 legacy=0x7f4464071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.640+0000 7f446259c640 1 -- 172.21.15.119:0/648491915 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446415a4f0 con 0x7f44640ca410 2023-12-19T16:17:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f446259c640 1 --2- 172.21.15.119:0/648491915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464159a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44540097c0 tx=0x7f445401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ef324a67e1f865 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4461d9b640 1 -- 172.21.15.119:0/648491915 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44540ab650 con 0x7f44640ca410 2023-12-19T16:17:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4461d9b640 1 -- 172.21.15.119:0/648491915 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44540ab7b0 con 0x7f44640ca410 2023-12-19T16:17:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4461d9b640 1 -- 172.21.15.119:0/648491915 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44540abb40 con 0x7f44640ca410 2023-12-19T16:17:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 -- 172.21.15.119:0/648491915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 msgr2=0x7f4464159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 --2- 172.21.15.119:0/648491915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464159a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44540097c0 tx=0x7f445401c450 comp rx=0 tx=0).stop 2023-12-19T16:17:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 -- 172.21.15.119:0/648491915 shutdown_connections 2023-12-19T16:17:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 --2- 172.21.15.119:0/648491915 >> v2:172.21.15.143:3300/0 conn(0x7f44640cbff0 0x7f44640cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 --2- 172.21.15.119:0/648491915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464159a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 -- 172.21.15.119:0/648491915 >> 172.21.15.119:0/648491915 conn(0x7f446406a2a0 msgr2=0x7f44640aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 -- 172.21.15.119:0/648491915 shutdown_connections 2023-12-19T16:17:27.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.644+0000 7f4468f52640 1 -- 172.21.15.119:0/648491915 wait complete. 2023-12-19T16:17:27.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 Processor -- start 2023-12-19T16:17:27.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 -- start start 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 0x7f44640adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4464159fb0 0x7f44640c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c5890 con 0x7f44640cbff0 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c7280 con 0x7f4464159fb0 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c7560 con 0x7f44640ca410 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 0x7f44640adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 0x7f44640adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48630/0 (socket says 172.21.15.119:48630) 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 -- 172.21.15.119:0/1853790483 learned_addr learned my addr 172.21.15.119:0/1853790483 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:27.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f446259c640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4462d9d640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4464159fb0 0x7f44640c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 -- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 msgr2=0x7f4464144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 -- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4464159fb0 msgr2=0x7f44640c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4464159fb0 0x7f44640c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 -- 172.21.15.119:0/1853790483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454009420 con 0x7f44640cbff0 2023-12-19T16:17:27.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4459d9b640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 0x7f44640adad0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c780 tx=0x7f444c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c005ac0 con 0x7f44640cbff0 2023-12-19T16:17:27.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c005c20 con 0x7f44640cbff0 2023-12-19T16:17:27.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c007070 con 0x7f44640cbff0 2023-12-19T16:17:27.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44640c7840 con 0x7f44640cbff0 2023-12-19T16:17:27.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.648+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44641f5540 con 0x7f44640cbff0 2023-12-19T16:17:27.654 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.652+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446404e000 con 0x7f44640cbff0 2023-12-19T16:17:27.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.652+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f444c0071f0 con 0x7f44640cbff0 2023-12-19T16:17:27.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.652+0000 7f445b7fe640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4444065a60 0x7f4444067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.652+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f444c082f50 con 0x7f44640cbff0 2023-12-19T16:17:27.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.652+0000 7f446259c640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4444065a60 0x7f4444067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.652+0000 7f446259c640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4444065a60 0x7f4444067f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f44540af000 tx=0x7f44540a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.656+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f444c0506e0 con 0x7f44640cbff0 2023-12-19T16:17:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4464156a70 con 0x7f44640cbff0 2023-12-19T16:17:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f445b7fe640 1 -- 172.21.15.119:0/1853790483 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f444c058e60 con 0x7f44640cbff0 2023-12-19T16:17:27.810 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4444065a60 msgr2=0x7f4444067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4444065a60 0x7f4444067f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f44540af000 tx=0x7f44540a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 msgr2=0x7f44640adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 0x7f44640adad0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c780 tx=0x7f444c00cc40 comp rx=0 tx=0).stop 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 shutdown_connections 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4444065a60 0x7f4444067f20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4464159fb0 0x7f44640c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44640cbff0 0x7f44640adad0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 --2- 172.21.15.119:0/1853790483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44640ca410 0x7f4464144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 >> 172.21.15.119:0/1853790483 conn(0x7f446406a2a0 msgr2=0x7f44640abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 shutdown_connections 2023-12-19T16:17:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.808+0000 7f4468f52640 1 -- 172.21.15.119:0/1853790483 wait complete. 2023-12-19T16:17:27.832 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:27.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.968+0000 7f3af9c2d640 1 Processor -- start 2023-12-19T16:17:27.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.968+0000 7f3af9c2d640 1 -- start start 2023-12-19T16:17:27.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.968+0000 7f3af9c2d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3af40c92b0 0x7f3af4160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.968+0000 7f3af9c2d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3af40ceac0 0x7f3af4142020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.968+0000 7f3af9c2d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af4142cd0 con 0x7f3af40c9690 2023-12-19T16:17:27.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af9c2d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af4142fb0 con 0x7f3af40c92b0 2023-12-19T16:17:27.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af9c2d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af41604c0 con 0x7f3af40ceac0 2023-12-19T16:17:27.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af37fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3af40c92b0 0x7f3af4160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af2ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3af40c9690 0x7f3af40ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35904/0 (socket says 172.21.15.119:35904) 2023-12-19T16:17:27.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af2ffd640 1 -- 172.21.15.119:0/221655498 learned_addr learned my addr 172.21.15.119:0/221655498 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:27.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af3fff640 1 --2- 172.21.15.119:0/221655498 >> v2:172.21.15.143:3300/0 conn(0x7f3af40ceac0 0x7f3af4142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af37fe640 1 -- 172.21.15.119:0/221655498 >> v2:172.21.15.143:3300/0 conn(0x7f3af40ceac0 msgr2=0x7f3af4142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:27.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af37fe640 1 --2- 172.21.15.119:0/221655498 >> v2:172.21.15.143:3300/0 conn(0x7f3af40ceac0 0x7f3af4142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af37fe640 1 -- 172.21.15.119:0/221655498 >> v1:172.21.15.119:6789/0 conn(0x7f3af40c9690 legacy=0x7f3af40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af37fe640 1 -- 172.21.15.119:0/221655498 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af41607a0 con 0x7f3af40c92b0 2023-12-19T16:17:27.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af3fff640 1 --2- 172.21.15.119:0/221655498 >> v2:172.21.15.143:3300/0 conn(0x7f3af40ceac0 0x7f3af4142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:27.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af27fc640 1 -- 172.21.15.119:0/221655498 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438457352 0 0) 0x7f3af4142cd0 con 0x7f3af40c9690 2023-12-19T16:17:27.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af37fe640 1 --2- 172.21.15.119:0/221655498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4160fa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3af40adeb0 tx=0x7f3ae401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43f588a24a18fae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af27fc640 1 -- 172.21.15.119:0/221655498 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40ab5f0 con 0x7f3af40c92b0 2023-12-19T16:17:27.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af27fc640 1 -- 172.21.15.119:0/221655498 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40ab750 con 0x7f3af40c92b0 2023-12-19T16:17:27.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.972+0000 7f3af27fc640 1 -- 172.21.15.119:0/221655498 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40abae0 con 0x7f3af40c92b0 2023-12-19T16:17:27.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- 172.21.15.119:0/221655498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 msgr2=0x7f3af4160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/221655498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4160fa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3af40adeb0 tx=0x7f3ae401c3d0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- 172.21.15.119:0/221655498 shutdown_connections 2023-12-19T16:17:27.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/221655498 >> v2:172.21.15.143:3300/0 conn(0x7f3af40ceac0 0x7f3af4142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/221655498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4160fa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- 172.21.15.119:0/221655498 >> 172.21.15.119:0/221655498 conn(0x7f3af406a2a0 msgr2=0x7f3af40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- 172.21.15.119:0/221655498 shutdown_connections 2023-12-19T16:17:27.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- 172.21.15.119:0/221655498 wait complete. 2023-12-19T16:17:27.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 Processor -- start 2023-12-19T16:17:27.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- start start 2023-12-19T16:17:27.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3af40c9690 0x7f3af40c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3af40ceac0 0x7f3af40ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40ad7f0 con 0x7f3af40c92b0 2023-12-19T16:17:27.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af415da40 con 0x7f3af40c9690 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af9c2d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40abc70 con 0x7f3af40ceac0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48650/0 (socket says 172.21.15.119:48650) 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 -- 172.21.15.119:0/3015316233 learned_addr learned my addr 172.21.15.119:0/3015316233 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af2ffd640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3af40c9690 0x7f3af40c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af3fff640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3af40ceac0 0x7f3af40ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 -- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3af40ceac0 msgr2=0x7f3af40ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3af40ceac0 0x7f3af40ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 -- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3af40c9690 msgr2=0x7f3af40c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.976+0000 7f3af37fe640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3af40c9690 0x7f3af40c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af37fe640 1 -- 172.21.15.119:0/3015316233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009420 con 0x7f3af40c92b0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af3fff640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3af40ceac0 0x7f3af40ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af37fe640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4156640 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ad040 tx=0x7f3ae401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40bf610 con 0x7f3af40c92b0 2023-12-19T16:17:27.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40bf790 con 0x7f3af40c92b0 2023-12-19T16:17:27.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af40abf50 con 0x7f3af40c92b0 2023-12-19T16:17:27.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40bfb40 con 0x7f3af40c92b0 2023-12-19T16:17:27.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af415dd20 con 0x7f3af40c92b0 2023-12-19T16:17:27.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af40cdd70 con 0x7f3af40c92b0 2023-12-19T16:17:27.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ae40b5400 con 0x7f3af40c92b0 2023-12-19T16:17:27.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3adbfff640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ae0065a60 0x7f3ae0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3ae40a8050 con 0x7f3af40c92b0 2023-12-19T16:17:27.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.980+0000 7f3af2ffd640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ae0065a60 0x7f3ae0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.984+0000 7f3af2ffd640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ae0065a60 0x7f3ae0067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3af40c4f70 tx=0x7f3ae8007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:27.984+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ae40ebaf0 con 0x7f3af40c92b0 2023-12-19T16:17:28.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.132+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f3af4145c70 con 0x7f3af40c92b0 2023-12-19T16:17:28.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3adbfff640 1 -- 172.21.15.119:0/3015316233 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7f3ae40ef110 con 0x7f3af40c92b0 2023-12-19T16:17:28.138 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ae0065a60 msgr2=0x7f3ae0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ae0065a60 0x7f3ae0067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3af40c4f70 tx=0x7f3ae8007d60 comp rx=0 tx=0).stop 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 msgr2=0x7f3af4156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4156640 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ad040 tx=0x7f3ae401ac10 comp rx=0 tx=0).stop 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 shutdown_connections 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ae0065a60 0x7f3ae0067f20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3af40c9690 0x7f3af40c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3af40ceac0 0x7f3af40ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 --2- 172.21.15.119:0/3015316233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af40c92b0 0x7f3af4156640 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 >> 172.21.15.119:0/3015316233 conn(0x7f3af406a2a0 msgr2=0x7f3af40cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 shutdown_connections 2023-12-19T16:17:28.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.136+0000 7f3af9c2d640 1 -- 172.21.15.119:0/3015316233 wait complete. 2023-12-19T16:17:28.159 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:28.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa8fc0640 1 Processor -- start 2023-12-19T16:17:28.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa8fc0640 1 -- start start 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa8fc0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feaa4070d50 0x7feaa40c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa8fc0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40711a0 con 0x7feaa406bde0 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa8fc0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40c8ab0 con 0x7feaa4071d40 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa8fc0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa4159b20 con 0x7feaa4070d50 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa259c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7feaa406bde0 0x7feaa40c1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35908/0 (socket says 172.21.15.119:35908) 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa259c640 1 -- 172.21.15.119:0/1726171751 learned_addr learned my addr 172.21.15.119:0/1726171751 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa2d9d640 1 --2- 172.21.15.119:0/1726171751 >> v2:172.21.15.119:3300/0 conn(0x7feaa4070d50 0x7feaa40c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa159a640 1 -- 172.21.15.119:0/1726171751 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292701619 0 0) 0x7feaa40711a0 con 0x7feaa406bde0 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa159a640 1 -- 172.21.15.119:0/1726171751 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea8c003530 con 0x7feaa406bde0 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa2d9d640 1 -- 172.21.15.119:0/1726171751 >> v1:172.21.15.143:6789/0 conn(0x7feaa4071d40 legacy=0x7feaa406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa2d9d640 1 -- 172.21.15.119:0/1726171751 >> v1:172.21.15.119:6789/0 conn(0x7feaa406bde0 legacy=0x7feaa40c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.296+0000 7feaa2d9d640 1 -- 172.21.15.119:0/1726171751 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40c8d90 con 0x7feaa4070d50 2023-12-19T16:17:28.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa2d9d640 1 --2- 172.21.15.119:0/1726171751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa40c9b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009dc0 tx=0x7fea9c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc415ea45e619fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:28.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa159a640 1 -- 172.21.15.119:0/1726171751 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0a57f0 con 0x7feaa4070d50 2023-12-19T16:17:28.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa159a640 1 -- 172.21.15.119:0/1726171751 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c0a5950 con 0x7feaa4070d50 2023-12-19T16:17:28.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa159a640 1 -- 172.21.15.119:0/1726171751 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0a5ce0 con 0x7feaa4070d50 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 -- 172.21.15.119:0/1726171751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 msgr2=0x7feaa40c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/1726171751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa40c9b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009dc0 tx=0x7fea9c01c930 comp rx=0 tx=0).stop 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 -- 172.21.15.119:0/1726171751 shutdown_connections 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/1726171751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa40c9b50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 -- 172.21.15.119:0/1726171751 >> 172.21.15.119:0/1726171751 conn(0x7feaa406a2a0 msgr2=0x7feaa40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 -- 172.21.15.119:0/1726171751 shutdown_connections 2023-12-19T16:17:28.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.300+0000 7feaa8fc0640 1 -- 172.21.15.119:0/1726171751 wait complete. 2023-12-19T16:17:28.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 Processor -- start 2023-12-19T16:17:28.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- start start 2023-12-19T16:17:28.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa406bde0 0x7feaa415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:28.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa4154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:28.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa4071d40 0x7feaa40c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:28.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415c310 con 0x7feaa4070d50 2023-12-19T16:17:28.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415ba10 con 0x7feaa4071d40 2023-12-19T16:17:28.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415a1b0 con 0x7feaa406bde0 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa4154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa4154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48664/0 (socket says 172.21.15.119:48664) 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 -- 172.21.15.119:0/3220892954 learned_addr learned my addr 172.21.15.119:0/3220892954 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa259c640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa406bde0 0x7feaa415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa2d9d640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa4071d40 0x7feaa40c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 -- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa406bde0 msgr2=0x7feaa415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa406bde0 0x7feaa415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 -- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa4071d40 msgr2=0x7feaa40c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa4071d40 0x7feaa40c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 -- 172.21.15.119:0/3220892954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009a70 con 0x7feaa4070d50 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa2d9d640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa4071d40 0x7feaa40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa259c640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa406bde0 0x7feaa415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa1d9b640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa4154d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fea9800c3c0 tx=0x7fea9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:28.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980052d0 con 0x7feaa4070d50 2023-12-19T16:17:28.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98005430 con 0x7feaa4070d50 2023-12-19T16:17:28.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa415a490 con 0x7feaa4070d50 2023-12-19T16:17:28.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98003840 con 0x7feaa4070d50 2023-12-19T16:17:28.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa415aa50 con 0x7feaa4070d50 2023-12-19T16:17:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.304+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa404e000 con 0x7feaa4070d50 2023-12-19T16:17:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.308+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea980039a0 con 0x7feaa4070d50 2023-12-19T16:17:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.308+0000 7fea92ffd640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fea84065a60 0x7fea84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.308+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fea98082a40 con 0x7feaa4070d50 2023-12-19T16:17:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.308+0000 7feaa259c640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fea84065a60 0x7fea84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.308+0000 7feaa259c640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fea84065a60 0x7fea84067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fea940011f0 tx=0x7fea94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:28.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.312+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea98050090 con 0x7feaa4070d50 2023-12-19T16:17:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.472+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feaa40af410 con 0x7feaa4070d50 2023-12-19T16:17:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.472+0000 7fea92ffd640 1 -- 172.21.15.119:0/3220892954 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fea98017080 con 0x7feaa4070d50 2023-12-19T16:17:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:17:28.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fea84065a60 msgr2=0x7fea84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fea84065a60 0x7fea84067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fea940011f0 tx=0x7fea94009040 comp rx=0 tx=0).stop 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 msgr2=0x7feaa4154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa4154d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fea9800c3c0 tx=0x7fea9800c880 comp rx=0 tx=0).stop 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 shutdown_connections 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fea84065a60 0x7fea84067f20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa4071d40 0x7feaa40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa4070d50 0x7feaa4154d90 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 --2- 172.21.15.119:0/3220892954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa406bde0 0x7feaa415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 >> 172.21.15.119:0/3220892954 conn(0x7feaa406a2a0 msgr2=0x7feaa40b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 shutdown_connections 2023-12-19T16:17:28.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:28.476+0000 7feaa8fc0640 1 -- 172.21.15.119:0/3220892954 wait complete. 2023-12-19T16:17:28.499 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:17:28.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:28.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:28.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[50727]: fuse finished with error 0 and tester_r 0 2023-12-19T16:17:28.520 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:34.621 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:17:34.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:34.621 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:17:34.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-12-19T16:17:34.827 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 Processor -- start 2023-12-19T16:17:34.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 -- start start 2023-12-19T16:17:34.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15e4f0 0x7ff51c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:34.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff51c15b530 0x7ff51c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:34.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c155410 con 0x7ff51c0702d0 2023-12-19T16:17:34.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c070bf0 con 0x7ff51c15b530 2023-12-19T16:17:34.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff523266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c15ea60 con 0x7ff51c15e4f0 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.824+0000 7ff521803640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff51c15b530 0x7ff51c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff51c15b530 0x7ff51c15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46644/0 (socket says 172.21.15.119:46644) 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 -- 172.21.15.119:0/827706343 learned_addr learned my addr 172.21.15.119:0/827706343 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff520801640 1 --2- 172.21.15.119:0/827706343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15e4f0 0x7ff51c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 -- 172.21.15.119:0/827706343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15e4f0 msgr2=0x7ff51c0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 --2- 172.21.15.119:0/827706343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15e4f0 0x7ff51c0706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 -- 172.21.15.119:0/827706343 >> v1:172.21.15.143:6789/0 conn(0x7ff51c0702d0 legacy=0x7ff51c0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 -- 172.21.15.119:0/827706343 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c15ed40 con 0x7ff51c15b530 2023-12-19T16:17:34.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff513fff640 1 -- 172.21.15.119:0/827706343 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437816837 0 0) 0x7ff51c155410 con 0x7ff51c0702d0 2023-12-19T16:17:34.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff521803640 1 --2- 172.21.15.119:0/827706343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15b530 0x7ff51c15b9c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff514009e50 tx=0x7ff51401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610a8ee6742eac44 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:34.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff513fff640 1 -- 172.21.15.119:0/827706343 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140a58a0 con 0x7ff51c15b530 2023-12-19T16:17:34.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff513fff640 1 -- 172.21.15.119:0/827706343 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5140a5a00 con 0x7ff51c15b530 2023-12-19T16:17:34.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.828+0000 7ff513fff640 1 -- 172.21.15.119:0/827706343 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140a5d90 con 0x7ff51c15b530 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- 172.21.15.119:0/827706343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15b530 msgr2=0x7ff51c15b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 --2- 172.21.15.119:0/827706343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15b530 0x7ff51c15b9c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff514009e50 tx=0x7ff51401c9e0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- 172.21.15.119:0/827706343 shutdown_connections 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 --2- 172.21.15.119:0/827706343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15b530 0x7ff51c15b9c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 --2- 172.21.15.119:0/827706343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15e4f0 0x7ff51c0706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- 172.21.15.119:0/827706343 >> 172.21.15.119:0/827706343 conn(0x7ff51c0ce450 msgr2=0x7ff51c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- 172.21.15.119:0/827706343 shutdown_connections 2023-12-19T16:17:34.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- 172.21.15.119:0/827706343 wait complete. 2023-12-19T16:17:34.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 Processor -- start 2023-12-19T16:17:34.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- start start 2023-12-19T16:17:34.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff51c0702d0 0x7ff51c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:34.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15b530 0x7ff51c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 0x7ff51c1f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1f52b0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1f4fa0 con 0x7ff51c0702d0 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff523266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0caab0 con 0x7ff51c15b530 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff521803640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 0x7ff51c1f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff521803640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 0x7ff51c1f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46656/0 (socket says 172.21.15.119:46656) 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff521803640 1 -- 172.21.15.119:0/1446822315 learned_addr learned my addr 172.21.15.119:0/1446822315 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff520801640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15b530 0x7ff51c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.832+0000 7ff521002640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff51c0702d0 0x7ff51c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff521803640 1 -- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15b530 msgr2=0x7ff51c1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff521803640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15b530 0x7ff51c1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff521803640 1 -- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff51c0702d0 msgr2=0x7ff51c0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:34.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff521803640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff51c0702d0 0x7ff51c0b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff521803640 1 -- 172.21.15.119:0/1446822315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009b30 con 0x7ff51c15e4f0 2023-12-19T16:17:34.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff521803640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 0x7ff51c1f56d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff5140af040 tx=0x7ff514019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:34.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140b8670 con 0x7ff51c15e4f0 2023-12-19T16:17:34.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5140b87d0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c0b15b0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140b8b60 con 0x7ff51c15e4f0 2023-12-19T16:17:34.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c0ca4f0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c1f53f0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff5140b8cc0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff511ffb640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff500065a60 0x7ff500067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:34.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.836+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ff51411e9e0 con 0x7ff51c15e4f0 2023-12-19T16:17:34.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.840+0000 7ff521002640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff500065a60 0x7ff500067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:34.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.840+0000 7ff521002640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff500065a60 0x7ff500067f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff518007fd0 tx=0x7ff518009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:34.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:34.844+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff51c1f53f0 con 0x7ff51c15e4f0 2023-12-19T16:17:35.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.044+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff51c1f53f0 con 0x7ff51c15e4f0 2023-12-19T16:17:35.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff511ffb640 1 -- 172.21.15.119:0/1446822315 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff51c1f53f0 con 0x7ff51c15e4f0 2023-12-19T16:17:35.051 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:17:35.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff500065a60 msgr2=0x7ff500067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff500065a60 0x7ff500067f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff518007fd0 tx=0x7ff518009040 comp rx=0 tx=0).stop 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 msgr2=0x7ff51c1f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 0x7ff51c1f56d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff5140af040 tx=0x7ff514019780 comp rx=0 tx=0).stop 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 shutdown_connections 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff500065a60 0x7ff500067f20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff51c15e4f0 0x7ff51c1f56d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff51c15b530 0x7ff51c1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 --2- 172.21.15.119:0/1446822315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff51c0702d0 0x7ff51c0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.048+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 >> 172.21.15.119:0/1446822315 conn(0x7ff51c0ce450 msgr2=0x7ff51c15bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.052+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 shutdown_connections 2023-12-19T16:17:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.052+0000 7ff523266640 1 -- 172.21.15.119:0/1446822315 wait complete. 2023-12-19T16:17:35.073 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:17:35.073 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:35.144 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:35.249 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:17:35.249 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:35.249 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:35.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:35.259 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:17:35.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:35.259 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:17:35.309 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-19T16:17:35.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:35.310 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:17:35.310 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:35.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:35.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:17:35.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:35.320 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T16:17:35.371 INFO:teuthology.orchestra.run.smithi143.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T16:17:35.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:35.372 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:35.372 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:35.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:35.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:17:35.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:35.382 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T16:17:35.433 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T16:17:35.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:35.434 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:17:35.434 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:35.443 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:35.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:17:35.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:35.443 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T16:17:35.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:35.496 INFO:teuthology.orchestra.run.smithi143.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T16:17:35.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:35.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 Processor -- start 2023-12-19T16:17:35.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 -- start start 2023-12-19T16:17:35.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe4440cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 0x7fe4440cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440cfa70 con 0x7fe4440cf610 2023-12-19T16:17:35.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440d11c0 con 0x7fe4440ce3f0 2023-12-19T16:17:35.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44b98f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440d0310 con 0x7fe44415ca40 2023-12-19T16:17:35.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe448f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 0x7fe4440cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44972b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe4440cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe448f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 0x7fe4440cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:60562/0 (socket says 172.21.15.119:60562) 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44972b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe4440cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:54504/0 (socket says 172.21.15.119:54504) 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe448f2a640 1 -- 172.21.15.119:0/2733249244 learned_addr learned my addr 172.21.15.119:0/2733249244 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe449f2c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe4440cf610 0x7fe4441605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:57750/0 (socket says 172.21.15.119:57750) 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44972b640 1 -- 172.21.15.119:0/2733249244 >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 msgr2=0x7fe4440cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44972b640 1 --2- 172.21.15.119:0/2733249244 >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 0x7fe4440cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44972b640 1 -- 172.21.15.119:0/2733249244 >> v1:172.21.15.143:6789/0 conn(0x7fe4440cf610 legacy=0x7fe4441605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe44972b640 1 -- 172.21.15.119:0/2733249244 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440d05b0 con 0x7fe44415ca40 2023-12-19T16:17:35.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe43bfff640 1 -- 172.21.15.119:0/2733249244 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37323673 0 0) 0x7fe4440cfa70 con 0x7fe4440cf610 2023-12-19T16:17:35.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.632+0000 7fe448f2a640 1 --2- 172.21.15.119:0/2733249244 >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 0x7fe4440cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:35.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44972b640 1 --2- 172.21.15.119:0/2733249244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe4440cdeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe4400097a0 tx=0x7fe44001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c507c793ef63442 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe43bfff640 1 -- 172.21.15.119:0/2733249244 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400ad680 con 0x7fe44415ca40 2023-12-19T16:17:35.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe43bfff640 1 -- 172.21.15.119:0/2733249244 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4400ad7e0 con 0x7fe44415ca40 2023-12-19T16:17:35.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe43bfff640 1 -- 172.21.15.119:0/2733249244 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400adb70 con 0x7fe44415ca40 2023-12-19T16:17:35.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 -- 172.21.15.119:0/2733249244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 msgr2=0x7fe4440cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 --2- 172.21.15.119:0/2733249244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe4440cdeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe4400097a0 tx=0x7fe44001c460 comp rx=0 tx=0).stop 2023-12-19T16:17:35.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 -- 172.21.15.119:0/2733249244 shutdown_connections 2023-12-19T16:17:35.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 --2- 172.21.15.119:0/2733249244 >> v2:172.21.15.143:3300/0 conn(0x7fe4440ce3f0 0x7fe4440cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 --2- 172.21.15.119:0/2733249244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe4440cdeb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 -- 172.21.15.119:0/2733249244 >> 172.21.15.119:0/2733249244 conn(0x7fe444089fb0 msgr2=0x7fe4440d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:35.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.636+0000 7fe44b98f640 1 -- 172.21.15.119:0/2733249244 shutdown_connections 2023-12-19T16:17:35.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 -- 172.21.15.119:0/2733249244 wait complete. 2023-12-19T16:17:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 Processor -- start 2023-12-19T16:17:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 -- start start 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 0x7fe4440b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4440cf610 0x7fe4441586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe444158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415a4e0 con 0x7fe4440ce3f0 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415a7c0 con 0x7fe4440cf610 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415aaa0 con 0x7fe44415ca40 2023-12-19T16:17:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 0x7fe4440b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 0x7fe4440b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46668/0 (socket says 172.21.15.119:46668) 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 -- 172.21.15.119:0/1255606049 learned_addr learned my addr 172.21.15.119:0/1255606049 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 -- 172.21.15.119:0/1255606049 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 msgr2=0x7fe444158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe444158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 -- 172.21.15.119:0/1255606049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4440cf610 msgr2=0x7fe4441586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4440cf610 0x7fe4441586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 -- 172.21.15.119:0/1255606049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434009480 con 0x7fe4440ce3f0 2023-12-19T16:17:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44972b640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 0x7fe4440b0f10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe4400b0040 tx=0x7fe44001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400be070 con 0x7fe4440ce3f0 2023-12-19T16:17:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4400adb60 con 0x7fe4440ce3f0 2023-12-19T16:17:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400b8420 con 0x7fe4440ce3f0 2023-12-19T16:17:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.640+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4400093b0 con 0x7fe4440ce3f0 2023-12-19T16:17:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44415b060 con 0x7fe4440ce3f0 2023-12-19T16:17:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44415b250 con 0x7fe4440ce3f0 2023-12-19T16:17:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe4400b4040 con 0x7fe4440ce3f0 2023-12-19T16:17:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe439ffb640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe428065a60 0x7fe428067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fe44011ccb0 con 0x7fe4440ce3f0 2023-12-19T16:17:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe448f2a640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe428065a60 0x7fe428067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.644+0000 7fe448f2a640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe428065a60 0x7fe428067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe434006ef0 tx=0x7fe434006e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.648+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4400ea430 con 0x7fe4440ce3f0 2023-12-19T16:17:35.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.828+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe44404e000 con 0x7fe4440ce3f0 2023-12-19T16:17:35.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.828+0000 7fe439ffb640 1 -- 172.21.15.119:0/1255606049 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fe4400eda50 con 0x7fe4440ce3f0 2023-12-19T16:17:35.833 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:35.833 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:58.585749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:35.833 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe428065a60 msgr2=0x7fe428067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe428065a60 0x7fe428067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe434006ef0 tx=0x7fe434006e40 comp rx=0 tx=0).stop 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 msgr2=0x7fe4440b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 0x7fe4440b0f10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe4400b0040 tx=0x7fe44001aca0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 shutdown_connections 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe428065a60 0x7fe428067f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4440cf610 0x7fe4441586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe44415ca40 0x7fe444158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 --2- 172.21.15.119:0/1255606049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4440ce3f0 0x7fe4440b0f10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 >> 172.21.15.119:0/1255606049 conn(0x7fe444089fb0 msgr2=0x7fe44406be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:35.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 shutdown_connections 2023-12-19T16:17:35.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.832+0000 7fe44b98f640 1 -- 172.21.15.119:0/1255606049 wait complete. 2023-12-19T16:17:35.854 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:35.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.988+0000 7fb94d7ce640 1 Processor -- start 2023-12-19T16:17:35.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.988+0000 7fb94d7ce640 1 -- start start 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.988+0000 7fb94d7ce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb9481570c0 0x7fb94806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.988+0000 7fb94d7ce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb94806c320 0x7fb9480c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb94d7ce640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480c9460 con 0x7fb9480c9e30 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb94d7ce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94806c7a0 con 0x7fb9481570c0 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb94d7ce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9481574a0 con 0x7fb94806c320 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb9481570c0 0x7fb94806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb9481570c0 0x7fb94806bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46684/0 (socket says 172.21.15.119:46684) 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 -- 172.21.15.119:0/2584497638 learned_addr learned my addr 172.21.15.119:0/2584497638 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb93e7fc640 1 --2- 172.21.15.119:0/2584497638 >> v2:172.21.15.143:3300/0 conn(0x7fb94806c320 0x7fb9480c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 -- 172.21.15.119:0/2584497638 >> v2:172.21.15.143:3300/0 conn(0x7fb94806c320 msgr2=0x7fb9480c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:35.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 --2- 172.21.15.119:0/2584497638 >> v2:172.21.15.143:3300/0 conn(0x7fb94806c320 0x7fb9480c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 -- 172.21.15.119:0/2584497638 >> v1:172.21.15.143:6789/0 conn(0x7fb9480c9e30 legacy=0x7fb94815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:35.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 -- 172.21.15.119:0/2584497638 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480c8b30 con 0x7fb9481570c0 2023-12-19T16:17:35.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.992+0000 7fb946ffd640 1 --2- 172.21.15.119:0/2584497638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9481570c0 0x7fb94806bde0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9480ce330 tx=0x7fb93801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae9a53e171c9314 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb9467fc640 1 -- 172.21.15.119:0/2584497638 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9380ac640 con 0x7fb9481570c0 2023-12-19T16:17:35.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb9467fc640 1 -- 172.21.15.119:0/2584497638 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9380ac7a0 con 0x7fb9481570c0 2023-12-19T16:17:35.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb9467fc640 1 -- 172.21.15.119:0/2584497638 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9380acb30 con 0x7fb9481570c0 2023-12-19T16:17:35.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- 172.21.15.119:0/2584497638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9481570c0 msgr2=0x7fb94806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/2584497638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9481570c0 0x7fb94806bde0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9480ce330 tx=0x7fb93801c400 comp rx=0 tx=0).stop 2023-12-19T16:17:35.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- 172.21.15.119:0/2584497638 shutdown_connections 2023-12-19T16:17:35.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/2584497638 >> v2:172.21.15.143:3300/0 conn(0x7fb94806c320 0x7fb9480c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/2584497638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9481570c0 0x7fb94806bde0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- 172.21.15.119:0/2584497638 >> 172.21.15.119:0/2584497638 conn(0x7fb94806a3e0 msgr2=0x7fb9480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:35.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- 172.21.15.119:0/2584497638 shutdown_connections 2023-12-19T16:17:35.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- 172.21.15.119:0/2584497638 wait complete. 2023-12-19T16:17:36.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 Processor -- start 2023-12-19T16:17:36.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- start start 2023-12-19T16:17:36.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb94806c320 0x7fb948156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 0x7fb94814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb9481570c0 0x7fb9480c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948157a60 con 0x7fb9480c9e30 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c4950 con 0x7fb94806c320 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb94d7ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480cae80 con 0x7fb9481570c0 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb93e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 0x7fb94814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb93e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 0x7fb94814a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46690/0 (socket says 172.21.15.119:46690) 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:35.996+0000 7fb93e7fc640 1 -- 172.21.15.119:0/298956619 learned_addr learned my addr 172.21.15.119:0/298956619 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb946ffd640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb94806c320 0x7fb948156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb9477fe640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb9481570c0 0x7fb9480c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93e7fc640 1 -- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb9481570c0 msgr2=0x7fb9480c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93e7fc640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb9481570c0 0x7fb9480c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93e7fc640 1 -- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb94806c320 msgr2=0x7fb948156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93e7fc640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb94806c320 0x7fb948156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93e7fc640 1 -- 172.21.15.119:0/298956619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380094d0 con 0x7fb9480c9e30 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb9477fe640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb9481570c0 0x7fb9480c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93e7fc640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 0x7fb94814a1b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb93000d5f0 tx=0x7fb93000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9300125f0 con 0x7fb9480c9e30 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930012750 con 0x7fb9480c9e30 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930012ae0 con 0x7fb9480c9e30 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480cb160 con 0x7fb9480c9e30 2023-12-19T16:17:36.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480cb720 con 0x7fb9480c9e30 2023-12-19T16:17:36.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9480735b0 con 0x7fb9480c9e30 2023-12-19T16:17:36.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb930012c40 con 0x7fb9480c9e30 2023-12-19T16:17:36.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.000+0000 7fb93ffff640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb928065a60 0x7fb928067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.004+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb930083930 con 0x7fb9480c9e30 2023-12-19T16:17:36.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.004+0000 7fb946ffd640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb928065a60 0x7fb928067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.004+0000 7fb946ffd640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb928065a60 0x7fb928067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb9380ae000 tx=0x7fb938008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.004+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb930050f80 con 0x7fb9480c9e30 2023-12-19T16:17:36.161 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb94804e000 con 0x7fb9480c9e30 2023-12-19T16:17:36.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb93ffff640 1 -- 172.21.15.119:0/298956619 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7fb930007380 con 0x7fb9480c9e30 2023-12-19T16:17:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:36.163 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb928065a60 msgr2=0x7fb928067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb928065a60 0x7fb928067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb9380ae000 tx=0x7fb938008040 comp rx=0 tx=0).stop 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 msgr2=0x7fb94814a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 0x7fb94814a1b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb93000d5f0 tx=0x7fb93000dab0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 shutdown_connections 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb928065a60 0x7fb928067f20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb9481570c0 0x7fb9480c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9480c9e30 0x7fb94814a1b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 --2- 172.21.15.119:0/298956619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb94806c320 0x7fb948156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 >> 172.21.15.119:0/298956619 conn(0x7fb94806a3e0 msgr2=0x7fb9480ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:36.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 shutdown_connections 2023-12-19T16:17:36.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.160+0000 7fb94d7ce640 1 -- 172.21.15.119:0/298956619 wait complete. 2023-12-19T16:17:36.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:42.059055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:42.708109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-19T16:16:57.390246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:36.185 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.320+0000 7f042c739640 1 Processor -- start 2023-12-19T16:17:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042c739640 1 -- start start 2023-12-19T16:17:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042c739640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04241582d0 0x7f04240c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042c739640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f04240ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042c739640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240c9390 con 0x7f04240ce3b0 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042c739640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042415aee0 con 0x7f04241582d0 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042c739640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042415b1c0 con 0x7f0424070820 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042acd6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f04240ce3b0 0x7f04240cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60026/0 (socket says 172.21.15.119:60026) 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042acd6640 1 -- 172.21.15.119:0/634695151 learned_addr learned my addr 172.21.15.119:0/634695151 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f0429cd4640 1 --2- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f04240ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042a4d5640 1 --2- 172.21.15.119:0/634695151 >> v2:172.21.15.143:3300/0 conn(0x7f04241582d0 0x7f04240c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f04294d3640 1 -- 172.21.15.119:0/634695151 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269787872 0 0) 0x7f04240c9390 con 0x7f04240ce3b0 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f04294d3640 1 -- 172.21.15.119:0/634695151 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0410003530 con 0x7f04240ce3b0 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042a4d5640 1 -- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 msgr2=0x7f04240ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042a4d5640 1 --2- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f04240ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042a4d5640 1 -- 172.21.15.119:0/634695151 >> v1:172.21.15.119:6789/0 conn(0x7f04240ce3b0 legacy=0x7f04240cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.324+0000 7f042a4d5640 1 -- 172.21.15.119:0/634695151 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042415b4a0 con 0x7f04241582d0 2023-12-19T16:17:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042a4d5640 1 --2- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04241582d0 0x7f04240c8e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f04200097c0 tx=0x7f042001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f5d32e2620e094 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f04294d3640 1 -- 172.21.15.119:0/634695151 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200ab670 con 0x7f04241582d0 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f04294d3640 1 -- 172.21.15.119:0/634695151 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04200ab7d0 con 0x7f04241582d0 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f04294d3640 1 -- 172.21.15.119:0/634695151 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200abb40 con 0x7f04241582d0 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 -- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04241582d0 msgr2=0x7f04240c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 --2- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04241582d0 0x7f04240c8e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f04200097c0 tx=0x7f042001c450 comp rx=0 tx=0).stop 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 -- 172.21.15.119:0/634695151 shutdown_connections 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 --2- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f04240ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 --2- 172.21.15.119:0/634695151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04241582d0 0x7f04240c8e50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 -- 172.21.15.119:0/634695151 >> 172.21.15.119:0/634695151 conn(0x7f042406a2a0 msgr2=0x7f04240aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 -- 172.21.15.119:0/634695151 shutdown_connections 2023-12-19T16:17:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.328+0000 7f042c739640 1 -- 172.21.15.119:0/634695151 wait complete. 2023-12-19T16:17:36.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 Processor -- start 2023-12-19T16:17:36.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- start start 2023-12-19T16:17:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f042415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04240ce3b0 0x7f042415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 0x7f0424151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042415dfc0 con 0x7f04241582d0 2023-12-19T16:17:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042414e1f0 con 0x7f04240ce3b0 2023-12-19T16:17:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c6c20 con 0x7f0424070820 2023-12-19T16:17:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 0x7f0424151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 0x7f0424151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46698/0 (socket says 172.21.15.119:46698) 2023-12-19T16:17:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 -- 172.21.15.119:0/3340989823 learned_addr learned my addr 172.21.15.119:0/3340989823 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f0429cd4640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04240ce3b0 0x7f042415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042a4d5640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f042415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 -- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 msgr2=0x7f042415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f042415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 -- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04240ce3b0 msgr2=0x7f042415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04240ce3b0 0x7f042415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 -- 172.21.15.119:0/3340989823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009420 con 0x7f04241582d0 2023-12-19T16:17:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042acd6640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 0x7f0424151910 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f041c00cb70 tx=0x7f041c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00ad40 con 0x7f04241582d0 2023-12-19T16:17:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c012400 con 0x7f04241582d0 2023-12-19T16:17:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04240c6010 con 0x7f04241582d0 2023-12-19T16:17:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00aea0 con 0x7f04241582d0 2023-12-19T16:17:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04240c65d0 con 0x7f04241582d0 2023-12-19T16:17:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.332+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04240c6db0 con 0x7f04241582d0 2023-12-19T16:17:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.336+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f041c007070 con 0x7f04241582d0 2023-12-19T16:17:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.336+0000 7f041affd640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0408065a60 0x7f0408067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.336+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f041c083470 con 0x7f04241582d0 2023-12-19T16:17:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.336+0000 7f042a4d5640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0408065a60 0x7f0408067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.336+0000 7f042a4d5640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0408065a60 0x7f0408067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f04200af000 tx=0x7f04200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.340+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f041c050b70 con 0x7f04241582d0 2023-12-19T16:17:36.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.488+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f042404e000 con 0x7f04241582d0 2023-12-19T16:17:36.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f041affd640 1 -- 172.21.15.119:0/3340989823 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f041c017020 con 0x7f04241582d0 2023-12-19T16:17:36.494 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0408065a60 msgr2=0x7f0408067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0408065a60 0x7f0408067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f04200af000 tx=0x7f04200a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 msgr2=0x7f0424151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 0x7f0424151910 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f041c00cb70 tx=0x7f041c00a430 comp rx=0 tx=0).stop 2023-12-19T16:17:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 shutdown_connections 2023-12-19T16:17:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0408065a60 0x7f0408067f20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04240ce3b0 0x7f042415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04241582d0 0x7f0424151910 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 --2- 172.21.15.119:0/3340989823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0424070820 0x7f042415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 >> 172.21.15.119:0/3340989823 conn(0x7f042406a2a0 msgr2=0x7f04241577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:36.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 shutdown_connections 2023-12-19T16:17:36.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.492+0000 7f042c739640 1 -- 172.21.15.119:0/3340989823 wait complete. 2023-12-19T16:17:36.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.652+0000 7fbdb18c4640 1 Processor -- start 2023-12-19T16:17:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.652+0000 7fbdb18c4640 1 -- start start 2023-12-19T16:17:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbdb18c4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdac071870 0x7fbdac071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbdb18c4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac070df0 con 0x7fbdac0cbff0 2023-12-19T16:17:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbdb18c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac15a4f0 con 0x7fbdac0ca410 2023-12-19T16:17:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbdb18c4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac15aab0 con 0x7fbdac071870 2023-12-19T16:17:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdac071870 0x7fbdac071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdac071870 0x7fbdac071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46706/0 (socket says 172.21.15.119:46706) 2023-12-19T16:17:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 -- 172.21.15.119:0/388834236 learned_addr learned my addr 172.21.15.119:0/388834236 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 -- 172.21.15.119:0/388834236 >> v1:172.21.15.143:6789/0 conn(0x7fbdac0ca410 legacy=0x7fbdac159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 -- 172.21.15.119:0/388834236 >> v1:172.21.15.119:6789/0 conn(0x7fbdac0cbff0 legacy=0x7fbdac0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 -- 172.21.15.119:0/388834236 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac15a7d0 con 0x7fbdac071870 2023-12-19T16:17:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.656+0000 7fbda27fc640 1 --2- 172.21.15.119:0/388834236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac071d00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009870 tx=0x7fbd9c01e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8764ed65c8e5e80 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdaa7fc640 1 -- 172.21.15.119:0/388834236 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0aa650 con 0x7fbdac071870 2023-12-19T16:17:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdaa7fc640 1 -- 172.21.15.119:0/388834236 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0aa7b0 con 0x7fbdac071870 2023-12-19T16:17:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdaa7fc640 1 -- 172.21.15.119:0/388834236 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0aab40 con 0x7fbdac071870 2023-12-19T16:17:36.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- 172.21.15.119:0/388834236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 msgr2=0x7fbdac071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/388834236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac071d00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009870 tx=0x7fbd9c01e720 comp rx=0 tx=0).stop 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- 172.21.15.119:0/388834236 shutdown_connections 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/388834236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac071d00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- 172.21.15.119:0/388834236 >> 172.21.15.119:0/388834236 conn(0x7fbdac06a2a0 msgr2=0x7fbdac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- 172.21.15.119:0/388834236 shutdown_connections 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- 172.21.15.119:0/388834236 wait complete. 2023-12-19T16:17:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 Processor -- start 2023-12-19T16:17:36.664 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- start start 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac0c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdac0ca410 0x7fbdac0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdac0cbff0 0x7fbdac150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1538a0 con 0x7fbdac071870 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac153af0 con 0x7fbdac0ca410 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.660+0000 7fbdb18c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac153dd0 con 0x7fbdac0cbff0 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac0c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac0c08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46712/0 (socket says 172.21.15.119:46712) 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 -- 172.21.15.119:0/1373546994 learned_addr learned my addr 172.21.15.119:0/1373546994 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbda27fc640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdac0ca410 0x7fbdac0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdab7fe640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdac0cbff0 0x7fbdac150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 -- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdac0cbff0 msgr2=0x7fbdac150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdac0cbff0 0x7fbdac150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 -- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdac0ca410 msgr2=0x7fbdac0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdac0ca410 0x7fbdac0c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 -- 172.21.15.119:0/1373546994 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0094d0 con 0x7fbdac071870 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdab7fe640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdac0cbff0 0x7fbdac150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdaaffd640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac0c08f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c500 tx=0x7fbd9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94005220 con 0x7fbdac071870 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd94005380 con 0x7fbdac071870 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94007270 con 0x7fbdac071870 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac0cc960 con 0x7fbdac071870 2023-12-19T16:17:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac154390 con 0x7fbdac071870 2023-12-19T16:17:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac154580 con 0x7fbdac071870 2023-12-19T16:17:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.664+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd940073d0 con 0x7fbdac071870 2023-12-19T16:17:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.668+0000 7fbda8ff9640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbd8c065a90 0x7fbd8c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.668+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fbd94082d20 con 0x7fbdac071870 2023-12-19T16:17:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.668+0000 7fbda27fc640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbd8c065a90 0x7fbd8c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.668+0000 7fbda27fc640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbd8c065a90 0x7fbd8c067f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0b1000 tx=0x7fbd9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.672+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd94050380 con 0x7fbdac071870 2023-12-19T16:17:36.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdac04e000 con 0x7fbdac071870 2023-12-19T16:17:36.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbda8ff9640 1 -- 172.21.15.119:0/1373546994 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd940539a0 con 0x7fbdac071870 2023-12-19T16:17:36.823 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbd8c065a90 msgr2=0x7fbd8c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbd8c065a90 0x7fbd8c067f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0b1000 tx=0x7fbd9c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 msgr2=0x7fbdac0c08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac0c08f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c500 tx=0x7fbd9400c9c0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 shutdown_connections 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbd8c065a90 0x7fbd8c067f50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdac0ca410 0x7fbdac0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdac0cbff0 0x7fbdac150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 --2- 172.21.15.119:0/1373546994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac071870 0x7fbdac0c08f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 >> 172.21.15.119:0/1373546994 conn(0x7fbdac06a2a0 msgr2=0x7fbdac155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:36.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 shutdown_connections 2023-12-19T16:17:36.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.820+0000 7fbdb18c4640 1 -- 172.21.15.119:0/1373546994 wait complete. 2023-12-19T16:17:36.844 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:36.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.980+0000 7f150b42d640 1 Processor -- start 2023-12-19T16:17:36.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.980+0000 7f150b42d640 1 -- start start 2023-12-19T16:17:36.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.980+0000 7f150b42d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15040ceac0 0x7f15040c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.980+0000 7f150b42d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15040c9390 con 0x7f1504070820 2023-12-19T16:17:36.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.980+0000 7f150b42d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150415aee0 con 0x7f15041582d0 2023-12-19T16:17:36.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.980+0000 7f150b42d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150415b1c0 con 0x7f15040ceac0 2023-12-19T16:17:36.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15089c8640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1504070820 0x7f15040ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60056/0 (socket says 172.21.15.119:60056) 2023-12-19T16:17:36.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15089c8640 1 -- 172.21.15.119:0/2796747494 learned_addr learned my addr 172.21.15.119:0/2796747494 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:36.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15099ca640 1 --2- 172.21.15.119:0/2796747494 >> v2:172.21.15.119:3300/0 conn(0x7f15040ceac0 0x7f15040c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15099ca640 1 -- 172.21.15.119:0/2796747494 >> v1:172.21.15.143:6789/0 conn(0x7f15041582d0 legacy=0x7f15040ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15099ca640 1 -- 172.21.15.119:0/2796747494 >> v1:172.21.15.119:6789/0 conn(0x7f1504070820 legacy=0x7f15040ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15099ca640 1 -- 172.21.15.119:0/2796747494 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150415b4a0 con 0x7f15040ceac0 2023-12-19T16:17:36.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f15099ca640 1 --2- 172.21.15.119:0/2796747494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15040ceac0 0x7f15040c8e50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009d90 tx=0x7f14fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95408dcb2d6c43d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f14fbfff640 1 -- 172.21.15.119:0/2796747494 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0a5a00 con 0x7f15040ceac0 2023-12-19T16:17:36.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f14fbfff640 1 -- 172.21.15.119:0/2796747494 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc0a5b60 con 0x7f15040ceac0 2023-12-19T16:17:36.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.984+0000 7f14fbfff640 1 -- 172.21.15.119:0/2796747494 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0ad440 con 0x7f15040ceac0 2023-12-19T16:17:36.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- 172.21.15.119:0/2796747494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15040ceac0 msgr2=0x7f15040c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 --2- 172.21.15.119:0/2796747494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15040ceac0 0x7f15040c8e50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009d90 tx=0x7f14fc01c920 comp rx=0 tx=0).stop 2023-12-19T16:17:36.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- 172.21.15.119:0/2796747494 shutdown_connections 2023-12-19T16:17:36.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 --2- 172.21.15.119:0/2796747494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15040ceac0 0x7f15040c8e50 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- 172.21.15.119:0/2796747494 >> 172.21.15.119:0/2796747494 conn(0x7f150406a2a0 msgr2=0x7f15040aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:36.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- 172.21.15.119:0/2796747494 shutdown_connections 2023-12-19T16:17:36.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- 172.21.15.119:0/2796747494 wait complete. 2023-12-19T16:17:36.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 Processor -- start 2023-12-19T16:17:36.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- start start 2023-12-19T16:17:36.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1504070820 0x7f15040c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15040ceac0 0x7f150415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 0x7f15040c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1504157dc0 con 0x7f15041582d0 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1504151980 con 0x7f15040ceac0 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f150b42d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1504151c60 con 0x7f1504070820 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15099ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 0x7f15040c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15099ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 0x7f15040c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46724/0 (socket says 172.21.15.119:46724) 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15099ca640 1 -- 172.21.15.119:0/455989395 learned_addr learned my addr 172.21.15.119:0/455989395 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:36.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15089c8640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15040ceac0 0x7f150415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15091c9640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1504070820 0x7f15040c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15099ca640 1 -- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1504070820 msgr2=0x7f15040c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.988+0000 7f15099ca640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1504070820 0x7f15040c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f15099ca640 1 -- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15040ceac0 msgr2=0x7f150415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f15099ca640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15040ceac0 0x7f150415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f15099ca640 1 -- 172.21.15.119:0/455989395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009a70 con 0x7f15041582d0 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f15099ca640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 0x7f15040c54f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f14fc019530 tx=0x7f14fc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0ade20 con 0x7f15041582d0 2023-12-19T16:17:36.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc0b7410 con 0x7f15041582d0 2023-12-19T16:17:36.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15040c2a00 con 0x7f15041582d0 2023-12-19T16:17:36.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0b77c0 con 0x7f15041582d0 2023-12-19T16:17:36.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15040c2fc0 con 0x7f15041582d0 2023-12-19T16:17:36.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150404e000 con 0x7f15041582d0 2023-12-19T16:17:37.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14fc0b4050 con 0x7f15041582d0 2023-12-19T16:17:37.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f14f9ffb640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14e8065a60 0x7f14e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.992+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f14fc11f2e0 con 0x7f15041582d0 2023-12-19T16:17:37.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.996+0000 7f15091c9640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14e8065a60 0x7f14e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.996+0000 7f15091c9640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14e8065a60 0x7f14e8067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1500000f70 tx=0x7f1500009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:36.996+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14fc0ecad0 con 0x7f15041582d0 2023-12-19T16:17:37.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.148+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15040c31b0 con 0x7f15041582d0 2023-12-19T16:17:37.151 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.148+0000 7f14f9ffb640 1 -- 172.21.15.119:0/455989395 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14fc0b20a0 con 0x7f15041582d0 2023-12-19T16:17:37.152 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:17:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14e8065a60 msgr2=0x7f14e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14e8065a60 0x7f14e8067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1500000f70 tx=0x7f1500009040 comp rx=0 tx=0).stop 2023-12-19T16:17:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 msgr2=0x7f15040c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 0x7f15040c54f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f14fc019530 tx=0x7f14fc0196c0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 shutdown_connections 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f14e8065a60 0x7f14e8067f20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15040ceac0 0x7f150415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15041582d0 0x7f15040c54f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 --2- 172.21.15.119:0/455989395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1504070820 0x7f15040c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 >> 172.21.15.119:0/455989395 conn(0x7f150406a2a0 msgr2=0x7f150415e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 shutdown_connections 2023-12-19T16:17:37.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.152+0000 7f150b42d640 1 -- 172.21.15.119:0/455989395 wait complete. 2023-12-19T16:17:37.172 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-19T16:17:37.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.308+0000 7fb51da66640 1 Processor -- start 2023-12-19T16:17:37.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.308+0000 7fb51da66640 1 -- start start 2023-12-19T16:17:37.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb51da66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb518153020 0x7fb5180c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb51da66640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5180ce390 0x7fb5180ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb51da66640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180c9730 con 0x7fb5181598d0 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb51da66640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180ced60 con 0x7fb5180ce390 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb51da66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180b0db0 con 0x7fb518153020 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5180ce390 0x7fb5180ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5180ce390 0x7fb5180ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46726/0 (socket says 172.21.15.119:46726) 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 -- 172.21.15.119:0/4107364716 learned_addr learned my addr 172.21.15.119:0/4107364716 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb5177fe640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb518153020 0x7fb5180c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 -- 172.21.15.119:0/4107364716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb518153020 msgr2=0x7fb5180c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb518153020 0x7fb5180c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 -- 172.21.15.119:0/4107364716 >> v1:172.21.15.143:6789/0 conn(0x7fb5181598d0 legacy=0x7fb5180b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb517fff640 1 -- 172.21.15.119:0/4107364716 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180cbc80 con 0x7fb5180ce390 2023-12-19T16:17:37.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.312+0000 7fb5177fe640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb518153020 0x7fb5180c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:37.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb517fff640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180ce820 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb51000d150 tx=0x7fb51001eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec4f0ca4c290117 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb516ffd640 1 -- 172.21.15.119:0/4107364716 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000b2d0 con 0x7fb5180ce390 2023-12-19T16:17:37.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb516ffd640 1 -- 172.21.15.119:0/4107364716 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000b430 con 0x7fb5180ce390 2023-12-19T16:17:37.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb516ffd640 1 -- 172.21.15.119:0/4107364716 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100a7bb0 con 0x7fb5180ce390 2023-12-19T16:17:37.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- 172.21.15.119:0/4107364716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 msgr2=0x7fb5180ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180ce820 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb51000d150 tx=0x7fb51001eac0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- 172.21.15.119:0/4107364716 shutdown_connections 2023-12-19T16:17:37.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180ce820 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 --2- 172.21.15.119:0/4107364716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb518153020 0x7fb5180c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- 172.21.15.119:0/4107364716 >> 172.21.15.119:0/4107364716 conn(0x7fb51806a2a0 msgr2=0x7fb5180aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- 172.21.15.119:0/4107364716 shutdown_connections 2023-12-19T16:17:37.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- 172.21.15.119:0/4107364716 wait complete. 2023-12-19T16:17:37.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 Processor -- start 2023-12-19T16:17:37.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- start start 2023-12-19T16:17:37.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb518153020 0x7fb5181f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5181598d0 0x7fb5181f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c8840 con 0x7fb5180ce390 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c57f0 con 0x7fb518153020 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.316+0000 7fb51da66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c7bc0 con 0x7fb5181598d0 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46732/0 (socket says 172.21.15.119:46732) 2023-12-19T16:17:37.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 -- 172.21.15.119:0/631430218 learned_addr learned my addr 172.21.15.119:0/631430218 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb50ffff640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb518153020 0x7fb5181f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb517fff640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5181598d0 0x7fb5181f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 -- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5181598d0 msgr2=0x7fb5181f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5181598d0 0x7fb5181f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 -- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb518153020 msgr2=0x7fb5181f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb518153020 0x7fb5181f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.324 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 -- 172.21.15.119:0/631430218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51000bd40 con 0x7fb5180ce390 2023-12-19T16:17:37.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb5177fe640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180c4890 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb50800e810 tx=0x7fb50800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50800c8d0 con 0x7fb5180ce390 2023-12-19T16:17:37.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50800ca30 con 0x7fb5180ce390 2023-12-19T16:17:37.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50800cde0 con 0x7fb5180ce390 2023-12-19T16:17:37.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5180c7ea0 con 0x7fb5180ce390 2023-12-19T16:17:37.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5180c8460 con 0x7fb5180ce390 2023-12-19T16:17:37.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51804e000 con 0x7fb5180ce390 2023-12-19T16:17:37.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.320+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb508013410 con 0x7fb5180ce390 2023-12-19T16:17:37.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.324+0000 7fb514ff9640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4f8065a60 0x7fb4f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.324+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb508083270 con 0x7fb5180ce390 2023-12-19T16:17:37.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.324+0000 7fb50ffff640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4f8065a60 0x7fb4f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.324+0000 7fb50ffff640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4f8065a60 0x7fb4f8067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb5180adad0 tx=0x7fb500009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.328+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb508050960 con 0x7fb5180ce390 2023-12-19T16:17:37.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.476+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fb5180cc600 con 0x7fb5180ce390 2023-12-19T16:17:37.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.476+0000 7fb514ff9640 1 -- 172.21.15.119:0/631430218 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v42) v1 ==== 97+0+11 (secure 0 0 0) 0x7fb508053f80 con 0x7fb5180ce390 2023-12-19T16:17:37.481 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4f8065a60 msgr2=0x7fb4f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4f8065a60 0x7fb4f8067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb5180adad0 tx=0x7fb500009040 comp rx=0 tx=0).stop 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 msgr2=0x7fb5180c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180c4890 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb50800e810 tx=0x7fb50800ecd0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 shutdown_connections 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb4f8065a60 0x7fb4f8067f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb518153020 0x7fb5181f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5181598d0 0x7fb5181f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 --2- 172.21.15.119:0/631430218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5180ce390 0x7fb5180c4890 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 >> 172.21.15.119:0/631430218 conn(0x7fb51806a2a0 msgr2=0x7fb5180cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 shutdown_connections 2023-12-19T16:17:37.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.480+0000 7fb51da66640 1 -- 172.21.15.119:0/631430218 wait complete. 2023-12-19T16:17:37.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:37.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 Processor -- start 2023-12-19T16:17:37.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 -- start start 2023-12-19T16:17:37.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6fb0157080 0x7f6fb00ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb00cd730 0x7f6fb00ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00d1320 con 0x7f6fb00d05b0 2023-12-19T16:17:37.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb0157460 con 0x7f6fb0157080 2023-12-19T16:17:37.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb816d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00cc970 con 0x7f6fb00cd730 2023-12-19T16:17:37.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb670a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6fb00d05b0 0x7f6fb00d0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:57800/0 (socket says 172.21.15.119:57800) 2023-12-19T16:17:37.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb5f09640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6fb0157080 0x7f6fb00ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb670a640 1 -- 172.21.15.119:0/947794623 learned_addr learned my addr 172.21.15.119:0/947794623 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:37.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.636+0000 7f6fb5708640 1 --2- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb00cd730 0x7f6fb00ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb5f09640 1 -- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb00cd730 msgr2=0x7f6fb00ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:37.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb5f09640 1 --2- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb00cd730 0x7f6fb00ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb5f09640 1 -- 172.21.15.119:0/947794623 >> v1:172.21.15.143:6789/0 conn(0x7f6fb00d05b0 legacy=0x7f6fb00d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb5f09640 1 -- 172.21.15.119:0/947794623 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00ccc50 con 0x7f6fb0157080 2023-12-19T16:17:37.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb4f07640 1 -- 172.21.15.119:0/947794623 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624094985 0 0) 0x7f6fb00d1320 con 0x7f6fb00d05b0 2023-12-19T16:17:37.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb5f09640 1 --2- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb0157080 0x7f6fb00ce210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0097c0 tx=0x7f6fac01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e65c76b0677a5ef3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb4f07640 1 -- 172.21.15.119:0/947794623 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0ab600 con 0x7f6fb0157080 2023-12-19T16:17:37.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb4f07640 1 -- 172.21.15.119:0/947794623 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0a7050 con 0x7f6fb0157080 2023-12-19T16:17:37.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb4f07640 1 -- 172.21.15.119:0/947794623 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0ab980 con 0x7f6fb0157080 2023-12-19T16:17:37.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb816d640 1 -- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb0157080 msgr2=0x7f6fb00ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb816d640 1 --2- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb0157080 0x7f6fb00ce210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0097c0 tx=0x7f6fac01c480 comp rx=0 tx=0).stop 2023-12-19T16:17:37.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb816d640 1 -- 172.21.15.119:0/947794623 shutdown_connections 2023-12-19T16:17:37.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb816d640 1 --2- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb00cd730 0x7f6fb00ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb816d640 1 --2- 172.21.15.119:0/947794623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb0157080 0x7f6fb00ce210 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.640+0000 7f6fb816d640 1 -- 172.21.15.119:0/947794623 >> 172.21.15.119:0/947794623 conn(0x7f6fb0069ca0 msgr2=0x7f6fb006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 -- 172.21.15.119:0/947794623 shutdown_connections 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 -- 172.21.15.119:0/947794623 wait complete. 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 Processor -- start 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 -- start start 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 0x7f6fb00c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb00d05b0 0x7f6fb014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb0157080 0x7f6fb0155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.659 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0151950 con 0x7f6fb00cd730 2023-12-19T16:17:37.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01500c0 con 0x7f6fb00d05b0 2023-12-19T16:17:37.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb816d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00c6de0 con 0x7f6fb0157080 2023-12-19T16:17:37.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 0x7f6fb00c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 0x7f6fb00c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46746/0 (socket says 172.21.15.119:46746) 2023-12-19T16:17:37.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 -- 172.21.15.119:0/4194042263 learned_addr learned my addr 172.21.15.119:0/4194042263 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:37.660 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb670a640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb0157080 0x7f6fb0155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 -- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb0157080 msgr2=0x7f6fb0155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb0157080 0x7f6fb0155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 -- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb00d05b0 msgr2=0x7f6fb014f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5708640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb00d05b0 0x7f6fb014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb00d05b0 0x7f6fb014f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 -- 172.21.15.119:0/4194042263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009420 con 0x7f6fb00cd730 2023-12-19T16:17:37.661 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb670a640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb0157080 0x7f6fb0155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5708640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb00d05b0 0x7f6fb014f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fb5f09640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 0x7f6fb00c7de0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6fac01a0b0 tx=0x7f6fac01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0b7450 con 0x7f6fb00cd730 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.644+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0b75b0 con 0x7f6fb00cd730 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb00c70c0 con 0x7f6fb00cd730 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0b7960 con 0x7f6fb00cd730 2023-12-19T16:17:37.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb0150380 con 0x7f6fb00cd730 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0150570 con 0x7f6fb00cd730 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6fac0b7ac0 con 0x7f6fb00cd730 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fa67fc640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6f94065a60 0x7f6f94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f6fac11dc90 con 0x7f6fb00cd730 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fb5708640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6f94065a60 0x7f6f94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.648+0000 7f6fb5708640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6f94065a60 0x7f6f94067f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ca810 tx=0x7f6fa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.663 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.652+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6fac0eb2e0 con 0x7f6fb00cd730 2023-12-19T16:17:37.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.832+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fb004e000 con 0x7f6fb00cd730 2023-12-19T16:17:37.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.832+0000 7f6fa67fc640 1 -- 172.21.15.119:0/4194042263 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f6fac0b0090 con 0x7f6fb00cd730 2023-12-19T16:17:37.836 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:37.836 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:58.585749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:37.836 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2023-12-19T16:17:37.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.832+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6f94065a60 msgr2=0x7f6f94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.832+0000 7f6fb816d640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6f94065a60 0x7f6f94067f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ca810 tx=0x7f6fa0008040 comp rx=0 tx=0).stop 2023-12-19T16:17:37.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.832+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 msgr2=0x7f6fb00c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.832+0000 7f6fb816d640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 0x7f6fb00c7de0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6fac01a0b0 tx=0x7f6fac01acc0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 shutdown_connections 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6f94065a60 0x7f6f94067f20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fb00d05b0 0x7f6fb014f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fb0157080 0x7f6fb0155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 --2- 172.21.15.119:0/4194042263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb00cd730 0x7f6fb00c7de0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 >> 172.21.15.119:0/4194042263 conn(0x7f6fb0069ca0 msgr2=0x7f6fb015e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 shutdown_connections 2023-12-19T16:17:37.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.836+0000 7f6fb816d640 1 -- 172.21.15.119:0/4194042263 wait complete. 2023-12-19T16:17:37.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:37.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 Processor -- start 2023-12-19T16:17:37.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 -- start start 2023-12-19T16:17:37.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc37806c4f0 0x7fc3780c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3780c9e30 0x7fc3780ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3780c9460 con 0x7fc3781570c0 2023-12-19T16:17:37.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3781574a0 con 0x7fc3780c9e30 2023-12-19T16:17:37.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37cd7b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3780c8b30 con 0x7fc37806c4f0 2023-12-19T16:17:37.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37659c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc3781570c0 0x7fc37806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60068/0 (socket says 172.21.15.119:60068) 2023-12-19T16:17:37.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc37659c640 1 -- 172.21.15.119:0/1208962696 learned_addr learned my addr 172.21.15.119:0/1208962696 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:37.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc376d9d640 1 --2- 172.21.15.119:0/1208962696 >> v2:172.21.15.119:3300/0 conn(0x7fc3780c9e30 0x7fc3780ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc36dd9b640 1 --2- 172.21.15.119:0/1208962696 >> v2:172.21.15.143:3300/0 conn(0x7fc37806c4f0 0x7fc3780c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc376d9d640 1 -- 172.21.15.119:0/1208962696 >> v2:172.21.15.143:3300/0 conn(0x7fc37806c4f0 msgr2=0x7fc3780c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:37.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc376d9d640 1 --2- 172.21.15.119:0/1208962696 >> v2:172.21.15.143:3300/0 conn(0x7fc37806c4f0 0x7fc3780c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc376d9d640 1 -- 172.21.15.119:0/1208962696 >> v1:172.21.15.119:6789/0 conn(0x7fc3781570c0 legacy=0x7fc37806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc376d9d640 1 -- 172.21.15.119:0/1208962696 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780c8e10 con 0x7fc3780c9e30 2023-12-19T16:17:37.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.992+0000 7fc36dd9b640 1 --2- 172.21.15.119:0/1208962696 >> v2:172.21.15.143:3300/0 conn(0x7fc37806c4f0 0x7fc3780c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:37.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc376d9d640 1 --2- 172.21.15.119:0/1208962696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3780c9e30 0x7fc3780ca2c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc3780ce330 tx=0x7fc37001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806f59239acf3e0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc375d9b640 1 -- 172.21.15.119:0/1208962696 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700a58d0 con 0x7fc3780c9e30 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc375d9b640 1 -- 172.21.15.119:0/1208962696 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3700a5a30 con 0x7fc3780c9e30 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc375d9b640 1 -- 172.21.15.119:0/1208962696 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700a5dc0 con 0x7fc3780c9e30 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 -- 172.21.15.119:0/1208962696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3780c9e30 msgr2=0x7fc3780ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/1208962696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3780c9e30 0x7fc3780ca2c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc3780ce330 tx=0x7fc37001c850 comp rx=0 tx=0).stop 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 -- 172.21.15.119:0/1208962696 shutdown_connections 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/1208962696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3780c9e30 0x7fc3780ca2c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/1208962696 >> v2:172.21.15.143:3300/0 conn(0x7fc37806c4f0 0x7fc3780c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 -- 172.21.15.119:0/1208962696 >> 172.21.15.119:0/1208962696 conn(0x7fc37806a3e0 msgr2=0x7fc3780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 -- 172.21.15.119:0/1208962696 shutdown_connections 2023-12-19T16:17:38.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:37.996+0000 7fc37cd7b640 1 -- 172.21.15.119:0/1208962696 wait complete. 2023-12-19T16:17:38.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 Processor -- start 2023-12-19T16:17:38.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- start start 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 0x7fc37814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3780c9e30 0x7fc378158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3781570c0 0x7fc3780c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37814add0 con 0x7fc37806c4f0 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780cc780 con 0x7fc3780c9e30 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780cbb70 con 0x7fc3781570c0 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 0x7fc37814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 0x7fc37814a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46756/0 (socket says 172.21.15.119:46756) 2023-12-19T16:17:38.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 -- 172.21.15.119:0/3593150559 learned_addr learned my addr 172.21.15.119:0/3593150559 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 -- 172.21.15.119:0/3593150559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3781570c0 msgr2=0x7fc3780c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3781570c0 0x7fc3780c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 -- 172.21.15.119:0/3593150559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3780c9e30 msgr2=0x7fc378158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3780c9e30 0x7fc378158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 -- 172.21.15.119:0/3593150559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370009a70 con 0x7fc37806c4f0 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37659c640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 0x7fc37814a890 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c430 tx=0x7fc36800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368005cf0 con 0x7fc37806c4f0 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368005e50 con 0x7fc37806c4f0 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3780cbe50 con 0x7fc37806c4f0 2023-12-19T16:17:38.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3680072d0 con 0x7fc37806c4f0 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3780cc410 con 0x7fc37806c4f0 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.000+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3780735b0 con 0x7fc37806c4f0 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.004+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc368007430 con 0x7fc37806c4f0 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.004+0000 7fc36f7fe640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc358065a60 0x7fc358067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.004+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fc368082940 con 0x7fc37806c4f0 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.004+0000 7fc36dd9b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc358065a60 0x7fc358067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.004+0000 7fc36dd9b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc358065a60 0x7fc358067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc378150530 tx=0x7fc360008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.008+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc368050040 con 0x7fc37806c4f0 2023-12-19T16:17:38.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc37815a560 con 0x7fc37806c4f0 2023-12-19T16:17:38.163 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc36f7fe640 1 -- 172.21.15.119:0/3593150559 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7fc368053660 con 0x7fc37806c4f0 2023-12-19T16:17:38.163 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:38.164 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:38.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc358065a60 msgr2=0x7fc358067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc358065a60 0x7fc358067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc378150530 tx=0x7fc360008040 comp rx=0 tx=0).stop 2023-12-19T16:17:38.166 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 msgr2=0x7fc37814a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 0x7fc37814a890 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c430 tx=0x7fc36800c8f0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 shutdown_connections 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.160+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc358065a60 0x7fc358067f20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.164+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3780c9e30 0x7fc378158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.164+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3781570c0 0x7fc3780c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.164+0000 7fc37cd7b640 1 --2- 172.21.15.119:0/3593150559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc37806c4f0 0x7fc37814a890 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.164+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 >> 172.21.15.119:0/3593150559 conn(0x7fc37806a3e0 msgr2=0x7fc37814d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:38.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.164+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 shutdown_connections 2023-12-19T16:17:38.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.164+0000 7fc37cd7b640 1 -- 172.21.15.119:0/3593150559 wait complete. 2023-12-19T16:17:38.185 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:17:38.185 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:38.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96f04c4640 1 Processor -- start 2023-12-19T16:17:38.323 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96f04c4640 1 -- start start 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96f04c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f96e80cf0d0 0x7f96e80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96f04c4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80cfa70 con 0x7f96e81648d0 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96f04c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80d11c0 con 0x7f96e815ca40 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96f04c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80d0310 con 0x7f96e80cf0d0 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96eea61640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f96e81648d0 0x7f96e8166cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60084/0 (socket says 172.21.15.119:60084) 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96eea61640 1 -- 172.21.15.119:0/2543860228 learned_addr learned my addr 172.21.15.119:0/2543860228 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96eda5f640 1 --2- 172.21.15.119:0/2543860228 >> v2:172.21.15.143:3300/0 conn(0x7f96e80cf0d0 0x7f96e80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.325 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96ed25e640 1 -- 172.21.15.119:0/2543860228 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298043748 0 0) 0x7f96e80cfa70 con 0x7f96e81648d0 2023-12-19T16:17:38.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96ed25e640 1 -- 172.21.15.119:0/2543860228 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d4003530 con 0x7f96e81648d0 2023-12-19T16:17:38.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96eda5f640 1 -- 172.21.15.119:0/2543860228 >> v1:172.21.15.143:6789/0 conn(0x7f96e815ca40 legacy=0x7f96e80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96ed25e640 1 -- 172.21.15.119:0/2543860228 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843497750 0 0) 0x7f96e80d11c0 con 0x7f96e815ca40 2023-12-19T16:17:38.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96eda5f640 1 -- 172.21.15.119:0/2543860228 >> v1:172.21.15.119:6789/0 conn(0x7f96e81648d0 legacy=0x7f96e8166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.320+0000 7f96eda5f640 1 -- 172.21.15.119:0/2543860228 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80d05b0 con 0x7f96e80cf0d0 2023-12-19T16:17:38.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96eda5f640 1 --2- 172.21.15.119:0/2543860228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e80cf0d0 0x7f96e80cf530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f96d80097a0 tx=0x7f96d801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94e5cee4a3805c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96ed25e640 1 -- 172.21.15.119:0/2543860228 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80a7070 con 0x7f96e80cf0d0 2023-12-19T16:17:38.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96ed25e640 1 -- 172.21.15.119:0/2543860228 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80ab430 con 0x7f96e80cf0d0 2023-12-19T16:17:38.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96ed25e640 1 -- 172.21.15.119:0/2543860228 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80ab7c0 con 0x7f96e80cf0d0 2023-12-19T16:17:38.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96f04c4640 1 -- 172.21.15.119:0/2543860228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e80cf0d0 msgr2=0x7f96e80cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96f04c4640 1 --2- 172.21.15.119:0/2543860228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e80cf0d0 0x7f96e80cf530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f96d80097a0 tx=0x7f96d801c430 comp rx=0 tx=0).stop 2023-12-19T16:17:38.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96f04c4640 1 -- 172.21.15.119:0/2543860228 shutdown_connections 2023-12-19T16:17:38.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96f04c4640 1 --2- 172.21.15.119:0/2543860228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e80cf0d0 0x7f96e80cf530 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.324+0000 7f96f04c4640 1 -- 172.21.15.119:0/2543860228 >> 172.21.15.119:0/2543860228 conn(0x7f96e8089fb0 msgr2=0x7f96e80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:38.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 -- 172.21.15.119:0/2543860228 shutdown_connections 2023-12-19T16:17:38.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 -- 172.21.15.119:0/2543860228 wait complete. 2023-12-19T16:17:38.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 Processor -- start 2023-12-19T16:17:38.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 -- start start 2023-12-19T16:17:38.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 0x7f96e815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96e815ca40 0x7f96e80c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e81648d0 0x7f96e80b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815b9f0 con 0x7f96e80cf0d0 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815ade0 con 0x7f96e81648d0 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96f04c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815b0c0 con 0x7f96e815ca40 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 0x7f96e815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 0x7f96e815be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46764/0 (socket says 172.21.15.119:46764) 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 -- 172.21.15.119:0/1853258755 learned_addr learned my addr 172.21.15.119:0/1853258755 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96eea61640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e81648d0 0x7f96e80b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96eda5f640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96e815ca40 0x7f96e80c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 -- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96e815ca40 msgr2=0x7f96e80c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96e815ca40 0x7f96e80c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 -- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e81648d0 msgr2=0x7f96e80b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e81648d0 0x7f96e80b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 -- 172.21.15.119:0/1853258755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80093b0 con 0x7f96e80cf0d0 2023-12-19T16:17:38.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96ee260640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 0x7f96e815be80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c550 tx=0x7f96e400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4005500 con 0x7f96e80cf0d0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e4003650 con 0x7f96e80cf0d0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.328+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4003a00 con 0x7f96e80cf0d0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e815b3a0 con 0x7f96e80cf0d0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e815aa00 con 0x7f96e80cf0d0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e804e000 con 0x7f96e80cf0d0 2023-12-19T16:17:38.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96e4003b60 con 0x7f96e80cf0d0 2023-12-19T16:17:38.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96deffd640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f96cc065a60 0x7f96cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f96e4082a70 con 0x7f96e80cf0d0 2023-12-19T16:17:38.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96eda5f640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f96cc065a60 0x7f96cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.332+0000 7f96eda5f640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f96cc065a60 0x7f96cc067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f96d80af000 tx=0x7f96d80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.336+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f96e4050200 con 0x7f96e80cf0d0 2023-12-19T16:17:38.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96e81681c0 con 0x7f96e80cf0d0 2023-12-19T16:17:38.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96deffd640 1 -- 172.21.15.119:0/1853258755 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f96e4017070 con 0x7f96e80cf0d0 2023-12-19T16:17:38.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:38.527 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:58.585749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:38.527 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2023-12-19T16:17:38.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f96cc065a60 msgr2=0x7f96cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f96cc065a60 0x7f96cc067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f96d80af000 tx=0x7f96d80a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:38.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 msgr2=0x7f96e815be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 0x7f96e815be80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c550 tx=0x7f96e400ca10 comp rx=0 tx=0).stop 2023-12-19T16:17:38.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 shutdown_connections 2023-12-19T16:17:38.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f96cc065a60 0x7f96cc067f20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96e81648d0 0x7f96e80b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96e815ca40 0x7f96e80c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 --2- 172.21.15.119:0/1853258755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e80cf0d0 0x7f96e815be80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 >> 172.21.15.119:0/1853258755 conn(0x7f96e8089fb0 msgr2=0x7f96e80b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:38.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 shutdown_connections 2023-12-19T16:17:38.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.524+0000 7f96f04c4640 1 -- 172.21.15.119:0/1853258755 wait complete. 2023-12-19T16:17:38.548 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:38.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.684+0000 7f40691ce640 1 Processor -- start 2023-12-19T16:17:38.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.684+0000 7f40691ce640 1 -- start start 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f40691ce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40641570c0 0x7f406406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f40691ce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40640ca000 0x7f4064070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f40691ce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640c9460 con 0x7f406406c320 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f40691ce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406406c7a0 con 0x7f40640ca000 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f40691ce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40641574a0 con 0x7f40641570c0 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40640ca000 0x7f4064070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40640ca000 0x7f4064070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46774/0 (socket says 172.21.15.119:46774) 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 -- 172.21.15.119:0/3564977516 learned_addr learned my addr 172.21.15.119:0/3564977516 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f4062d9d640 1 --2- 172.21.15.119:0/3564977516 >> v2:172.21.15.143:3300/0 conn(0x7f40641570c0 0x7f406406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 -- 172.21.15.119:0/3564977516 >> v2:172.21.15.143:3300/0 conn(0x7f40641570c0 msgr2=0x7f406406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 --2- 172.21.15.119:0/3564977516 >> v2:172.21.15.143:3300/0 conn(0x7f40641570c0 0x7f406406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 -- 172.21.15.119:0/3564977516 >> v1:172.21.15.119:6789/0 conn(0x7f406406c320 legacy=0x7f40640c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.691 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.688+0000 7f406359e640 1 -- 172.21.15.119:0/3564977516 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640c8b30 con 0x7f40640ca000 2023-12-19T16:17:38.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f406359e640 1 --2- 172.21.15.119:0/3564977516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40640ca000 0x7f4064070df0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f406406e280 tx=0x7f405c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d72ad7ad215d04 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f406259c640 1 -- 172.21.15.119:0/3564977516 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0a57d0 con 0x7f40640ca000 2023-12-19T16:17:38.693 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f406259c640 1 -- 172.21.15.119:0/3564977516 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c0a5930 con 0x7f40640ca000 2023-12-19T16:17:38.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f406259c640 1 -- 172.21.15.119:0/3564977516 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0a5cc0 con 0x7f40640ca000 2023-12-19T16:17:38.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- 172.21.15.119:0/3564977516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40640ca000 msgr2=0x7f4064070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.694 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 --2- 172.21.15.119:0/3564977516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40640ca000 0x7f4064070df0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f406406e280 tx=0x7f405c01c910 comp rx=0 tx=0).stop 2023-12-19T16:17:38.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- 172.21.15.119:0/3564977516 shutdown_connections 2023-12-19T16:17:38.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 --2- 172.21.15.119:0/3564977516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40640ca000 0x7f4064070df0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 --2- 172.21.15.119:0/3564977516 >> v2:172.21.15.143:3300/0 conn(0x7f40641570c0 0x7f406406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- 172.21.15.119:0/3564977516 >> 172.21.15.119:0/3564977516 conn(0x7f406406a3e0 msgr2=0x7f40640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:38.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- 172.21.15.119:0/3564977516 shutdown_connections 2023-12-19T16:17:38.695 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- 172.21.15.119:0/3564977516 wait complete. 2023-12-19T16:17:38.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 Processor -- start 2023-12-19T16:17:38.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- start start 2023-12-19T16:17:38.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 0x7f40640c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640ca000 0x7f40640c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641570c0 0x7f406414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641462e0 con 0x7f406406c320 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40640c8070 con 0x7f40641570c0 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.692+0000 7f40691ce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40640c5540 con 0x7f40640ca000 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 0x7f40640c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 0x7f40640c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46790/0 (socket says 172.21.15.119:46790) 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 -- 172.21.15.119:0/705262104 learned_addr learned my addr 172.21.15.119:0/705262104 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f406359e640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641570c0 0x7f406414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405bfff640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640ca000 0x7f40640c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 -- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640ca000 msgr2=0x7f40640c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640ca000 0x7f40640c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 -- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641570c0 msgr2=0x7f406414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.699 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641570c0 0x7f406414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 -- 172.21.15.119:0/705262104 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009b30 con 0x7f406406c320 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f4062d9d640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 0x7f40640c7b30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f405400d800 tx=0x7f405400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400b6c0 con 0x7f406406c320 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405400b820 con 0x7f406406c320 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40640c5820 con 0x7f406406c320 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400bb90 con 0x7f406406c320 2023-12-19T16:17:38.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40640c5de0 con 0x7f406406c320 2023-12-19T16:17:38.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40640735b0 con 0x7f406406c320 2023-12-19T16:17:38.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f405400bcf0 con 0x7f406406c320 2023-12-19T16:17:38.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405b7fe640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4044065a90 0x7f4044067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:38.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.696+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f4054083970 con 0x7f406406c320 2023-12-19T16:17:38.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.700+0000 7f405bfff640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4044065a90 0x7f4044067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:38.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.700+0000 7f405bfff640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4044065a90 0x7f4044067f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f40640c84c0 tx=0x7f404c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:38.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.700+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4054051060 con 0x7f406406c320 2023-12-19T16:17:38.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.880+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f406404e000 con 0x7f406406c320 2023-12-19T16:17:38.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.880+0000 7f405b7fe640 1 -- 172.21.15.119:0/705262104 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f4054054680 con 0x7f406406c320 2023-12-19T16:17:38.885 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:38.885 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:43.714510+0000","modified":"2023-12-19T16:16:58.585749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6835/985218590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":985218590},{"type":"v1","addr":"172.21.15.143:6835","nonce":985218590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:38.885 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4044065a90 msgr2=0x7f4044067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4044065a90 0x7f4044067f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f40640c84c0 tx=0x7f404c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 msgr2=0x7f40640c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 0x7f40640c7b30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f405400d800 tx=0x7f405400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 shutdown_connections 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4044065a90 0x7f4044067f50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641570c0 0x7f406414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640ca000 0x7f40640c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 --2- 172.21.15.119:0/705262104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f406406c320 0x7f40640c7b30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:38.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 >> 172.21.15.119:0/705262104 conn(0x7f406406a3e0 msgr2=0x7f406414ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:38.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 shutdown_connections 2023-12-19T16:17:38.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:38.884+0000 7f40691ce640 1 -- 172.21.15.119:0/705262104 wait complete. 2023-12-19T16:17:38.906 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:39.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 Processor -- start 2023-12-19T16:17:39.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 -- start start 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7880ae040 0x7fa78806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa78806d170 0x7fa7880cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7880ce290 0x7fa7880c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880ce720 con 0x7fa78806d170 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880cccf0 con 0x7fa7880ae040 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa79052c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880ae420 con 0x7fa7880ce290 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa78806d170 0x7fa7880cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa78806d170 0x7fa7880cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46802/0 (socket says 172.21.15.119:46802) 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 -- 172.21.15.119:0/426634758 learned_addr learned my addr 172.21.15.119:0/426634758 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78eac9640 1 --2- 172.21.15.119:0/426634758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7880ce290 0x7fa7880c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78e2c8640 1 --2- 172.21.15.119:0/426634758 >> v2:172.21.15.143:3300/0 conn(0x7fa7880ae040 0x7fa78806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 -- 172.21.15.119:0/426634758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7880ce290 msgr2=0x7fa7880c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 --2- 172.21.15.119:0/426634758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7880ce290 0x7fa7880c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 -- 172.21.15.119:0/426634758 >> v2:172.21.15.143:3300/0 conn(0x7fa7880ae040 msgr2=0x7fa78806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.040+0000 7fa78dac7640 1 --2- 172.21.15.119:0/426634758 >> v2:172.21.15.143:3300/0 conn(0x7fa7880ae040 0x7fa78806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa78dac7640 1 -- 172.21.15.119:0/426634758 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880ccf90 con 0x7fa78806d170 2023-12-19T16:17:39.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa78e2c8640 1 --2- 172.21.15.119:0/426634758 >> v2:172.21.15.143:3300/0 conn(0x7fa7880ae040 0x7fa78806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:39.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa78dac7640 1 --2- 172.21.15.119:0/426634758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78806d170 0x7fa7880cdd50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa7880b4d00 tx=0x7fa77801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa32fca1ca0666f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa78d2c6640 1 -- 172.21.15.119:0/426634758 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780ac600 con 0x7fa78806d170 2023-12-19T16:17:39.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa78d2c6640 1 -- 172.21.15.119:0/426634758 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780a8050 con 0x7fa78806d170 2023-12-19T16:17:39.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa78d2c6640 1 -- 172.21.15.119:0/426634758 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780ac980 con 0x7fa78806d170 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 -- 172.21.15.119:0/426634758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78806d170 msgr2=0x7fa7880cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 --2- 172.21.15.119:0/426634758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78806d170 0x7fa7880cdd50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa7880b4d00 tx=0x7fa77801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 -- 172.21.15.119:0/426634758 shutdown_connections 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 --2- 172.21.15.119:0/426634758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7880ce290 0x7fa7880c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 --2- 172.21.15.119:0/426634758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78806d170 0x7fa7880cdd50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 --2- 172.21.15.119:0/426634758 >> v2:172.21.15.143:3300/0 conn(0x7fa7880ae040 0x7fa78806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 -- 172.21.15.119:0/426634758 >> 172.21.15.119:0/426634758 conn(0x7fa7880cb610 msgr2=0x7fa7880cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 -- 172.21.15.119:0/426634758 shutdown_connections 2023-12-19T16:17:39.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.044+0000 7fa79052c640 1 -- 172.21.15.119:0/426634758 wait complete. 2023-12-19T16:17:39.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 Processor -- start 2023-12-19T16:17:39.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 -- start start 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa78806d170 0x7fa788154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 0x7fa7880b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7880ce290 0x7fa7880c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa788159ff0 con 0x7fa7880ae040 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815a2b0 con 0x7fa7880ce290 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815a590 con 0x7fa78806d170 2023-12-19T16:17:39.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 0x7fa7880b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 0x7fa7880b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46818/0 (socket says 172.21.15.119:46818) 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 -- 172.21.15.119:0/2147834600 learned_addr learned my addr 172.21.15.119:0/2147834600 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78eac9640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7880ce290 0x7fa7880c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78e2c8640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa78806d170 0x7fa788154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 -- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa78806d170 msgr2=0x7fa788154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa78806d170 0x7fa788154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 -- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7880ce290 msgr2=0x7fa7880c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7880ce290 0x7fa7880c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 -- 172.21.15.119:0/2147834600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094d0 con 0x7fa7880ae040 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa78dac7640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 0x7fa7880b38c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa77801ab80 tx=0x7fa77801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780b7450 con 0x7fa7880ae040 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780b75b0 con 0x7fa7880ae040 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78815a870 con 0x7fa7880ae040 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.048+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780b7920 con 0x7fa7880ae040 2023-12-19T16:17:39.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa788154e40 con 0x7fa7880ae040 2023-12-19T16:17:39.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78815ad90 con 0x7fa7880ae040 2023-12-19T16:17:39.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7780b3070 con 0x7fa7880ae040 2023-12-19T16:17:39.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa77effd640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa76c065a90 0x7fa76c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fa77811d9d0 con 0x7fa7880ae040 2023-12-19T16:17:39.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa78e2c8640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa76c065a90 0x7fa76c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.052+0000 7fa78e2c8640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa76c065a90 0x7fa76c067f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa7880ad850 tx=0x7fa784008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.056+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa78815ad90 con 0x7fa7880ae040 2023-12-19T16:17:39.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.207+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa78815ad90 con 0x7fa7880ae040 2023-12-19T16:17:39.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.207+0000 7fa77effd640 1 -- 172.21.15.119:0/2147834600 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18133 (secure 0 0 0) 0x7fa78815ad90 con 0x7fa7880ae040 2023-12-19T16:17:39.212 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:16:59.588351+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:42.059055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:42.708109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-19T16:16:57.390246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:39.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa76c065a90 msgr2=0x7fa76c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa76c065a90 0x7fa76c067f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa7880ad850 tx=0x7fa784008040 comp rx=0 tx=0).stop 2023-12-19T16:17:39.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 msgr2=0x7fa7880b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 0x7fa7880b38c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa77801ab80 tx=0x7fa77801ad10 comp rx=0 tx=0).stop 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 shutdown_connections 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa76c065a90 0x7fa76c067f50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7880ce290 0x7fa7880c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7880ae040 0x7fa7880b38c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 --2- 172.21.15.119:0/2147834600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa78806d170 0x7fa788154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 >> 172.21.15.119:0/2147834600 conn(0x7fa7880cb610 msgr2=0x7fa788155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 shutdown_connections 2023-12-19T16:17:39.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.211+0000 7fa79052c640 1 -- 172.21.15.119:0/2147834600 wait complete. 2023-12-19T16:17:39.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:17:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.371+0000 7f50ff2f9640 1 Processor -- start 2023-12-19T16:17:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.371+0000 7f50ff2f9640 1 -- start start 2023-12-19T16:17:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50ff2f9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f50f81570c0 0x7f50f806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50ff2f9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f806c320 0x7f50f80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50ff2f9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f80c9460 con 0x7f50f80c9e30 2023-12-19T16:17:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50ff2f9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f806c7a0 con 0x7f50f806c320 2023-12-19T16:17:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50ff2f9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f81574a0 con 0x7f50f81570c0 2023-12-19T16:17:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f806c320 0x7f50f80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f806c320 0x7f50f80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46824/0 (socket says 172.21.15.119:46824) 2023-12-19T16:17:39.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 -- 172.21.15.119:0/1518899287 learned_addr learned my addr 172.21.15.119:0/1518899287 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:39.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fd095640 1 --2- 172.21.15.119:0/1518899287 >> v2:172.21.15.143:3300/0 conn(0x7f50f81570c0 0x7f50f806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 -- 172.21.15.119:0/1518899287 >> v2:172.21.15.143:3300/0 conn(0x7f50f81570c0 msgr2=0x7f50f806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 --2- 172.21.15.119:0/1518899287 >> v2:172.21.15.143:3300/0 conn(0x7f50f81570c0 0x7f50f806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 -- 172.21.15.119:0/1518899287 >> v1:172.21.15.143:6789/0 conn(0x7f50f80c9e30 legacy=0x7f50f815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50fc894640 1 -- 172.21.15.119:0/1518899287 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80c8b30 con 0x7f50f806c320 2023-12-19T16:17:39.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.375+0000 7f50effff640 1 -- 172.21.15.119:0/1518899287 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802336826 0 0) 0x7f50f80c9460 con 0x7f50f80c9e30 2023-12-19T16:17:39.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50fc894640 1 --2- 172.21.15.119:0/1518899287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c98f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f50f806e280 tx=0x7f50e801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97dc40879adcf6a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50effff640 1 -- 172.21.15.119:0/1518899287 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80a7af0 con 0x7f50f806c320 2023-12-19T16:17:39.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50effff640 1 -- 172.21.15.119:0/1518899287 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e80a7c50 con 0x7f50f806c320 2023-12-19T16:17:39.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50effff640 1 -- 172.21.15.119:0/1518899287 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80af440 con 0x7f50f806c320 2023-12-19T16:17:39.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1518899287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 msgr2=0x7f50f80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1518899287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c98f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f50f806e280 tx=0x7f50e801eb10 comp rx=0 tx=0).stop 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1518899287 shutdown_connections 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1518899287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c98f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1518899287 >> v2:172.21.15.143:3300/0 conn(0x7f50f81570c0 0x7f50f806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1518899287 >> 172.21.15.119:0/1518899287 conn(0x7f50f806a3e0 msgr2=0x7f50f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1518899287 shutdown_connections 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1518899287 wait complete. 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 Processor -- start 2023-12-19T16:17:39.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.379+0000 7f50ff2f9640 1 -- start start 2023-12-19T16:17:39.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50f80c9e30 0x7f50f8146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50f81570c0 0x7f50f8157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f81f9460 con 0x7f50f806c320 2023-12-19T16:17:39.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80c5970 con 0x7f50f81570c0 2023-12-19T16:17:39.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f81f9950 con 0x7f50f80c9e30 2023-12-19T16:17:39.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46826/0 (socket says 172.21.15.119:46826) 2023-12-19T16:17:39.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 -- 172.21.15.119:0/1292375667 learned_addr learned my addr 172.21.15.119:0/1292375667 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:39.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd896640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50f81570c0 0x7f50f8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fc894640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50f80c9e30 0x7f50f8146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 -- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50f80c9e30 msgr2=0x7f50f8146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50f80c9e30 0x7f50f8146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 -- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50f81570c0 msgr2=0x7f50f8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50f81570c0 0x7f50f8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 -- 172.21.15.119:0/1292375667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e800b770 con 0x7f50f806c320 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd896640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50f81570c0 0x7f50f8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50fd095640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c5430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50f400e930 tx=0x7f50f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4009690 con 0x7f50f806c320 2023-12-19T16:17:39.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f400ca00 con 0x7f50f806c320 2023-12-19T16:17:39.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f81f9670 con 0x7f50f806c320 2023-12-19T16:17:39.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400cd70 con 0x7f50f806c320 2023-12-19T16:17:39.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f80c7280 con 0x7f50f806c320 2023-12-19T16:17:39.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f80735b0 con 0x7f50f806c320 2023-12-19T16:17:39.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.383+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50f4013470 con 0x7f50f806c320 2023-12-19T16:17:39.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.387+0000 7f50edffb640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f50dc065a90 0x7f50dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.387+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f50f4083740 con 0x7f50f806c320 2023-12-19T16:17:39.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.387+0000 7f50fc894640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f50dc065a90 0x7f50dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.387+0000 7f50fc894640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f50dc065a90 0x7f50dc067f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f50e80b1000 tx=0x7f50e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.391+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f50f4050e50 con 0x7f50f806c320 2023-12-19T16:17:39.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.571+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f50f80c6e00 con 0x7f50f806c320 2023-12-19T16:17:39.577 INFO:tasks.ceph.mon.a.smithi119.stderr:2023-12-19T16:17:39.575+0000 7f5651957640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:17:39.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50edffb640 1 -- 172.21.15.119:0/1292375667 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f50f80c6e00 con 0x7f50f806c320 2023-12-19T16:17:39.591 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:17:39.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f50dc065a90 msgr2=0x7f50dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f50dc065a90 0x7f50dc067f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f50e80b1000 tx=0x7f50e8008040 comp rx=0 tx=0).stop 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 msgr2=0x7f50f80c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c5430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50f400e930 tx=0x7f50f400edf0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 shutdown_connections 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f50dc065a90 0x7f50dc067f50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50f81570c0 0x7f50f8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50f80c9e30 0x7f50f8146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 --2- 172.21.15.119:0/1292375667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f806c320 0x7f50f80c5430 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 >> 172.21.15.119:0/1292375667 conn(0x7f50f806a3e0 msgr2=0x7f50f815ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 shutdown_connections 2023-12-19T16:17:39.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.587+0000 7f50ff2f9640 1 -- 172.21.15.119:0/1292375667 wait complete. 2023-12-19T16:17:39.600 INFO:tasks.ceph.mds.b.smithi143.stderr: -3657> 2023-12-19T16:16:47.797+0000 7f9d19dec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:17:39.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:17:39.650 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-19T16:17:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c7de9640 1 Processor -- start 2023-12-19T16:17:39.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c7de9640 1 -- start start 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c7de9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff6c00ca410 0x7ff6c0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c7de9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c0070df0 con 0x7ff6c00cbff0 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c7de9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c015a4f0 con 0x7ff6c0159fb0 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c7de9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c015aab0 con 0x7ff6c00ca410 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c5b85640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff6c00ca410 0x7ff6c0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c6386640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff6c00cbff0 0x7ff6c00ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60094/0 (socket says 172.21.15.119:60094) 2023-12-19T16:17:39.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c6386640 1 -- 172.21.15.119:0/2638990725 learned_addr learned my addr 172.21.15.119:0/2638990725 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:39.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c4b83640 1 -- 172.21.15.119:0/2638990725 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551576846 0 0) 0x7ff6c015a4f0 con 0x7ff6c0159fb0 2023-12-19T16:17:39.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c5b85640 1 -- 172.21.15.119:0/2638990725 >> v1:172.21.15.143:6789/0 conn(0x7ff6c0159fb0 legacy=0x7ff6c0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c5b85640 1 -- 172.21.15.119:0/2638990725 >> v1:172.21.15.119:6789/0 conn(0x7ff6c00cbff0 legacy=0x7ff6c00ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.751+0000 7ff6c5b85640 1 -- 172.21.15.119:0/2638990725 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c015a7d0 con 0x7ff6c00ca410 2023-12-19T16:17:39.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c5b85640 1 --2- 172.21.15.119:0/2638990725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c0159a70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0097c0 tx=0x7ff6bc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e890aeab46296c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c4b83640 1 -- 172.21.15.119:0/2638990725 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0ab600 con 0x7ff6c00ca410 2023-12-19T16:17:39.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c4b83640 1 -- 172.21.15.119:0/2638990725 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0a7050 con 0x7ff6c00ca410 2023-12-19T16:17:39.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c4b83640 1 -- 172.21.15.119:0/2638990725 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0ab980 con 0x7ff6c00ca410 2023-12-19T16:17:39.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 -- 172.21.15.119:0/2638990725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 msgr2=0x7ff6c0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/2638990725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c0159a70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0097c0 tx=0x7ff6bc01c310 comp rx=0 tx=0).stop 2023-12-19T16:17:39.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 -- 172.21.15.119:0/2638990725 shutdown_connections 2023-12-19T16:17:39.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/2638990725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c0159a70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 -- 172.21.15.119:0/2638990725 >> 172.21.15.119:0/2638990725 conn(0x7ff6c006a2a0 msgr2=0x7ff6c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 -- 172.21.15.119:0/2638990725 shutdown_connections 2023-12-19T16:17:39.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.755+0000 7ff6c7de9640 1 -- 172.21.15.119:0/2638990725 wait complete. 2023-12-19T16:17:39.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 Processor -- start 2023-12-19T16:17:39.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 -- start start 2023-12-19T16:17:39.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c01f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6c00cbff0 0x7ff6c00c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c0159fb0 0x7ff6c01f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00c2990 con 0x7ff6c00ca410 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00c2c70 con 0x7ff6c0159fb0 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00c2f50 con 0x7ff6c00cbff0 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c01f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c01f1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46836/0 (socket says 172.21.15.119:46836) 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 -- 172.21.15.119:0/3172426290 learned_addr learned my addr 172.21.15.119:0/3172426290 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c6386640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c0159fb0 0x7ff6c01f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5384640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6c00cbff0 0x7ff6c00c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 -- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6c00cbff0 msgr2=0x7ff6c00c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6c00cbff0 0x7ff6c00c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 -- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c0159fb0 msgr2=0x7ff6c01f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c0159fb0 0x7ff6c01f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 -- 172.21.15.119:0/3172426290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc009420 con 0x7ff6c00ca410 2023-12-19T16:17:39.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c5b85640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c01f1530 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ae040 tx=0x7ff6bc01ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0b7920 con 0x7ff6c00ca410 2023-12-19T16:17:39.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0b7aa0 con 0x7ff6c00ca410 2023-12-19T16:17:39.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0b7e50 con 0x7ff6c00ca410 2023-12-19T16:17:39.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c00c3230 con 0x7ff6c00ca410 2023-12-19T16:17:39.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.759+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c00c1f20 con 0x7ff6c00ca410 2023-12-19T16:17:39.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.763+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c004e000 con 0x7ff6c00ca410 2023-12-19T16:17:39.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.763+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6bc0aa420 con 0x7ff6c00ca410 2023-12-19T16:17:39.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.763+0000 7ff6b67fc640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff6a4065a60 0x7ff6a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.763+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6510+0+0 (secure 0 0 0) 0x7ff6bc11dff0 con 0x7ff6c00ca410 2023-12-19T16:17:39.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.763+0000 7ff6c5384640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff6a4065a60 0x7ff6a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.763+0000 7ff6c5384640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff6a4065a60 0x7ff6a4067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00cbf40 tx=0x7ff6b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.767+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff6bc0eb790 con 0x7ff6c00ca410 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:39.951+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff6c0159af0 con 0x7ff6c00ca410 2023-12-19T16:17:40.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6b67fc640 1 -- 172.21.15.119:0/3172426290 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6bc0eedb0 con 0x7ff6c00ca410 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff6a4065a60 msgr2=0x7ff6a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff6a4065a60 0x7ff6a4067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00cbf40 tx=0x7ff6b0009040 comp rx=0 tx=0).stop 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 msgr2=0x7ff6c01f1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c01f1530 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ae040 tx=0x7ff6bc01ab50 comp rx=0 tx=0).stop 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 shutdown_connections 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff6a4065a60 0x7ff6a4067f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6c0159fb0 0x7ff6c01f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6c00cbff0 0x7ff6c00c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 --2- 172.21.15.119:0/3172426290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6c00ca410 0x7ff6c01f1530 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.591+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 >> 172.21.15.119:0/3172426290 conn(0x7ff6c006a2a0 msgr2=0x7ff6c00c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.595+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 shutdown_connections 2023-12-19T16:17:40.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.595+0000 7ff6c7de9640 1 -- 172.21.15.119:0/3172426290 wait complete. 2023-12-19T16:17:40.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:17:40.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ffa36c640 1 Processor -- start 2023-12-19T16:17:40.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ffa36c640 1 -- start start 2023-12-19T16:17:40.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ffa36c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ff40c8ed0 0x7f5ff415c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ffa36c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff4070a10 con 0x7f5ff4153200 2023-12-19T16:17:40.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ffa36c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff415d590 con 0x7f5ff4070ea0 2023-12-19T16:17:40.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ffa36c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff4071d60 con 0x7f5ff40c8ed0 2023-12-19T16:17:40.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5ff4153200 0x7f5ff40b0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:60102/0 (socket says 172.21.15.119:60102) 2023-12-19T16:17:40.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 -- 172.21.15.119:0/3807049829 learned_addr learned my addr 172.21.15.119:0/3807049829 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:40.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff9b6b640 1 --2- 172.21.15.119:0/3807049829 >> v2:172.21.15.143:3300/0 conn(0x7f5ff40c8ed0 0x7f5ff415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311204379 0 0) 0x7f5ff4070a10 con 0x7f5ff4153200 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe0003530 con 0x7f5ff4153200 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227420008 0 0) 0x7f5ff415d590 con 0x7f5ff4070ea0 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4070a10 con 0x7f5ff4070ea0 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870341264 0 0) 0x7f5fe0003530 con 0x7f5ff4153200 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 >> v2:172.21.15.143:3300/0 conn(0x7f5ff40c8ed0 msgr2=0x7f5ff415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:40.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 --2- 172.21.15.119:0/3807049829 >> v2:172.21.15.143:3300/0 conn(0x7f5ff40c8ed0 0x7f5ff415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 >> v1:172.21.15.143:6789/0 conn(0x7f5ff4070ea0 legacy=0x7f5ff40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff415d2b0 con 0x7f5ff4153200 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f5ff0001680 con 0x7f5ff4153200 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff9b6b640 1 --2- 172.21.15.119:0/3807049829 >> v2:172.21.15.143:3300/0 conn(0x7f5ff40c8ed0 0x7f5ff415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 >> v1:172.21.15.119:6789/0 conn(0x7f5ff4153200 legacy=0x7f5ff40b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe0003b10 0x7f5fe0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0005190 0x7f5fe000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe000e1f0 con 0x7f5fe0003b10 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe000e360 con 0x7f5fe0005190 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe000e520 con 0x7f5fe00047d0 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe0003b10 0x7f5fe0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff9b6b640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0005190 0x7f5fe000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff8b69640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 -- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00047d0 msgr2=0x7f5fe0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 -- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0005190 msgr2=0x7f5fe000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0005190 0x7f5fe000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff936a640 1 -- 172.21.15.119:0/3807049829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0003530 con 0x7f5fe0003b10 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.759+0000 7f5ff9b6b640 1 -- 172.21.15.119:0/3807049829 reap_dead start 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ff936a640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe0003b10 0x7f5fe0003f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c190 tx=0x7f5ff001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4f81a3dc55266c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:40.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00058e0 con 0x7f5fe0003b10 2023-12-19T16:17:40.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0005a40 con 0x7f5fe0003b10 2023-12-19T16:17:40.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5febfff640 1 -- 172.21.15.119:0/3807049829 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0005e50 con 0x7f5fe0003b10 2023-12-19T16:17:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 -- 172.21.15.119:0/3807049829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe0003b10 msgr2=0x7f5fe0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe0003b10 0x7f5fe0003f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c190 tx=0x7f5ff001cbc0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 -- 172.21.15.119:0/3807049829 shutdown_connections 2023-12-19T16:17:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/3807049829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe0003b10 0x7f5fe0003f10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 -- 172.21.15.119:0/3807049829 >> 172.21.15.119:0/3807049829 conn(0x7f5ff406a2a0 msgr2=0x7f5ff40afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 -- 172.21.15.119:0/3807049829 shutdown_connections 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.763+0000 7f5ffa36c640 1 -- 172.21.15.119:0/3807049829 wait complete. 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 Processor -- start 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 -- start start 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0003b10 0x7f5ff40c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ff41541e0 0x7f5ff41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 0x7f5ff40c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40c34f0 con 0x7f5ff40c96d0 2023-12-19T16:17:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40ca090 con 0x7f5fe0003b10 2023-12-19T16:17:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40c2bf0 con 0x7f5ff41541e0 2023-12-19T16:17:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 0x7f5ff40c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 0x7f5ff40c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46852/0 (socket says 172.21.15.119:46852) 2023-12-19T16:17:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 -- 172.21.15.119:0/1208014174 learned_addr learned my addr 172.21.15.119:0/1208014174 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff936a640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0003b10 0x7f5ff40c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 -- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ff41541e0 msgr2=0x7f5ff41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ff41541e0 0x7f5ff41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 -- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0003b10 msgr2=0x7f5ff40c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0003b10 0x7f5ff40c26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 -- 172.21.15.119:0/1208014174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4154750 con 0x7f5ff40c96d0 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ff9b6b640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 0x7f5ff40c9b50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4156c40 tx=0x7f5fec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00e040 con 0x7f5ff40c96d0 2023-12-19T16:17:40.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00f040 con 0x7f5ff40c96d0 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff4154a30 con 0x7f5ff40c96d0 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec003be0 con 0x7f5ff40c96d0 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.767+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff40b0d50 con 0x7f5ff40c96d0 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.771+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff40c3630 con 0x7f5ff40c96d0 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.771+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fec015430 con 0x7f5ff40c96d0 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.771+0000 7f5fe9ffb640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fd8065a60 0x7f5fd8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.771+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6510+0+0 (secure 0 0 0) 0x7f5fec083d70 con 0x7f5ff40c96d0 2023-12-19T16:17:40.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.771+0000 7f5ff936a640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fd8065a60 0x7f5fd8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.771+0000 7f5ff936a640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fd8065a60 0x7f5fd8067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00aa000 tx=0x7f5ff0001990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:40.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.775+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5ff40c3630 con 0x7f5ff40c96d0 2023-12-19T16:17:40.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:40.927+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ff40c3630 con 0x7f5ff40c96d0 2023-12-19T16:17:41.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.595+0000 7f5fe9ffb640 1 -- 172.21.15.119:0/1208014174 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5ff40c3630 con 0x7f5ff40c96d0 2023-12-19T16:17:41.600 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:17:41.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fd8065a60 msgr2=0x7f5fd8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fd8065a60 0x7f5fd8067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00aa000 tx=0x7f5ff0001990 comp rx=0 tx=0).stop 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 msgr2=0x7f5ff40c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 0x7f5ff40c9b50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4156c40 tx=0x7f5fec009f90 comp rx=0 tx=0).stop 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 shutdown_connections 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5fd8065a60 0x7f5fd8067f20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff40c96d0 0x7f5ff40c9b50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ff41541e0 0x7f5ff41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 --2- 172.21.15.119:0/1208014174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5fe0003b10 0x7f5ff40c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 >> 172.21.15.119:0/1208014174 conn(0x7f5ff406a2a0 msgr2=0x7f5ff40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 shutdown_connections 2023-12-19T16:17:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.599+0000 7f5ffa36c640 1 -- 172.21.15.119:0/1208014174 wait complete. 2023-12-19T16:17:41.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:17:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 Processor -- start 2023-12-19T16:17:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 -- start start 2023-12-19T16:17:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa7400ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7400c89f0 0x7fa7400c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400ad6e0 con 0x7fa7400ce6a0 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa740159b20 con 0x7fa7400c89f0 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.763+0000 7fa747d39640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400ad9c0 con 0x7fa7400ca200 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7400c89f0 0x7fa7400c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7400c89f0 0x7fa7400c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46864/0 (socket says 172.21.15.119:46864) 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 -- 172.21.15.119:0/3449588810 learned_addr learned my addr 172.21.15.119:0/3449588810 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7452d4640 1 --2- 172.21.15.119:0/3449588810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa7400ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 -- 172.21.15.119:0/3449588810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 msgr2=0x7fa7400ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 --2- 172.21.15.119:0/3449588810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa7400ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 -- 172.21.15.119:0/3449588810 >> v1:172.21.15.143:6789/0 conn(0x7fa7400ce6a0 legacy=0x7fa7400cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 -- 172.21.15.119:0/3449588810 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74006be20 con 0x7fa7400c89f0 2023-12-19T16:17:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa7462d6640 1 --2- 172.21.15.119:0/3449588810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400c89f0 0x7fa7400c8e80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa738009e50 tx=0x7fa73801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f8f210e7d80880 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa744ad3640 1 -- 172.21.15.119:0/3449588810 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380a58d0 con 0x7fa7400c89f0 2023-12-19T16:17:41.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa744ad3640 1 -- 172.21.15.119:0/3449588810 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380a5a30 con 0x7fa7400c89f0 2023-12-19T16:17:41.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.767+0000 7fa744ad3640 1 -- 172.21.15.119:0/3449588810 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380a5dc0 con 0x7fa7400c89f0 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- 172.21.15.119:0/3449588810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400c89f0 msgr2=0x7fa7400c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 --2- 172.21.15.119:0/3449588810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400c89f0 0x7fa7400c8e80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa738009e50 tx=0x7fa73801c9e0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- 172.21.15.119:0/3449588810 shutdown_connections 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 --2- 172.21.15.119:0/3449588810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400c89f0 0x7fa7400c8e80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 --2- 172.21.15.119:0/3449588810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa7400ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- 172.21.15.119:0/3449588810 >> 172.21.15.119:0/3449588810 conn(0x7fa740069e70 msgr2=0x7fa74006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- 172.21.15.119:0/3449588810 shutdown_connections 2023-12-19T16:17:41.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- 172.21.15.119:0/3449588810 wait complete. 2023-12-19T16:17:41.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 Processor -- start 2023-12-19T16:17:41.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- start start 2023-12-19T16:17:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7400c89f0 0x7fa7400b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa740156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 0x7fa7400cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74015ac70 con 0x7fa7400ce6a0 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740157010 con 0x7fa7400c89f0 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa747d39640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401572b0 con 0x7fa7400ca200 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 0x7fa7400cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 0x7fa7400cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46872/0 (socket says 172.21.15.119:46872) 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 -- 172.21.15.119:0/4195356905 learned_addr learned my addr 172.21.15.119:0/4195356905 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa745ad5640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7400c89f0 0x7fa7400b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7452d4640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa740156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 -- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 msgr2=0x7fa740156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa740156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 -- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7400c89f0 msgr2=0x7fa7400b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7400c89f0 0x7fa7400b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 -- 172.21.15.119:0/4195356905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738009b30 con 0x7fa7400ce6a0 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.771+0000 7fa7462d6640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 0x7fa7400cae00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa7380af040 tx=0x7fa738019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380b8880 con 0x7fa7400ce6a0 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380b8a00 con 0x7fa7400ce6a0 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380b8db0 con 0x7fa7400ce6a0 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74006cd60 con 0x7fa7400ce6a0 2023-12-19T16:17:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa740157870 con 0x7fa7400ce6a0 2023-12-19T16:17:41.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74015adb0 con 0x7fa7400ce6a0 2023-12-19T16:17:41.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7380b6440 con 0x7fa7400ce6a0 2023-12-19T16:17:41.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa7367fc640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa724065a60 0x7fa724067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6072+0+0 (secure 0 0 0) 0x7fa73811e860 con 0x7fa7400ce6a0 2023-12-19T16:17:41.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.775+0000 7fa745ad5640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa724065a60 0x7fa724067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.779+0000 7fa745ad5640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa724065a60 0x7fa724067f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa73c007fd0 tx=0x7fa73c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:41.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.779+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa74015adb0 con 0x7fa7400ce6a0 2023-12-19T16:17:41.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:41.931+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa74015adb0 con 0x7fa7400ce6a0 2023-12-19T16:17:42.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.595+0000 7fa7367fc640 1 -- 172.21.15.119:0/4195356905 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa74015adb0 con 0x7fa7400ce6a0 2023-12-19T16:17:42.602 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2023-12-19T16:17:42.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa724065a60 msgr2=0x7fa724067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:42.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa724065a60 0x7fa724067f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa73c007fd0 tx=0x7fa73c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 msgr2=0x7fa7400cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 0x7fa7400cae00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa7380af040 tx=0x7fa738019780 comp rx=0 tx=0).stop 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 shutdown_connections 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa724065a60 0x7fa724067f20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7400ce6a0 0x7fa7400cae00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7400ca200 0x7fa740156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 --2- 172.21.15.119:0/4195356905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7400c89f0 0x7fa7400b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.599+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 >> 172.21.15.119:0/4195356905 conn(0x7fa740069e70 msgr2=0x7fa740072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.603+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 shutdown_connections 2023-12-19T16:17:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.603+0000 7fa747d39640 1 -- 172.21.15.119:0/4195356905 wait complete. 2023-12-19T16:17:42.628 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-12-19T16:17:42.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 Processor -- start 2023-12-19T16:17:42.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 -- start start 2023-12-19T16:17:42.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f06540ce5d0 0x7f06540ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:42.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:42.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540b28a0 con 0x7f065415e2d0 2023-12-19T16:17:42.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540ac1a0 con 0x7f06540ce5d0 2023-12-19T16:17:42.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0659db3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540ceef0 con 0x7f065406d440 2023-12-19T16:17:42.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f06540ce5d0 0x7f06540ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:42.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f0652ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:42.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f06540ce5d0 0x7f06540ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:53652/0 (socket says 172.21.15.119:53652) 2023-12-19T16:17:42.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 -- 172.21.15.119:0/4281569809 learned_addr learned my addr 172.21.15.119:0/4281569809 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:42.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 -- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 msgr2=0x7f065406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:42.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 --2- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065406d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 -- 172.21.15.119:0/4281569809 >> v1:172.21.15.143:6789/0 conn(0x7f065415e2d0 legacy=0x7f065415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:42.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.771+0000 7f06537fe640 1 -- 172.21.15.119:0/4281569809 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065415ab30 con 0x7f06540ce5d0 2023-12-19T16:17:42.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f06537fe640 1 --2- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06540ce5d0 0x7f06540ce9b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0644009870 tx=0x7f064401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df5f1566397318be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:42.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f06527fc640 1 -- 172.21.15.119:0/4281569809 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440aa670 con 0x7f06540ce5d0 2023-12-19T16:17:42.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f06527fc640 1 -- 172.21.15.119:0/4281569809 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06440aa7d0 con 0x7f06540ce5d0 2023-12-19T16:17:42.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f06527fc640 1 -- 172.21.15.119:0/4281569809 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440aab60 con 0x7f06540ce5d0 2023-12-19T16:17:42.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 -- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06540ce5d0 msgr2=0x7f06540ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 --2- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06540ce5d0 0x7f06540ce9b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0644009870 tx=0x7f064401c510 comp rx=0 tx=0).stop 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 -- 172.21.15.119:0/4281569809 shutdown_connections 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 --2- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 --2- 172.21.15.119:0/4281569809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06540ce5d0 0x7f06540ce9b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 -- 172.21.15.119:0/4281569809 >> 172.21.15.119:0/4281569809 conn(0x7f0654069e70 msgr2=0x7f065406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 -- 172.21.15.119:0/4281569809 shutdown_connections 2023-12-19T16:17:42.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.775+0000 7f0659db3640 1 -- 172.21.15.119:0/4281569809 wait complete. 2023-12-19T16:17:42.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 Processor -- start 2023-12-19T16:17:42.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 -- start start 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 0x7f06540c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065415e2d0 0x7f0654158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540c59b0 con 0x7f06540ce5d0 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540c6480 con 0x7f065415e2d0 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065415aed0 con 0x7f065406d440 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 0x7f06540c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 0x7f06540c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48122/0 (socket says 172.21.15.119:48122) 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 -- 172.21.15.119:0/4263032708 learned_addr learned my addr 172.21.15.119:0/4263032708 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0653fff640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065415e2d0 0x7f0654158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f06537fe640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:42.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 -- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 msgr2=0x7f065415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 -- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065415e2d0 msgr2=0x7f0654158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065415e2d0 0x7f0654158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 -- 172.21.15.119:0/4263032708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440094d0 con 0x7f06540ce5d0 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0652ffd640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 0x7f06540c5470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f064800e870 tx=0x7f064800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648009510 con 0x7f06540ce5d0 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800eec0 con 0x7f06540ce5d0 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800cb40 con 0x7f06540ce5d0 2023-12-19T16:17:42.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06540c5be0 con 0x7f06540ce5d0 2023-12-19T16:17:42.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.779+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06540c61a0 con 0x7f06540ce5d0 2023-12-19T16:17:42.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.783+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06540b2d10 con 0x7f06540ce5d0 2023-12-19T16:17:42.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.783+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f064800cca0 con 0x7f06540ce5d0 2023-12-19T16:17:42.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.783+0000 7f063bfff640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0640065a60 0x7f0640067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:42.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.783+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5658+0+0 (secure 0 0 0) 0x7f0648083260 con 0x7f06540ce5d0 2023-12-19T16:17:42.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.783+0000 7f06537fe640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0640065a60 0x7f0640067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:42.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.787+0000 7f06537fe640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0640065a60 0x7f0640067f20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06440ae000 tx=0x7f06440b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:42.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.787+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f06540b2d10 con 0x7f06540ce5d0 2023-12-19T16:17:42.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:42.939+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f06540b2d10 con 0x7f06540ce5d0 2023-12-19T16:17:43.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.603+0000 7f063bfff640 1 -- 172.21.15.119:0/4263032708 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v46) v1 ==== 160+0+0 (secure 0 0 0) 0x7f06540b2d10 con 0x7f06540ce5d0 2023-12-19T16:17:43.609 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'data_new' removed 2023-12-19T16:17:43.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0640065a60 msgr2=0x7f0640067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0640065a60 0x7f0640067f20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06440ae000 tx=0x7f06440b5040 comp rx=0 tx=0).stop 2023-12-19T16:17:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 msgr2=0x7f06540c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 0x7f06540c5470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f064800e870 tx=0x7f064800ec70 comp rx=0 tx=0).stop 2023-12-19T16:17:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 shutdown_connections 2023-12-19T16:17:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0640065a60 0x7f0640067f20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065415e2d0 0x7f0654158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06540ce5d0 0x7f06540c5470 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 --2- 172.21.15.119:0/4263032708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f065406d440 0x7f065415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 >> 172.21.15.119:0/4263032708 conn(0x7f0654069e70 msgr2=0x7f06540ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 shutdown_connections 2023-12-19T16:17:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.607+0000 7f0659db3640 1 -- 172.21.15.119:0/4263032708 wait complete. 2023-12-19T16:17:43.634 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T16:17:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.771+0000 7fa392d60640 1 Processor -- start 2023-12-19T16:17:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.771+0000 7fa392d60640 1 -- start start 2023-12-19T16:17:43.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa392d60640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa38c0ceac0 0x7fa38c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:43.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa392d60640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c0c9390 con 0x7fa38c070820 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa392d60640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c15aee0 con 0x7fa38c1582d0 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa392d60640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c15b1c0 con 0x7fa38c0ceac0 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa3912fd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa38c0ceac0 0x7fa38c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa383fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa38c070820 0x7fa38c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37232/0 (socket says 172.21.15.119:37232) 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa3912fd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa38c0ceac0 0x7fa38c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48132/0 (socket says 172.21.15.119:48132) 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa383fff640 1 -- 172.21.15.119:0/1510891350 learned_addr learned my addr 172.21.15.119:0/1510891350 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa3912fd640 1 -- 172.21.15.119:0/1510891350 >> v1:172.21.15.143:6789/0 conn(0x7fa38c1582d0 legacy=0x7fa38c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa3912fd640 1 -- 172.21.15.119:0/1510891350 >> v1:172.21.15.119:6789/0 conn(0x7fa38c070820 legacy=0x7fa38c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa3912fd640 1 -- 172.21.15.119:0/1510891350 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c15b4a0 con 0x7fa38c0ceac0 2023-12-19T16:17:43.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.775+0000 7fa3837fe640 1 -- 172.21.15.119:0/1510891350 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376965781 0 0) 0x7fa38c0c9390 con 0x7fa38c070820 2023-12-19T16:17:43.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa3912fd640 1 --2- 172.21.15.119:0/1510891350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c0ceac0 0x7fa38c0c8e50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa384009d90 tx=0x7fa38401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a73ecb9f7af759 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:43.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa3837fe640 1 -- 172.21.15.119:0/1510891350 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a5a00 con 0x7fa38c0ceac0 2023-12-19T16:17:43.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa3837fe640 1 -- 172.21.15.119:0/1510891350 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3840a5b60 con 0x7fa38c0ceac0 2023-12-19T16:17:43.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa3837fe640 1 -- 172.21.15.119:0/1510891350 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840ad440 con 0x7fa38c0ceac0 2023-12-19T16:17:43.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- 172.21.15.119:0/1510891350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c0ceac0 msgr2=0x7fa38c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 --2- 172.21.15.119:0/1510891350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c0ceac0 0x7fa38c0c8e50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa384009d90 tx=0x7fa38401c920 comp rx=0 tx=0).stop 2023-12-19T16:17:43.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- 172.21.15.119:0/1510891350 shutdown_connections 2023-12-19T16:17:43.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 --2- 172.21.15.119:0/1510891350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c0ceac0 0x7fa38c0c8e50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- 172.21.15.119:0/1510891350 >> 172.21.15.119:0/1510891350 conn(0x7fa38c06a2a0 msgr2=0x7fa38c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:43.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- 172.21.15.119:0/1510891350 shutdown_connections 2023-12-19T16:17:43.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- 172.21.15.119:0/1510891350 wait complete. 2023-12-19T16:17:43.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 Processor -- start 2023-12-19T16:17:43.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- start start 2023-12-19T16:17:43.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 0x7fa38c1f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:43.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa38c0ceac0 0x7fa38c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:43.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa38c1582d0 0x7fa38c0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:43.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1f6f20 con 0x7fa38c070820 2023-12-19T16:17:43.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1481a0 con 0x7fa38c0ceac0 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.779+0000 7fa392d60640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c155aa0 con 0x7fa38c1582d0 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 0x7fa38c1f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 0x7fa38c1f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48144/0 (socket says 172.21.15.119:48144) 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 -- 172.21.15.119:0/2258342664 learned_addr learned my addr 172.21.15.119:0/2258342664 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa383fff640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa38c0ceac0 0x7fa38c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3912fd640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa38c1582d0 0x7fa38c0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 -- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa38c1582d0 msgr2=0x7fa38c0c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa38c1582d0 0x7fa38c0c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 -- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa38c0ceac0 msgr2=0x7fa38c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa38c0ceac0 0x7fa38c1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 -- 172.21.15.119:0/2258342664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384009a70 con 0x7fa38c070820 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3912fd640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa38c1582d0 0x7fa38c0c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa390afc640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 0x7fa38c1f69e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa38800c500 tx=0x7fa38800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388005220 con 0x7fa38c070820 2023-12-19T16:17:43.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388005380 con 0x7fa38c070820 2023-12-19T16:17:43.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388007270 con 0x7fa38c070820 2023-12-19T16:17:43.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c155d60 con 0x7fa38c070820 2023-12-19T16:17:43.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c156320 con 0x7fa38c070820 2023-12-19T16:17:43.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c04e000 con 0x7fa38c070820 2023-12-19T16:17:43.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa3880073d0 con 0x7fa38c070820 2023-12-19T16:17:43.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3817fa640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa378065a60 0x7fa378067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:43.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.783+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa3880828b0 con 0x7fa38c070820 2023-12-19T16:17:43.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.787+0000 7fa383fff640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa378065a60 0x7fa378067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:43.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.787+0000 7fa383fff640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa378065a60 0x7fa378067f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa38c1f70b0 tx=0x7fa37c007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:43.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.787+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa3880503a0 con 0x7fa38c070820 2023-12-19T16:17:43.942 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.939+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa38c0b0c00 con 0x7fa38c070820 2023-12-19T16:17:43.947 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.943+0000 7fa3817fa640 1 -- 172.21.15.119:0/2258342664 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa3880539c0 con 0x7fa38c070820 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa378065a60 msgr2=0x7fa378067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa378065a60 0x7fa378067f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa38c1f70b0 tx=0x7fa37c007240 comp rx=0 tx=0).stop 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 msgr2=0x7fa38c1f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 0x7fa38c1f69e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa38800c500 tx=0x7fa38800c9c0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 shutdown_connections 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa378065a60 0x7fa378067f20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa38c0ceac0 0x7fa38c1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa38c1582d0 0x7fa38c0c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 --2- 172.21.15.119:0/2258342664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38c070820 0x7fa38c1f69e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 >> 172.21.15.119:0/2258342664 conn(0x7fa38c06a2a0 msgr2=0x7fa38c1586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 shutdown_connections 2023-12-19T16:17:43.950 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:43.947+0000 7fa392d60640 1 -- 172.21.15.119:0/2258342664 wait complete. 2023-12-19T16:17:43.968 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-12-19T16:17:44.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 Processor -- start 2023-12-19T16:17:44.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 -- start start 2023-12-19T16:17:44.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f31d815ca40 0x7f31d80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d80cf7e0 0x7f31d81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d80d11c0 con 0x7f31d80ce3f0 2023-12-19T16:17:44.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d80d0310 con 0x7f31d815ca40 2023-12-19T16:17:44.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31de539640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80d05b0 con 0x7f31d80cf7e0 2023-12-19T16:17:44.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31d7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f31d815ca40 0x7f31d80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31d7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f31d815ca40 0x7f31d80cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:53668/0 (socket says 172.21.15.119:53668) 2023-12-19T16:17:44.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31d7fff640 1 -- 172.21.15.119:0/3279270801 learned_addr learned my addr 172.21.15.119:0/3279270801 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:44.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31d77fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f31d80ce3f0 0x7f31d80cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:36708/0 (socket says 172.21.15.119:36708) 2023-12-19T16:17:44.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31dcad6640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d80cf7e0 0x7f31d81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31d7fff640 1 -- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d80cf7e0 msgr2=0x7f31d81668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:44.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.103+0000 7f31d7fff640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d80cf7e0 0x7f31d81668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31d7fff640 1 -- 172.21.15.119:0/3279270801 >> v1:172.21.15.143:6789/0 conn(0x7f31d80ce3f0 legacy=0x7f31d80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31d7fff640 1 -- 172.21.15.119:0/3279270801 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80d0890 con 0x7f31d815ca40 2023-12-19T16:17:44.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31dcad6640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d80cf7e0 0x7f31d81668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:44.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31d7fff640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d815ca40 0x7f31d80cdeb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f31c8006fd0 tx=0x7f31c801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd795088794bcc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:44.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31d6ffd640 1 -- 172.21.15.119:0/3279270801 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80aa680 con 0x7f31d815ca40 2023-12-19T16:17:44.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31d6ffd640 1 -- 172.21.15.119:0/3279270801 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80aa7e0 con 0x7f31d815ca40 2023-12-19T16:17:44.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.107+0000 7f31d6ffd640 1 -- 172.21.15.119:0/3279270801 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80aab70 con 0x7f31d815ca40 2023-12-19T16:17:44.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d815ca40 msgr2=0x7f31d80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d815ca40 0x7f31d80cdeb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f31c8006fd0 tx=0x7f31c801c520 comp rx=0 tx=0).stop 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- 172.21.15.119:0/3279270801 shutdown_connections 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d80cf7e0 0x7f31d81668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 --2- 172.21.15.119:0/3279270801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d815ca40 0x7f31d80cdeb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- 172.21.15.119:0/3279270801 >> 172.21.15.119:0/3279270801 conn(0x7f31d8089fb0 msgr2=0x7f31d80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- 172.21.15.119:0/3279270801 shutdown_connections 2023-12-19T16:17:44.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- 172.21.15.119:0/3279270801 wait complete. 2023-12-19T16:17:44.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 Processor -- start 2023-12-19T16:17:44.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- start start 2023-12-19T16:17:44.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d80ce3f0 0x7f31d80b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 0x7f31d80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d815ca40 0x7f31d80af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80cc6c0 con 0x7f31d80cf7e0 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80c98b0 con 0x7f31d80ce3f0 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31de539640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80c9b50 con 0x7f31d815ca40 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 0x7f31d80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 0x7f31d80b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48156/0 (socket says 172.21.15.119:48156) 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 -- 172.21.15.119:0/1761559055 learned_addr learned my addr 172.21.15.119:0/1761559055 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31dcad6640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d815ca40 0x7f31d80af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d7fff640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d80ce3f0 0x7f31d80b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 -- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d815ca40 msgr2=0x7f31d80af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d815ca40 0x7f31d80af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 -- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d80ce3f0 msgr2=0x7f31d80b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d80ce3f0 0x7f31d80b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.111+0000 7f31d77fe640 1 -- 172.21.15.119:0/1761559055 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0009a70 con 0x7f31d80cf7e0 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d77fe640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 0x7f31d80b0ff0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00c4d0 tx=0x7f31cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc005c80 con 0x7f31d80cf7e0 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc005de0 con 0x7f31d80cf7e0 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc007270 con 0x7f31d80cf7e0 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8009480 con 0x7f31d80cf7e0 2023-12-19T16:17:44.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d80d17d0 con 0x7f31d80cf7e0 2023-12-19T16:17:44.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d80d1630 con 0x7f31d80cf7e0 2023-12-19T16:17:44.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31cc0073d0 con 0x7f31d80cf7e0 2023-12-19T16:17:44.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d4ff9640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f31c4065a60 0x7f31c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f31cc082480 con 0x7f31d80cf7e0 2023-12-19T16:17:44.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.115+0000 7f31d7fff640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f31c4065a60 0x7f31c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.119+0000 7f31d7fff640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f31c4065a60 0x7f31c4067f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f31c80ae000 tx=0x7f31c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:44.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.119+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31d80d1630 con 0x7f31d80cf7e0 2023-12-19T16:17:44.327 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.323+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f31d80d1630 con 0x7f31d80cf7e0 2023-12-19T16:17:44.611 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.607+0000 7f31d4ff9640 1 -- 172.21.15.119:0/1761559055 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v148) v1 ==== 147+0+0 (secure 0 0 0) 0x7f31d80d1630 con 0x7f31d80cf7e0 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f31c4065a60 msgr2=0x7f31c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f31c4065a60 0x7f31c4067f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f31c80ae000 tx=0x7f31c8009040 comp rx=0 tx=0).stop 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 msgr2=0x7f31d80b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 0x7f31d80b0ff0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00c4d0 tx=0x7f31cc00c990 comp rx=0 tx=0).stop 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 shutdown_connections 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f31c4065a60 0x7f31c4067f20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31d815ca40 0x7f31d80af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d80cf7e0 0x7f31d80b0ff0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 --2- 172.21.15.119:0/1761559055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31d80ce3f0 0x7f31d80b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 >> 172.21.15.119:0/1761559055 conn(0x7f31d8089fb0 msgr2=0x7f31d80ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:44.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 shutdown_connections 2023-12-19T16:17:44.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.611+0000 7f31de539640 1 -- 172.21.15.119:0/1761559055 wait complete. 2023-12-19T16:17:44.634 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-12-19T16:17:44.635 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-19T16:17:44.635 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-12-19T16:17:44.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.767+0000 7f8f80739640 1 Processor -- start 2023-12-19T16:17:44.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.767+0000 7f8f80739640 1 -- start start 2023-12-19T16:17:44.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f80739640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f781570c0 0x7f8f7806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f80739640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f780c9460 con 0x7f8f7806c320 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f80739640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f781574a0 con 0x7f8f780ca000 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f80739640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7806c7a0 con 0x7f8f781570c0 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7dcd4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8f7806c320 0x7f8f780c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37234/0 (socket says 172.21.15.119:37234) 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7dcd4640 1 -- 172.21.15.119:0/3952619159 learned_addr learned my addr 172.21.15.119:0/3952619159 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7e4d5640 1 --2- 172.21.15.119:0/3952619159 >> v2:172.21.15.143:3300/0 conn(0x7f8f781570c0 0x7f8f7806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7d4d3640 1 -- 172.21.15.119:0/3952619159 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859096636 0 0) 0x7f8f780c9460 con 0x7f8f7806c320 2023-12-19T16:17:44.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7d4d3640 1 -- 172.21.15.119:0/3952619159 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f64003530 con 0x7f8f7806c320 2023-12-19T16:17:44.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7e4d5640 1 -- 172.21.15.119:0/3952619159 >> v1:172.21.15.143:6789/0 conn(0x7f8f780ca000 legacy=0x7f8f78070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7e4d5640 1 -- 172.21.15.119:0/3952619159 >> v1:172.21.15.119:6789/0 conn(0x7f8f7806c320 legacy=0x7f8f780c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.776 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.771+0000 7f8f7e4d5640 1 -- 172.21.15.119:0/3952619159 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780c8b30 con 0x7f8f781570c0 2023-12-19T16:17:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f7e4d5640 1 --2- 172.21.15.119:0/3952619159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f781570c0 0x7f8f7806bde0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f740097c0 tx=0x7f8f7401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de743eae49b0de9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f7d4d3640 1 -- 172.21.15.119:0/3952619159 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740ac620 con 0x7f8f781570c0 2023-12-19T16:17:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f7d4d3640 1 -- 172.21.15.119:0/3952619159 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f740ac780 con 0x7f8f781570c0 2023-12-19T16:17:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f7d4d3640 1 -- 172.21.15.119:0/3952619159 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740acb10 con 0x7f8f781570c0 2023-12-19T16:17:44.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 -- 172.21.15.119:0/3952619159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f781570c0 msgr2=0x7f8f7806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 --2- 172.21.15.119:0/3952619159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f781570c0 0x7f8f7806bde0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f740097c0 tx=0x7f8f7401c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 -- 172.21.15.119:0/3952619159 shutdown_connections 2023-12-19T16:17:44.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 --2- 172.21.15.119:0/3952619159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f781570c0 0x7f8f7806bde0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 -- 172.21.15.119:0/3952619159 >> 172.21.15.119:0/3952619159 conn(0x7f8f7806a3e0 msgr2=0x7f8f780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:44.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 -- 172.21.15.119:0/3952619159 shutdown_connections 2023-12-19T16:17:44.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 -- 172.21.15.119:0/3952619159 wait complete. 2023-12-19T16:17:44.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 Processor -- start 2023-12-19T16:17:44.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.775+0000 7f8f80739640 1 -- start start 2023-12-19T16:17:44.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f7806c320 0x7f8f780cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f780ca000 0x7f8f780cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 0x7f8f780cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78158080 con 0x7f8f781570c0 2023-12-19T16:17:44.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7815be10 con 0x7f8f780ca000 2023-12-19T16:17:44.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78158270 con 0x7f8f7806c320 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 0x7f8f780cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 0x7f8f780cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48168/0 (socket says 172.21.15.119:48168) 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 -- 172.21.15.119:0/2374287328 learned_addr learned my addr 172.21.15.119:0/2374287328 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7dcd4640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f780ca000 0x7f8f780cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7e4d5640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f7806c320 0x7f8f780cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 -- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f7806c320 msgr2=0x7f8f780cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.786 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f7806c320 0x7f8f780cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 -- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f780ca000 msgr2=0x7f8f780cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f780ca000 0x7f8f780cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 -- 172.21.15.119:0/2374287328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74009420 con 0x7f8f781570c0 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f7ecd6640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 0x7f8f780cb740 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c730 tx=0x7f8f7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70003b80 con 0x7f8f781570c0 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f70003ce0 con 0x7f8f781570c0 2023-12-19T16:17:44.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000aa30 con 0x7f8f781570c0 2023-12-19T16:17:44.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f78158550 con 0x7f8f781570c0 2023-12-19T16:17:44.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f780cda00 con 0x7f8f781570c0 2023-12-19T16:17:44.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.779+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f780735b0 con 0x7f8f781570c0 2023-12-19T16:17:44.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.783+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8f7000ab90 con 0x7f8f781570c0 2023-12-19T16:17:44.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.783+0000 7f8f6effd640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f5c065a90 0x7f8f5c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:44.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.783+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8f70082bb0 con 0x7f8f781570c0 2023-12-19T16:17:44.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.783+0000 7f8f7e4d5640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f5c065a90 0x7f8f5c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:44.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.783+0000 7f8f7e4d5640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f5c065a90 0x7f8f5c067f50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f740ae000 tx=0x7f8f740a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:44.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.787+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8f700507d0 con 0x7f8f781570c0 2023-12-19T16:17:44.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:44.991+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f8f7804e000 con 0x7f8f781570c0 2023-12-19T16:17:45.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f6effd640 1 -- 172.21.15.119:0/2374287328 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v149) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8f70053df0 con 0x7f8f781570c0 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f5c065a90 msgr2=0x7f8f5c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f5c065a90 0x7f8f5c067f50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f740ae000 tx=0x7f8f740a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 msgr2=0x7f8f780cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 0x7f8f780cb740 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c730 tx=0x7f8f7000cbf0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 shutdown_connections 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8f5c065a90 0x7f8f5c067f50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.616 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f780ca000 0x7f8f780cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f781570c0 0x7f8f780cb740 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 --2- 172.21.15.119:0/2374287328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f7806c320 0x7f8f780cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 >> 172.21.15.119:0/2374287328 conn(0x7f8f7806a3e0 msgr2=0x7f8f780c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:45.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 shutdown_connections 2023-12-19T16:17:45.617 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.611+0000 7f8f80739640 1 -- 172.21.15.119:0/2374287328 wait complete. 2023-12-19T16:17:45.639 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T16:17:45.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 Processor -- start 2023-12-19T16:17:45.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 -- start start 2023-12-19T16:17:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34b0160a60 0x7f34b00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:45.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34b00ce8f0 0x7f34b0164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00ced50 con 0x7f34b0164e60 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b00cc980 con 0x7f34b00ce8f0 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b8109640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b00cc090 con 0x7f34b0160a60 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34b00ce8f0 0x7f34b0164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34b00ce8f0 0x7f34b0164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48170/0 (socket says 172.21.15.119:48170) 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b66a6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f34b0164e60 0x7f34b00cad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37246/0 (socket says 172.21.15.119:37246) 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 -- 172.21.15.119:0/3068982678 learned_addr learned my addr 172.21.15.119:0/3068982678 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b5ea5640 1 --2- 172.21.15.119:0/3068982678 >> v2:172.21.15.143:3300/0 conn(0x7f34b0160a60 0x7f34b00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 -- 172.21.15.119:0/3068982678 >> v2:172.21.15.143:3300/0 conn(0x7f34b0160a60 msgr2=0x7f34b00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 --2- 172.21.15.119:0/3068982678 >> v2:172.21.15.143:3300/0 conn(0x7f34b0160a60 0x7f34b00ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 -- 172.21.15.119:0/3068982678 >> v1:172.21.15.119:6789/0 conn(0x7f34b0164e60 legacy=0x7f34b00cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.779+0000 7f34b56a4640 1 -- 172.21.15.119:0/3068982678 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00cc330 con 0x7f34b00ce8f0 2023-12-19T16:17:45.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b56a4640 1 --2- 172.21.15.119:0/3068982678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b00ce8f0 0x7f34b0164920 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f34b00b07c0 tx=0x7f34a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7018fe39b152a459 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:45.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b4ea3640 1 -- 172.21.15.119:0/3068982678 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00aa650 con 0x7f34b00ce8f0 2023-12-19T16:17:45.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b4ea3640 1 -- 172.21.15.119:0/3068982678 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a00aa7b0 con 0x7f34b00ce8f0 2023-12-19T16:17:45.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b4ea3640 1 -- 172.21.15.119:0/3068982678 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00aab40 con 0x7f34b00ce8f0 2023-12-19T16:17:45.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 -- 172.21.15.119:0/3068982678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b00ce8f0 msgr2=0x7f34b0164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 --2- 172.21.15.119:0/3068982678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b00ce8f0 0x7f34b0164920 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f34b00b07c0 tx=0x7f34a001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 -- 172.21.15.119:0/3068982678 shutdown_connections 2023-12-19T16:17:45.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 --2- 172.21.15.119:0/3068982678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b00ce8f0 0x7f34b0164920 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 --2- 172.21.15.119:0/3068982678 >> v2:172.21.15.143:3300/0 conn(0x7f34b0160a60 0x7f34b00ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 -- 172.21.15.119:0/3068982678 >> 172.21.15.119:0/3068982678 conn(0x7f34b006a2a0 msgr2=0x7f34b00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:45.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 -- 172.21.15.119:0/3068982678 shutdown_connections 2023-12-19T16:17:45.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.783+0000 7f34b8109640 1 -- 172.21.15.119:0/3068982678 wait complete. 2023-12-19T16:17:45.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 Processor -- start 2023-12-19T16:17:45.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 -- start start 2023-12-19T16:17:45.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34b00ce8f0 0x7f34b00c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:45.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34b0160a60 0x7f34b00c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:45.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 0x7f34b00cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0158270 con 0x7f34b0164e60 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0158df0 con 0x7f34b00ce8f0 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01584c0 con 0x7f34b0160a60 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 0x7f34b00cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 0x7f34b00cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48174/0 (socket says 172.21.15.119:48174) 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 -- 172.21.15.119:0/1524617341 learned_addr learned my addr 172.21.15.119:0/1524617341 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b5ea5640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34b00ce8f0 0x7f34b00c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b56a4640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34b0160a60 0x7f34b00c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 -- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34b0160a60 msgr2=0x7f34b00c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34b0160a60 0x7f34b00c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 -- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34b00ce8f0 msgr2=0x7f34b00c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34b00ce8f0 0x7f34b00c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 -- 172.21.15.119:0/1524617341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00094d0 con 0x7f34b0164e60 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b66a6640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 0x7f34b00cce10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f34a800c7d0 tx=0x7f34a800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800a640 con 0x7f34b0164e60 2023-12-19T16:17:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800a7a0 con 0x7f34b0164e60 2023-12-19T16:17:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800ab10 con 0x7f34b0164e60 2023-12-19T16:17:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b01587a0 con 0x7f34b0164e60 2023-12-19T16:17:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.787+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00cd350 con 0x7f34b0164e60 2023-12-19T16:17:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.791+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b004e000 con 0x7f34b0164e60 2023-12-19T16:17:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.791+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34a800ac70 con 0x7f34b0164e60 2023-12-19T16:17:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.791+0000 7f34a67fc640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3494065a60 0x7f3494067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:45.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.791+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f34a8082740 con 0x7f34b0164e60 2023-12-19T16:17:45.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.791+0000 7f34b5ea5640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3494065a60 0x7f3494067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:45.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.791+0000 7f34b5ea5640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3494065a60 0x7f3494067f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f34ac007a60 tx=0x7f34ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:45.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.795+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34a8050360 con 0x7f34b0164e60 2023-12-19T16:17:45.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.951+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f34b0158f30 con 0x7f34b0164e60 2023-12-19T16:17:45.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34a67fc640 1 -- 172.21.15.119:0/1524617341 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f34a80170c0 con 0x7f34b0164e60 2023-12-19T16:17:45.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3494065a60 msgr2=0x7f3494067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3494065a60 0x7f3494067f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f34ac007a60 tx=0x7f34ac008040 comp rx=0 tx=0).stop 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 msgr2=0x7f34b00cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 0x7f34b00cce10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f34a800c7d0 tx=0x7f34a800cc90 comp rx=0 tx=0).stop 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 shutdown_connections 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3494065a60 0x7f3494067f20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34b0164e60 0x7f34b00cce10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34b0160a60 0x7f34b00c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 --2- 172.21.15.119:0/1524617341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34b00ce8f0 0x7f34b00c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 >> 172.21.15.119:0/1524617341 conn(0x7f34b006a2a0 msgr2=0x7f34b006fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 shutdown_connections 2023-12-19T16:17:45.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:45.959+0000 7f34b8109640 1 -- 172.21.15.119:0/1524617341 wait complete. 2023-12-19T16:17:45.983 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:17:45.983 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:46.084 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:46.173 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:17:46.173 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:46.173 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:46.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:46.183 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:17:46.183 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:46.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:46.193 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:17:46.193 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:46.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:46.234 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:17:46.234 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:46.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:46.243 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T16:17:46.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.411+0000 7ffab748c640 1 Processor -- start 2023-12-19T16:17:46.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.411+0000 7ffab748c640 1 -- start start 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab748c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffab0160cc0 0x7ffab00cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab748c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab00c1280 0x7ffab00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab748c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab006fdb0 con 0x7ffab00c17d0 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab748c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab01654a0 con 0x7ffab0160cc0 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab748c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01610a0 con 0x7ffab00c1280 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5a29640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ffab00c17d0 0x7ffab006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37262/0 (socket says 172.21.15.119:37262) 2023-12-19T16:17:46.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5a29640 1 -- 172.21.15.119:0/2527911201 learned_addr learned my addr 172.21.15.119:0/2527911201 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5228640 1 --2- 172.21.15.119:0/2527911201 >> v2:172.21.15.143:3300/0 conn(0x7ffab0160cc0 0x7ffab00cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab4a27640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab00c1280 0x7ffab00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffaa7fff640 1 -- 172.21.15.119:0/2527911201 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12325426 0 0) 0x7ffab006fdb0 con 0x7ffab00c17d0 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffaa7fff640 1 -- 172.21.15.119:0/2527911201 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa9c003530 con 0x7ffab00c17d0 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5228640 1 -- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab00c1280 msgr2=0x7ffab00cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5228640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab00c1280 0x7ffab00cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5228640 1 -- 172.21.15.119:0/2527911201 >> v1:172.21.15.119:6789/0 conn(0x7ffab00c17d0 legacy=0x7ffab006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab5228640 1 -- 172.21.15.119:0/2527911201 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00cb6b0 con 0x7ffab0160cc0 2023-12-19T16:17:46.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.415+0000 7ffab4a27640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab00c1280 0x7ffab00cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab5228640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0160cc0 0x7ffab00cac30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0097f0 tx=0x7ffaac01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67f69109b97f7c21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffaa7fff640 1 -- 172.21.15.119:0/2527911201 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab600 con 0x7ffab0160cc0 2023-12-19T16:17:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffaa7fff640 1 -- 172.21.15.119:0/2527911201 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac0a7050 con 0x7ffab0160cc0 2023-12-19T16:17:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffaa7fff640 1 -- 172.21.15.119:0/2527911201 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab960 con 0x7ffab0160cc0 2023-12-19T16:17:46.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 -- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0160cc0 msgr2=0x7ffab00cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0160cc0 0x7ffab00cac30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0097f0 tx=0x7ffaac01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 -- 172.21.15.119:0/2527911201 shutdown_connections 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab00c1280 0x7ffab00cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 --2- 172.21.15.119:0/2527911201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0160cc0 0x7ffab00cac30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 -- 172.21.15.119:0/2527911201 >> 172.21.15.119:0/2527911201 conn(0x7ffab006a3e0 msgr2=0x7ffab00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 -- 172.21.15.119:0/2527911201 shutdown_connections 2023-12-19T16:17:46.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 -- 172.21.15.119:0/2527911201 wait complete. 2023-12-19T16:17:46.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 Processor -- start 2023-12-19T16:17:46.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 -- start start 2023-12-19T16:17:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab00c1280 0x7ffab00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 0x7ffab0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.419+0000 7ffab748c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab0160cc0 0x7ffab0143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab748c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b1440 con 0x7ffab00c17d0 2023-12-19T16:17:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab748c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b1650 con 0x7ffab00c1280 2023-12-19T16:17:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab748c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b1930 con 0x7ffab0160cc0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 0x7ffab0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 0x7ffab0155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48188/0 (socket says 172.21.15.119:48188) 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 -- 172.21.15.119:0/2052962543 learned_addr learned my addr 172.21.15.119:0/2052962543 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab5228640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab00c1280 0x7ffab00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab5a29640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab0160cc0 0x7ffab0143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 -- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab0160cc0 msgr2=0x7ffab0143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab0160cc0 0x7ffab0143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 -- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab00c1280 msgr2=0x7ffab00b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab00c1280 0x7ffab00b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 -- 172.21.15.119:0/2052962543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009420 con 0x7ffab00c17d0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab5a29640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab0160cc0 0x7ffab0143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab4a27640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 0x7ffab0155e00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ebe0 tx=0x7ffaa000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000eee0 con 0x7ffab00c17d0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000cc30 con 0x7ffab00c17d0 2023-12-19T16:17:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0013470 con 0x7ffab00c17d0 2023-12-19T16:17:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac009420 con 0x7ffab00c17d0 2023-12-19T16:17:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab00b1ef0 con 0x7ffab00c17d0 2023-12-19T16:17:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00735b0 con 0x7ffab00c17d0 2023-12-19T16:17:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.423+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffaa00135d0 con 0x7ffab00c17d0 2023-12-19T16:17:46.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.427+0000 7ffaa5ffb640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffa94065a60 0x7ffa94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.427+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ffaa00832e0 con 0x7ffab00c17d0 2023-12-19T16:17:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.427+0000 7ffab5228640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffa94065a60 0x7ffa94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.427+0000 7ffab5228640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffa94065a60 0x7ffa94067f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0ad000 tx=0x7ffaac0a4f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.431+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffaa0050e70 con 0x7ffab00c17d0 2023-12-19T16:17:46.619 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.615+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffab00adc70 con 0x7ffab00c17d0 2023-12-19T16:17:46.620 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.615+0000 7ffaa5ffb640 1 -- 172.21.15.119:0/2052962543 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3529 (secure 0 0 0) 0x7ffaa0017de0 con 0x7ffab00c17d0 2023-12-19T16:17:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:46.620 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/278316906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":278316906},{"type":"v1","addr":"172.21.15.143:6834","nonce":278316906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1982203090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1982203090},{"type":"v1","addr":"172.21.15.119:6835","nonce":1982203090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5484,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/7823586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":7823586},{"type":"v1","addr":"172.21.15.119:6837","nonce":7823586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5788,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2678219264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2678219264},{"type":"v1","addr":"172.21.15.143:6835","nonce":2678219264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-12-19T16:17:46.620 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 20 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffa94065a60 msgr2=0x7ffa94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffa94065a60 0x7ffa94067f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0ad000 tx=0x7ffaac0a4f90 comp rx=0 tx=0).stop 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 msgr2=0x7ffab0155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 0x7ffab0155e00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ebe0 tx=0x7ffaa000c520 comp rx=0 tx=0).stop 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 shutdown_connections 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ffa94065a60 0x7ffa94067f20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab0160cc0 0x7ffab0143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00c17d0 0x7ffab0155e00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 --2- 172.21.15.119:0/2052962543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab00c1280 0x7ffab00b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 >> 172.21.15.119:0/2052962543 conn(0x7ffab006a3e0 msgr2=0x7ffab00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 shutdown_connections 2023-12-19T16:17:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.619+0000 7ffab748c640 1 -- 172.21.15.119:0/2052962543 wait complete. 2023-12-19T16:17:46.641 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:17:46.642 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:17:46.642 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:17:46.642 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:46.642 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:17:46.642 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:17:46.642 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:17:46.642 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:46.643 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:17:46.643 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:17:46.643 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:17:46.643 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:46.643 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:17:46.643 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T16:17:46.643 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:17:46.643 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:46.655 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:17:46.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:17:46.657 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:17:46.657 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:17:46.660 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:17:46.660 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:17:46.661 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:17:46.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:17:46.704 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:17:46.704 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:46.705 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:17:46.705 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:46.706 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:17:46.706 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:46.708 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:17:46.708 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:46.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T16:17:46.791 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2023-12-19T16:17:46.792 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2023-12-19T16:17:46.798 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-19T16:17:46.800 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-19T16:17:46.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.855+0000 7ff0a082d640 1 Processor -- start 2023-12-19T16:17:46.860 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.855+0000 7ff0a082d640 1 -- start start 2023-12-19T16:17:46.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff0a082d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff09c15a680 0x7ff09c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff0a082d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c15f100 con 0x7ff09c0cac10 2023-12-19T16:17:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff0a082d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0ca7d0 con 0x7ff09c06fdb0 2023-12-19T16:17:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff0a082d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c15e860 con 0x7ff09c15a680 2023-12-19T16:17:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff09a59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff09c15a680 0x7ff09c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff093fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff09c0cac10 0x7ff09c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37272/0 (socket says 172.21.15.119:37272) 2023-12-19T16:17:46.862 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff093fff640 1 -- 172.21.15.119:0/1279089228 learned_addr learned my addr 172.21.15.119:0/1279089228 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:46.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff099d9b640 1 -- 172.21.15.119:0/1279089228 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732345092 0 0) 0x7ff09c15f100 con 0x7ff09c0cac10 2023-12-19T16:17:46.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff099d9b640 1 -- 172.21.15.119:0/1279089228 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff088003530 con 0x7ff09c0cac10 2023-12-19T16:17:46.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff09a59c640 1 -- 172.21.15.119:0/1279089228 >> v1:172.21.15.143:6789/0 conn(0x7ff09c06fdb0 legacy=0x7ff09c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff09a59c640 1 -- 172.21.15.119:0/1279089228 >> v1:172.21.15.119:6789/0 conn(0x7ff09c0cac10 legacy=0x7ff09c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff09a59c640 1 -- 172.21.15.119:0/1279089228 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c15eb40 con 0x7ff09c15a680 2023-12-19T16:17:46.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-19T16:17:46.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-19T16:17:46.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-19T16:17:46.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-19T16:17:46.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.859+0000 7ff09a59c640 1 --2- 172.21.15.119:0/1279089228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c15a680 0x7ff09c15e160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097f0 tx=0x7ff08c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c099505920721ac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff099d9b640 1 -- 172.21.15.119:0/1279089228 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0ab5f0 con 0x7ff09c15a680 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff099d9b640 1 -- 172.21.15.119:0/1279089228 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c0ab750 con 0x7ff09c15a680 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff099d9b640 1 -- 172.21.15.119:0/1279089228 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0abae0 con 0x7ff09c15a680 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- 172.21.15.119:0/1279089228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c15a680 msgr2=0x7ff09c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 --2- 172.21.15.119:0/1279089228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c15a680 0x7ff09c15e160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097f0 tx=0x7ff08c01c3f0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- 172.21.15.119:0/1279089228 shutdown_connections 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 --2- 172.21.15.119:0/1279089228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c15a680 0x7ff09c15e160 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- 172.21.15.119:0/1279089228 >> 172.21.15.119:0/1279089228 conn(0x7ff09c06a3e0 msgr2=0x7ff09c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- 172.21.15.119:0/1279089228 shutdown_connections 2023-12-19T16:17:46.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- 172.21.15.119:0/1279089228 wait complete. 2023-12-19T16:17:46.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 Processor -- start 2023-12-19T16:17:46.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- start start 2023-12-19T16:17:46.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff09c06fdb0 0x7ff09c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 0x7ff09c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09c15a680 0x7ff09c153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0c8300 con 0x7ff09c0cac10 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0c3070 con 0x7ff09c15a680 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff0a082d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0c3350 con 0x7ff09c06fdb0 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff093fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 0x7ff09c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff093fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 0x7ff09c1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48226/0 (socket says 172.21.15.119:48226) 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.863+0000 7ff093fff640 1 -- 172.21.15.119:0/942076206 learned_addr learned my addr 172.21.15.119:0/942076206 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff09a59c640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff09c06fdb0 0x7ff09c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff09ad9d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09c15a680 0x7ff09c153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff093fff640 1 -- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff09c06fdb0 msgr2=0x7ff09c154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff093fff640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff09c06fdb0 0x7ff09c154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff093fff640 1 -- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09c15a680 msgr2=0x7ff09c153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:46.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff093fff640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09c15a680 0x7ff09c153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:46.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff093fff640 1 -- 172.21.15.119:0/942076206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009420 con 0x7ff09c0cac10 2023-12-19T16:17:46.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff093fff640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 0x7ff09c1563e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c420 tx=0x7ff08400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:46.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084005cf0 con 0x7ff09c0cac10 2023-12-19T16:17:46.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084005e50 con 0x7ff09c0cac10 2023-12-19T16:17:46.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840072d0 con 0x7ff09c0cac10 2023-12-19T16:17:46.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c070750 con 0x7ff09c0cac10 2023-12-19T16:17:46.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c153d80 con 0x7ff09c0cac10 2023-12-19T16:17:46.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c0735b0 con 0x7ff09c0cac10 2023-12-19T16:17:46.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff084007430 con 0x7ff09c0cac10 2023-12-19T16:17:46.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff092ffd640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff07c065a60 0x7ff07c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:46.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff0840824d0 con 0x7ff09c0cac10 2023-12-19T16:17:46.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.867+0000 7ff09a59c640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff07c065a60 0x7ff07c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:46.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.871+0000 7ff09a59c640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff07c065a60 0x7ff07c067f20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0af000 tx=0x7ff08c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:46.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:46.871+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff0840500f0 con 0x7ff09c0cac10 2023-12-19T16:17:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.035+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff09c04e000 con 0x7ff09c0cac10 2023-12-19T16:17:47.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff092ffd640 1 -- 172.21.15.119:0/942076206 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff084053710 con 0x7ff09c0cac10 2023-12-19T16:17:47.966 INFO:teuthology.orchestra.run.smithi119.stderr: removed all blocklist entries 2023-12-19T16:17:47.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff07c065a60 msgr2=0x7ff07c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff07c065a60 0x7ff07c067f20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0af000 tx=0x7ff08c0a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:47.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 msgr2=0x7ff09c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 0x7ff09c1563e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c420 tx=0x7ff08400c8e0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 shutdown_connections 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff07c065a60 0x7ff07c067f20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff09c15a680 0x7ff09c153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff09c0cac10 0x7ff09c1563e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 --2- 172.21.15.119:0/942076206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff09c06fdb0 0x7ff09c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 >> 172.21.15.119:0/942076206 conn(0x7ff09c06a3e0 msgr2=0x7ff09c15df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 shutdown_connections 2023-12-19T16:17:47.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:47.963+0000 7ff0a082d640 1 -- 172.21.15.119:0/942076206 wait complete. 2023-12-19T16:17:47.991 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T16:17:48.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 Processor -- start 2023-12-19T16:17:48.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 -- start start 2023-12-19T16:17:48.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13400ae040 0x7f134006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f134006d170 0x7f13400cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.132 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f13400ce290 0x7f13400c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400ce720 con 0x7f13400ae040 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400cccf0 con 0x7f13400ce290 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134636d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400ae420 con 0x7f134006d170 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13400ae040 0x7f134006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13400ae040 0x7f134006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48232/0 (socket says 172.21.15.119:48232) 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 -- 172.21.15.119:0/2352110200 learned_addr learned my addr 172.21.15.119:0/2352110200 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133f7fe640 1 --2- 172.21.15.119:0/2352110200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f134006d170 0x7f13400cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f134490a640 1 --2- 172.21.15.119:0/2352110200 >> v2:172.21.15.143:3300/0 conn(0x7f13400ce290 0x7f13400c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 -- 172.21.15.119:0/2352110200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f134006d170 msgr2=0x7f13400cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 --2- 172.21.15.119:0/2352110200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f134006d170 0x7f13400cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 -- 172.21.15.119:0/2352110200 >> v2:172.21.15.143:3300/0 conn(0x7f13400ce290 msgr2=0x7f13400c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 --2- 172.21.15.119:0/2352110200 >> v2:172.21.15.143:3300/0 conn(0x7f13400ce290 0x7f13400c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.127+0000 7f133ffff640 1 -- 172.21.15.119:0/2352110200 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400ccf90 con 0x7f13400ae040 2023-12-19T16:17:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f133ffff640 1 --2- 172.21.15.119:0/2352110200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006cc30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1340071d00 tx=0x7f133001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7add36c436fa2893 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f133effd640 1 -- 172.21.15.119:0/2352110200 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300ac600 con 0x7f13400ae040 2023-12-19T16:17:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f133effd640 1 -- 172.21.15.119:0/2352110200 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300a8050 con 0x7f13400ae040 2023-12-19T16:17:48.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f133effd640 1 -- 172.21.15.119:0/2352110200 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300ac980 con 0x7f13400ae040 2023-12-19T16:17:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 -- 172.21.15.119:0/2352110200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 msgr2=0x7f134006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 --2- 172.21.15.119:0/2352110200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006cc30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1340071d00 tx=0x7f133001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.136 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 -- 172.21.15.119:0/2352110200 shutdown_connections 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 --2- 172.21.15.119:0/2352110200 >> v2:172.21.15.143:3300/0 conn(0x7f13400ce290 0x7f13400c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 --2- 172.21.15.119:0/2352110200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f134006d170 0x7f13400cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 --2- 172.21.15.119:0/2352110200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006cc30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 -- 172.21.15.119:0/2352110200 >> 172.21.15.119:0/2352110200 conn(0x7f13400cb610 msgr2=0x7f13400cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 -- 172.21.15.119:0/2352110200 shutdown_connections 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.131+0000 7f134636d640 1 -- 172.21.15.119:0/2352110200 wait complete. 2023-12-19T16:17:48.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 Processor -- start 2023-12-19T16:17:48.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 -- start start 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f134006d170 0x7f13400b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13400ce290 0x7f134006e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400b4570 con 0x7f13400ae040 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400b3960 con 0x7f134006d170 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400b3c40 con 0x7f13400ce290 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48246/0 (socket says 172.21.15.119:48246) 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 -- 172.21.15.119:0/520567393 learned_addr learned my addr 172.21.15.119:0/520567393 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134490a640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13400ce290 0x7f134006e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133ffff640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f134006d170 0x7f13400b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 -- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13400ce290 msgr2=0x7f134006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13400ce290 0x7f134006e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 -- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f134006d170 msgr2=0x7f13400b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f134006d170 0x7f13400b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 -- 172.21.15.119:0/520567393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300094d0 con 0x7f13400ae040 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133f7fe640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006dad0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f133400d5f0 tx=0x7f133400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340125f0 con 0x7f13400ae040 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1334012750 con 0x7f13400ae040 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13400b3f20 con 0x7f13400ae040 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334012ae0 con 0x7f13400ae040 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.135+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13400c8490 con 0x7f13400ae040 2023-12-19T16:17:48.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.139+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13400c8710 con 0x7f13400ae040 2023-12-19T16:17:48.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.139+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1334012c40 con 0x7f13400ae040 2023-12-19T16:17:48.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.139+0000 7f133cff9640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f132c065a60 0x7f132c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.139+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f13340832e0 con 0x7f13400ae040 2023-12-19T16:17:48.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.139+0000 7f133ffff640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f132c065a60 0x7f132c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.139+0000 7f133ffff640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f132c065a60 0x7f132c067f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f13300ae000 tx=0x7f13300a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.143+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1334050f50 con 0x7f13400ae040 2023-12-19T16:17:48.348 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.343+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f134004e000 con 0x7f13400ae040 2023-12-19T16:17:48.349 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.343+0000 7f133cff9640 1 -- 172.21.15.119:0/520567393 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f1334054570 con 0x7f13400ae040 2023-12-19T16:17:48.349 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:48.349 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:17:48.349 INFO:teuthology.orchestra.run.smithi119.stdout: "auth_dump": [ 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.a", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlLDhBIhAA3Y+9H7uLr/4NWc6wXrLwjw==", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.b", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFleo5rLhAAJHoKLrFQzbYJ01cW5H58bg==", 2023-12-19T16:17:48.350 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.c", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlLLZzKRAA1mYEkFxnIMSc0nOQ5J3fZw==", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.351 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.d", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlJUDtNRAAMkucPMR4CF+uFnPefHxzaw==", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.0", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBgwYFlM246FhAATtFR0UPTG9iux5t4/pDT4A==", 2023-12-19T16:17:48.352 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.1", 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBjwYFlq7HwHBAAk5181pBrEv1Fr0NWsopEMg==", 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.2", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBmwYFlny61IhAAwxFTN7IkHgUfv3YpUv9b2A==", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.3", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBpwYFlaACTKxAAxbB8vMqBTc8nqHXpm2ZCOw==", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.354 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.4", 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBvwYFlJwJNORAAiwNlC6En0K9K7KKMrKUJoA==", 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.5", 2023-12-19T16:17:48.355 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBzwYFltvhjBRAARAVX5jbCgshgh46xt/X71Q==", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.6", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB2wYFlwB8iDBAAripdVFJZJMdj7HCelaVNLQ==", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.7", 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQB5wYFlcokUExAAQ/3tAfnmMJmp7ZTNpGoigA==", 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.0", 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlxmL3ORAAUnxwWR6p21EpYQy5hfFh3w==", 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.357 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow r", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rw pool=cephfs_data" 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.1", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBdwYFlnA8JCBAA7wql2Q+kIvfCR4WQlK58rA==", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.2", 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBdwYFly+dsBBAAV1uD8UkERj4vOKY6L1EshA==", 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.3", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBdwYFlF1wNDhAAlW/gPN5CFwwTxAfF964QeQ==", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.admin", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlZ2G5BhAAToqSgYfGBr80GT7W4sX3LQ==", 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.360 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.x", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFlCU5jHhAAq425Kk2xzqJYbEG+KbnDZA==", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:48.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.y", 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQBcwYFl2BuDGhAA+Q9BVQ1he47GGTx/7eIoHw==", 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2023-12-19T16:17:48.362 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:17:48.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f132c065a60 msgr2=0x7f132c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f132c065a60 0x7f132c067f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f13300ae000 tx=0x7f13300a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:48.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 msgr2=0x7f134006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006dad0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f133400d5f0 tx=0x7f133400dab0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 shutdown_connections 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f132c065a60 0x7f132c067f20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13400ce290 0x7f134006e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400ae040 0x7f134006dad0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 --2- 172.21.15.119:0/520567393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f134006d170 0x7f13400b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 >> 172.21.15.119:0/520567393 conn(0x7f13400cb610 msgr2=0x7f134015c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 shutdown_connections 2023-12-19T16:17:48.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.347+0000 7f134636d640 1 -- 172.21.15.119:0/520567393 wait complete. 2023-12-19T16:17:48.370 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:48.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.503+0000 7f6a6b3db640 1 Processor -- start 2023-12-19T16:17:48.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a6b3db640 1 -- start start 2023-12-19T16:17:48.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a6b3db640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a6406c4f0 0x7f6a640c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a6b3db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a640c9460 con 0x7f6a641570c0 2023-12-19T16:17:48.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a6b3db640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a641574a0 con 0x7f6a640c9e30 2023-12-19T16:17:48.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a6b3db640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640c8b30 con 0x7f6a6406c4f0 2023-12-19T16:17:48.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a69177640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6a641570c0 0x7f6a6406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37288/0 (socket says 172.21.15.119:37288) 2023-12-19T16:17:48.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a69177640 1 -- 172.21.15.119:0/1126159645 learned_addr learned my addr 172.21.15.119:0/1126159645 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:48.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a68976640 1 --2- 172.21.15.119:0/1126159645 >> v2:172.21.15.119:3300/0 conn(0x7f6a6406c4f0 0x7f6a640c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a5bfff640 1 -- 172.21.15.119:0/1126159645 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857683309 0 0) 0x7f6a640c9460 con 0x7f6a641570c0 2023-12-19T16:17:48.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a5bfff640 1 -- 172.21.15.119:0/1126159645 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a50003530 con 0x7f6a641570c0 2023-12-19T16:17:48.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a68976640 1 -- 172.21.15.119:0/1126159645 >> v1:172.21.15.143:6789/0 conn(0x7f6a640c9e30 legacy=0x7f6a64070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:48.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a68976640 1 -- 172.21.15.119:0/1126159645 >> v1:172.21.15.119:6789/0 conn(0x7f6a641570c0 legacy=0x7f6a6406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.507+0000 7f6a68976640 1 -- 172.21.15.119:0/1126159645 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640c8e10 con 0x7f6a6406c4f0 2023-12-19T16:17:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a68976640 1 --2- 172.21.15.119:0/1126159645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a640c98f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097c0 tx=0x7f6a5401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05bf500a8f76972 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a5bfff640 1 -- 172.21.15.119:0/1126159645 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540ab600 con 0x7f6a6406c4f0 2023-12-19T16:17:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a5bfff640 1 -- 172.21.15.119:0/1126159645 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a540a7050 con 0x7f6a6406c4f0 2023-12-19T16:17:48.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a5bfff640 1 -- 172.21.15.119:0/1126159645 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540ab980 con 0x7f6a6406c4f0 2023-12-19T16:17:48.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1126159645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 msgr2=0x7f6a640c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1126159645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a640c98f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097c0 tx=0x7f6a5401c380 comp rx=0 tx=0).stop 2023-12-19T16:17:48.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1126159645 shutdown_connections 2023-12-19T16:17:48.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1126159645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a640c98f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1126159645 >> 172.21.15.119:0/1126159645 conn(0x7f6a6406a3e0 msgr2=0x7f6a640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1126159645 shutdown_connections 2023-12-19T16:17:48.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1126159645 wait complete. 2023-12-19T16:17:48.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 Processor -- start 2023-12-19T16:17:48.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.511+0000 7f6a6b3db640 1 -- start start 2023-12-19T16:17:48.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a641491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a640c9e30 0x7f6a6415c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a641570c0 0x7f6a641552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6415bfd0 con 0x7f6a6406c4f0 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6415cc80 con 0x7f6a640c9e30 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a64159e20 con 0x7f6a641570c0 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a641491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a641491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48268/0 (socket says 172.21.15.119:48268) 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 -- 172.21.15.119:0/1915681252 learned_addr learned my addr 172.21.15.119:0/1915681252 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a68976640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a640c9e30 0x7f6a6415c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69978640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a641570c0 0x7f6a641552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 -- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a641570c0 msgr2=0x7f6a641552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a641570c0 0x7f6a641552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 -- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a640c9e30 msgr2=0x7f6a6415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a640c9e30 0x7f6a6415c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 -- 172.21.15.119:0/1915681252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009420 con 0x7f6a6406c4f0 2023-12-19T16:17:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a69177640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a641491c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000c3c0 tx=0x7f6a6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60005cf0 con 0x7f6a6406c4f0 2023-12-19T16:17:48.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60005e50 con 0x7f6a6406c4f0 2023-12-19T16:17:48.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600072f0 con 0x7f6a6406c4f0 2023-12-19T16:17:48.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6415a100 con 0x7f6a6406c4f0 2023-12-19T16:17:48.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6415c220 con 0x7f6a6406c4f0 2023-12-19T16:17:48.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.515+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a640735b0 con 0x7f6a6406c4f0 2023-12-19T16:17:48.521 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.519+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a60007450 con 0x7f6a6406c4f0 2023-12-19T16:17:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.519+0000 7f6a59ffb640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a48065a60 0x7f6a48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.519+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6a60082560 con 0x7f6a6406c4f0 2023-12-19T16:17:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.519+0000 7f6a68976640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a48065a60 0x7f6a48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.519+0000 7f6a68976640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a48065a60 0x7f6a48067f20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a540ad000 tx=0x7f6a540a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.523+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6a60050140 con 0x7f6a6406c4f0 2023-12-19T16:17:48.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:48.669 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:48.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.675+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a6404e000 con 0x7f6a6406c4f0 2023-12-19T16:17:48.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.675+0000 7f6a59ffb640 1 -- 172.21.15.119:0/1915681252 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+12642 (secure 0 0 0) 0x7f6a60017020 con 0x7f6a6406c4f0 2023-12-19T16:17:48.681 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:48.681 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":51,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:47.960096+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a48065a60 msgr2=0x7f6a48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a48065a60 0x7f6a48067f20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a540ad000 tx=0x7f6a540a6000 comp rx=0 tx=0).stop 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 msgr2=0x7f6a641491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a641491c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000c3c0 tx=0x7f6a6000c880 comp rx=0 tx=0).stop 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 shutdown_connections 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a48065a60 0x7f6a48067f20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a640c9e30 0x7f6a6415c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a641570c0 0x7f6a641552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 --2- 172.21.15.119:0/1915681252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6406c4f0 0x7f6a641491c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 >> 172.21.15.119:0/1915681252 conn(0x7f6a6406a3e0 msgr2=0x7f6a640c4770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 shutdown_connections 2023-12-19T16:17:48.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.679+0000 7f6a6b3db640 1 -- 172.21.15.119:0/1915681252 wait complete. 2023-12-19T16:17:48.703 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:48.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.895+0000 7f1c5f59e640 1 Processor -- start 2023-12-19T16:17:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.895+0000 7f1c5f59e640 1 -- start start 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1c6006bdf0 0x7f1c600c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5f59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1c600cb810 0x7f1c6015d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5f59e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6015d8c0 con 0x7f1c6006c1d0 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5f59e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6015dba0 con 0x7f1c600cb810 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5f59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6015de80 con 0x7f1c6006bdf0 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c57fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1c600cb810 0x7f1c6015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1c6006c1d0 0x7f1c6014ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37294/0 (socket says 172.21.15.119:37294) 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c57fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1c600cb810 0x7f1c6015d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48284/0 (socket says 172.21.15.119:48284) 2023-12-19T16:17:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5ed9d640 1 -- 172.21.15.119:0/3444888177 learned_addr learned my addr 172.21.15.119:0/3444888177 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5e59c640 1 --2- 172.21.15.119:0/3444888177 >> v2:172.21.15.143:3300/0 conn(0x7f1c6006bdf0 0x7f1c600c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c57fff640 1 -- 172.21.15.119:0/3444888177 >> v2:172.21.15.143:3300/0 conn(0x7f1c6006bdf0 msgr2=0x7f1c600c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c57fff640 1 --2- 172.21.15.119:0/3444888177 >> v2:172.21.15.143:3300/0 conn(0x7f1c6006bdf0 0x7f1c600c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c57fff640 1 -- 172.21.15.119:0/3444888177 >> v1:172.21.15.119:6789/0 conn(0x7f1c6006c1d0 legacy=0x7f1c6014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c57fff640 1 -- 172.21.15.119:0/3444888177 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600c8880 con 0x7f1c600cb810 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5e59c640 1 --2- 172.21.15.119:0/3444888177 >> v2:172.21.15.143:3300/0 conn(0x7f1c6006bdf0 0x7f1c600c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:48.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.899+0000 7f1c5dd9b640 1 -- 172.21.15.119:0/3444888177 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181977819 0 0) 0x7f1c6015d8c0 con 0x7f1c6006c1d0 2023-12-19T16:17:48.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c57fff640 1 --2- 172.21.15.119:0/3444888177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015d070 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1c6006de60 tx=0x7f1c4801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ed58500ad04585 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5dd9b640 1 -- 172.21.15.119:0/3444888177 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c480ab650 con 0x7f1c600cb810 2023-12-19T16:17:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5dd9b640 1 -- 172.21.15.119:0/3444888177 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c480ab7b0 con 0x7f1c600cb810 2023-12-19T16:17:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5dd9b640 1 -- 172.21.15.119:0/3444888177 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c480abb40 con 0x7f1c600cb810 2023-12-19T16:17:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3444888177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 msgr2=0x7f1c6015d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3444888177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015d070 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1c6006de60 tx=0x7f1c4801c430 comp rx=0 tx=0).stop 2023-12-19T16:17:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3444888177 shutdown_connections 2023-12-19T16:17:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3444888177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015d070 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3444888177 >> v2:172.21.15.143:3300/0 conn(0x7f1c6006bdf0 0x7f1c600c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3444888177 >> 172.21.15.119:0/3444888177 conn(0x7f1c6006a2a0 msgr2=0x7f1c600cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3444888177 shutdown_connections 2023-12-19T16:17:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3444888177 wait complete. 2023-12-19T16:17:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 Processor -- start 2023-12-19T16:17:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.903+0000 7f1c5f59e640 1 -- start start 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c6006bdf0 0x7f1c600c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c6006c1d0 0x7f1c6014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600c2df0 con 0x7f1c600cb810 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600c3930 con 0x7f1c6006bdf0 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600c3bd0 con 0x7f1c6006c1d0 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48286/0 (socket says 172.21.15.119:48286) 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 -- 172.21.15.119:0/3524299170 learned_addr learned my addr 172.21.15.119:0/3524299170 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5e59c640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c6006bdf0 0x7f1c600c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c57fff640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c6006c1d0 0x7f1c6014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 -- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c6006c1d0 msgr2=0x7f1c6014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c6006c1d0 0x7f1c6014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 -- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c6006bdf0 msgr2=0x7f1c600c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c6006bdf0 0x7f1c600c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 -- 172.21.15.119:0/3524299170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48009420 con 0x7f1c600cb810 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c57fff640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c6006c1d0 0x7f1c6014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5ed9d640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015c040 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1c58001570 tx=0x7f1c5800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800a640 con 0x7f1c600cb810 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5800a7c0 con 0x7f1c600cb810 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800ab70 con 0x7f1c600cb810 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600c3eb0 con 0x7f1c600cb810 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600c4470 con 0x7f1c600cb810 2023-12-19T16:17:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c60066cc0 con 0x7f1c600cb810 2023-12-19T16:17:48.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.907+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c5800acd0 con 0x7f1c600cb810 2023-12-19T16:17:48.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.911+0000 7f1c56ffd640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1c40065a60 0x7f1c40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.911+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1c58082420 con 0x7f1c600cb810 2023-12-19T16:17:48.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.911+0000 7f1c5e59c640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1c40065a60 0x7f1c40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.911+0000 7f1c5e59c640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1c40065a60 0x7f1c40067f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1c6015cc50 tx=0x7f1c50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:48.915+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1c58050130 con 0x7f1c600cb810 2023-12-19T16:17:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.063+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c6004e850 con 0x7f1c600cb810 2023-12-19T16:17:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.063+0000 7f1c56ffd640 1 -- 172.21.15.119:0/3524299170 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c580180a0 con 0x7f1c600cb810 2023-12-19T16:17:49.068 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:17:49.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1c40065a60 msgr2=0x7f1c40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1c40065a60 0x7f1c40067f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1c6015cc50 tx=0x7f1c50008040 comp rx=0 tx=0).stop 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 msgr2=0x7f1c6015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015c040 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1c58001570 tx=0x7f1c5800cca0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 shutdown_connections 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1c40065a60 0x7f1c40067f20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c600cb810 0x7f1c6015c040 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c6006c1d0 0x7f1c6014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 --2- 172.21.15.119:0/3524299170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c6006bdf0 0x7f1c600c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 >> 172.21.15.119:0/3524299170 conn(0x7f1c6006a2a0 msgr2=0x7f1c6014f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 shutdown_connections 2023-12-19T16:17:49.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.067+0000 7f1c5f59e640 1 -- 172.21.15.119:0/3524299170 wait complete. 2023-12-19T16:17:49.090 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:17:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 Processor -- start 2023-12-19T16:17:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 -- start start 2023-12-19T16:17:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d380cac10 0x7f0d3815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d38070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3815f100 con 0x7f0d3815a680 2023-12-19T16:17:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d38070780 con 0x7f0d380cac10 2023-12-19T16:17:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d3dc95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380ca7d0 con 0x7f0d3806fdb0 2023-12-19T16:17:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.223+0000 7f0d36ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d380cac10 0x7f0d3815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d377fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0d3815a680 0x7f0d3815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37304/0 (socket says 172.21.15.119:37304) 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d377fe640 1 -- 172.21.15.119:0/2749793806 learned_addr learned my addr 172.21.15.119:0/2749793806 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d37fff640 1 --2- 172.21.15.119:0/2749793806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d38070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d36ffd640 1 -- 172.21.15.119:0/2749793806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 msgr2=0x7f0d38070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d36ffd640 1 --2- 172.21.15.119:0/2749793806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d38070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d36ffd640 1 -- 172.21.15.119:0/2749793806 >> v1:172.21.15.119:6789/0 conn(0x7f0d3815a680 legacy=0x7f0d3815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d36ffd640 1 -- 172.21.15.119:0/2749793806 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3815e860 con 0x7f0d380cac10 2023-12-19T16:17:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d367fc640 1 -- 172.21.15.119:0/2749793806 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116390740 0 0) 0x7f0d3815f100 con 0x7f0d3815a680 2023-12-19T16:17:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d36ffd640 1 --2- 172.21.15.119:0/2749793806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d380cac10 0x7f0d3815e160 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ce6f99a8ca1f90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d367fc640 1 -- 172.21.15.119:0/2749793806 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0ab5f0 con 0x7f0d380cac10 2023-12-19T16:17:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d367fc640 1 -- 172.21.15.119:0/2749793806 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0ab750 con 0x7f0d380cac10 2023-12-19T16:17:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d367fc640 1 -- 172.21.15.119:0/2749793806 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0abae0 con 0x7f0d380cac10 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2749793806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d380cac10 msgr2=0x7f0d3815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.227+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2749793806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d380cac10 0x7f0d3815e160 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01c3f0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2749793806 shutdown_connections 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2749793806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d38070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2749793806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d380cac10 0x7f0d3815e160 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2749793806 >> 172.21.15.119:0/2749793806 conn(0x7f0d3806a3e0 msgr2=0x7f0d380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2749793806 shutdown_connections 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2749793806 wait complete. 2023-12-19T16:17:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 Processor -- start 2023-12-19T16:17:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- start start 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d380af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d380cac10 0x7f0d380c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 0x7f0d380c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380c2790 con 0x7f0d3815a680 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380c2a70 con 0x7f0d380cac10 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d3dc95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380c2d50 con 0x7f0d3806fdb0 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 0x7f0d380c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 0x7f0d380c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48294/0 (socket says 172.21.15.119:48294) 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 -- 172.21.15.119:0/2429034367 learned_addr learned my addr 172.21.15.119:0/2429034367 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d377fe640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d380af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d36ffd640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d380cac10 0x7f0d380c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 -- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 msgr2=0x7f0d380af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d380af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 -- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d380cac10 msgr2=0x7f0d380c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d380cac10 0x7f0d380c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.231+0000 7f0d37fff640 1 -- 172.21.15.119:0/2429034367 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c009420 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d37fff640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 0x7f0d380c4040 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0d30007e60 tx=0x7f0d3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30014420 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d300145a0 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d380c3030 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30014950 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d380afb00 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d380735b0 con 0x7f0d3815a680 2023-12-19T16:17:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d30014ab0 con 0x7f0d3815a680 2023-12-19T16:17:49.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d1ffff640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0d24065a60 0x7f0d24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0d30083760 con 0x7f0d3815a680 2023-12-19T16:17:49.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d377fe640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0d24065a60 0x7f0d24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.235+0000 7f0d377fe640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0d24065a60 0x7f0d24067f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d28007fd0 tx=0x7f0d28007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.239+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0d300513d0 con 0x7f0d3815a680 2023-12-19T16:17:49.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0d380c88b0 con 0x7f0d3815a680 2023-12-19T16:17:49.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d1ffff640 1 -- 172.21.15.119:0/2429034367 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0d300549f0 con 0x7f0d3815a680 2023-12-19T16:17:49.399 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:49.399 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2023-12-19T16:17:49.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2023-12-19T16:17:49.400 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2023-12-19T16:17:49.400 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2023-12-19T16:17:49.400 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:49.400 INFO:teuthology.orchestra.run.smithi119.stdout:] 2023-12-19T16:17:49.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0d24065a60 msgr2=0x7f0d24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0d24065a60 0x7f0d24067f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d28007fd0 tx=0x7f0d28007d60 comp rx=0 tx=0).stop 2023-12-19T16:17:49.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 msgr2=0x7f0d380c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 0x7f0d380c4040 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0d30007e60 tx=0x7f0d3000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 shutdown_connections 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0d24065a60 0x7f0d24067f20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d380cac10 0x7f0d380c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3815a680 0x7f0d380c4040 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 --2- 172.21.15.119:0/2429034367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3806fdb0 0x7f0d380af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.395+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 >> 172.21.15.119:0/2429034367 conn(0x7f0d3806a3e0 msgr2=0x7f0d3815aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.399+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 shutdown_connections 2023-12-19T16:17:49.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.399+0000 7f0d3dc95640 1 -- 172.21.15.119:0/2429034367 wait complete. 2023-12-19T16:17:49.423 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:17:49.423 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:17:49.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.559+0000 7fe794bce640 1 Processor -- start 2023-12-19T16:17:49.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.559+0000 7fe794bce640 1 -- start start 2023-12-19T16:17:49.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe794bce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7900ce5d0 0x7fe7900ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe794bce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe79006d8a0 0x7fe79015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe794bce640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900b28a0 con 0x7fe79006d440 2023-12-19T16:17:49.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe794bce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79006dcd0 con 0x7fe79006d8a0 2023-12-19T16:17:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe794bce640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7900ac1a0 con 0x7fe7900ce5d0 2023-12-19T16:17:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe79006d8a0 0x7fe79015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe79006d8a0 0x7fe79015e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48304/0 (socket says 172.21.15.119:48304) 2023-12-19T16:17:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 -- 172.21.15.119:0/3297459719 learned_addr learned my addr 172.21.15.119:0/3297459719 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78e59c640 1 --2- 172.21.15.119:0/3297459719 >> v2:172.21.15.143:3300/0 conn(0x7fe7900ce5d0 0x7fe7900ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 -- 172.21.15.119:0/3297459719 >> v2:172.21.15.143:3300/0 conn(0x7fe7900ce5d0 msgr2=0x7fe7900ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:49.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 --2- 172.21.15.119:0/3297459719 >> v2:172.21.15.143:3300/0 conn(0x7fe7900ce5d0 0x7fe7900ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 -- 172.21.15.119:0/3297459719 >> v1:172.21.15.143:6789/0 conn(0x7fe79006d440 legacy=0x7fe79015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.563+0000 7fe78ed9d640 1 -- 172.21.15.119:0/3297459719 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900ceef0 con 0x7fe79006d8a0 2023-12-19T16:17:49.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe78ed9d640 1 --2- 172.21.15.119:0/3297459719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe79015e9e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe79006ac50 tx=0x7fe78801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf80854e1f6085d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:49.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe78dd9b640 1 -- 172.21.15.119:0/3297459719 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880a5890 con 0x7fe79006d8a0 2023-12-19T16:17:49.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe78dd9b640 1 -- 172.21.15.119:0/3297459719 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880a59f0 con 0x7fe79006d8a0 2023-12-19T16:17:49.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe78dd9b640 1 -- 172.21.15.119:0/3297459719 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880a5d80 con 0x7fe79006d8a0 2023-12-19T16:17:49.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 -- 172.21.15.119:0/3297459719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 msgr2=0x7fe79015e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 --2- 172.21.15.119:0/3297459719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe79015e9e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe79006ac50 tx=0x7fe78801c9d0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 -- 172.21.15.119:0/3297459719 shutdown_connections 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 --2- 172.21.15.119:0/3297459719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe79015e9e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 --2- 172.21.15.119:0/3297459719 >> v2:172.21.15.143:3300/0 conn(0x7fe7900ce5d0 0x7fe7900ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 -- 172.21.15.119:0/3297459719 >> 172.21.15.119:0/3297459719 conn(0x7fe790069e70 msgr2=0x7fe79006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 -- 172.21.15.119:0/3297459719 shutdown_connections 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 -- 172.21.15.119:0/3297459719 wait complete. 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 Processor -- start 2023-12-19T16:17:49.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.567+0000 7fe794bce640 1 -- start start 2023-12-19T16:17:49.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe79006d440 0x7fe790157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe7900afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7900ce5d0 0x7fe7900b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901596e0 con 0x7fe79006d8a0 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901599c0 con 0x7fe79006d440 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe790159ca0 con 0x7fe7900ce5d0 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe7900afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe7900afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48318/0 (socket says 172.21.15.119:48318) 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 -- 172.21.15.119:0/190009751 learned_addr learned my addr 172.21.15.119:0/190009751 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe78e59c640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe79006d440 0x7fe790157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe78ed9d640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7900ce5d0 0x7fe7900b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 -- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7900ce5d0 msgr2=0x7fe7900b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7900ce5d0 0x7fe7900b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 -- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe79006d440 msgr2=0x7fe790157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe79006d440 0x7fe790157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 -- 172.21.15.119:0/190009751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788009b30 con 0x7fe79006d8a0 2023-12-19T16:17:49.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe785d9b640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe7900afe00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c3c0 tx=0x7fe77800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7780052d0 con 0x7fe79006d8a0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe778005430 con 0x7fe79006d8a0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778003840 con 0x7fe79006d8a0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790159f80 con 0x7fe79006d8a0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe790144840 con 0x7fe79006d8a0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.571+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79015a4a0 con 0x7fe79006d8a0 2023-12-19T16:17:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.575+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe7780039a0 con 0x7fe79006d8a0 2023-12-19T16:17:49.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.575+0000 7fe7877fe640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe770065a60 0x7fe770067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:49.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.575+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe7780824b0 con 0x7fe79006d8a0 2023-12-19T16:17:49.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.575+0000 7fe78e59c640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe770065a60 0x7fe770067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:49.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.575+0000 7fe78e59c640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe770065a60 0x7fe770067f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe780009b60 tx=0x7fe780009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:49.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.579+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe79015a4a0 con 0x7fe79006d8a0 2023-12-19T16:17:49.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:49.731+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe79015a4a0 con 0x7fe79006d8a0 2023-12-19T16:17:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.627+0000 7fe7877fe640 1 -- 172.21.15.119:0/190009751 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe79015a4a0 con 0x7fe79006d8a0 2023-12-19T16:17:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2023-12-19T16:17:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe770065a60 msgr2=0x7fe770067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe770065a60 0x7fe770067f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe780009b60 tx=0x7fe780009190 comp rx=0 tx=0).stop 2023-12-19T16:17:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 msgr2=0x7fe7900afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe7900afe00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c3c0 tx=0x7fe77800c880 comp rx=0 tx=0).stop 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 shutdown_connections 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe770065a60 0x7fe770067f20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7900ce5d0 0x7fe7900b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe79006d8a0 0x7fe7900afe00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 --2- 172.21.15.119:0/190009751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe79006d440 0x7fe790157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 >> 172.21.15.119:0/190009751 conn(0x7fe790069e70 msgr2=0x7fe7900c55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 shutdown_connections 2023-12-19T16:17:50.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.631+0000 7fe794bce640 1 -- 172.21.15.119:0/190009751 wait complete. 2023-12-19T16:17:50.662 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:17:50.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 Processor -- start 2023-12-19T16:17:50.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 -- start start 2023-12-19T16:17:50.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58ac0afed0 0x7f58ac0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:50.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac159c60 0x7f58ac15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:50.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac15a630 con 0x7f58ac0ca9d0 2023-12-19T16:17:50.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac0b0850 con 0x7f58ac0afed0 2023-12-19T16:17:50.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b23a6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0c8a10 con 0x7f58ac159c60 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58ab7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58ac0afed0 0x7f58ac0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58ab7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58ac0afed0 0x7f58ac0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48326/0 (socket says 172.21.15.119:48326) 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58ab7fe640 1 -- 172.21.15.119:0/2496803660 learned_addr learned my addr 172.21.15.119:0/2496803660 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.803+0000 7f58b0943640 1 --2- 172.21.15.119:0/2496803660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac159c60 0x7f58ac15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58ab7fe640 1 -- 172.21.15.119:0/2496803660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac159c60 msgr2=0x7f58ac15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58ab7fe640 1 --2- 172.21.15.119:0/2496803660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac159c60 0x7f58ac15a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58ab7fe640 1 -- 172.21.15.119:0/2496803660 >> v1:172.21.15.143:6789/0 conn(0x7f58ac0ca9d0 legacy=0x7f58ac0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58ab7fe640 1 -- 172.21.15.119:0/2496803660 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac15a860 con 0x7f58ac0afed0 2023-12-19T16:17:50.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58ab7fe640 1 --2- 172.21.15.119:0/2496803660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac0afed0 0x7f58ac0b0310 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f58a000bb10 tx=0x7f58a001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffb7501ab91a41a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:50.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58aaffd640 1 -- 172.21.15.119:0/2496803660 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a7c20 con 0x7f58ac0afed0 2023-12-19T16:17:50.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58aaffd640 1 -- 172.21.15.119:0/2496803660 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a00a7d80 con 0x7f58ac0afed0 2023-12-19T16:17:50.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58aaffd640 1 -- 172.21.15.119:0/2496803660 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00af660 con 0x7f58ac0afed0 2023-12-19T16:17:50.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58b23a6640 1 -- 172.21.15.119:0/2496803660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac0afed0 msgr2=0x7f58ac0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:50.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58b23a6640 1 --2- 172.21.15.119:0/2496803660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac0afed0 0x7f58ac0b0310 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f58a000bb10 tx=0x7f58a001eb50 comp rx=0 tx=0).stop 2023-12-19T16:17:50.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58b23a6640 1 -- 172.21.15.119:0/2496803660 shutdown_connections 2023-12-19T16:17:50.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58b23a6640 1 --2- 172.21.15.119:0/2496803660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac159c60 0x7f58ac15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58b23a6640 1 --2- 172.21.15.119:0/2496803660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac0afed0 0x7f58ac0b0310 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.807+0000 7f58b23a6640 1 -- 172.21.15.119:0/2496803660 >> 172.21.15.119:0/2496803660 conn(0x7f58ac0ce450 msgr2=0x7f58ac0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:50.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 -- 172.21.15.119:0/2496803660 shutdown_connections 2023-12-19T16:17:50.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 -- 172.21.15.119:0/2496803660 wait complete. 2023-12-19T16:17:50.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 Processor -- start 2023-12-19T16:17:50.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 -- start start 2023-12-19T16:17:50.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac0afed0 0x7f58ac152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:50.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58ac0ca9d0 0x7f58ac0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 0x7f58ac0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1526b0 con 0x7f58ac159c60 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0c33a0 con 0x7f58ac0ca9d0 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b23a6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0c3680 con 0x7f58ac0afed0 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 0x7f58ac0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 0x7f58ac0c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48332/0 (socket says 172.21.15.119:48332) 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 -- 172.21.15.119:0/3370308896 learned_addr learned my addr 172.21.15.119:0/3370308896 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:50.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58abfff640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac0afed0 0x7f58ac152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58ab7fe640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58ac0ca9d0 0x7f58ac0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 -- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac0afed0 msgr2=0x7f58ac152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac0afed0 0x7f58ac152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 -- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58ac0ca9d0 msgr2=0x7f58ac0c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58ac0ca9d0 0x7f58ac0c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 -- 172.21.15.119:0/3370308896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a000b770 con 0x7f58ac159c60 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.811+0000 7f58b0943640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 0x7f58ac0c0f50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f58a4007e60 tx=0x7f58a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4014420 con 0x7f58ac159c60 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40145a0 con 0x7f58ac159c60 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac0c3960 con 0x7f58ac159c60 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4014950 con 0x7f58ac159c60 2023-12-19T16:17:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac0c3f20 con 0x7f58ac159c60 2023-12-19T16:17:50.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac066e70 con 0x7f58ac159c60 2023-12-19T16:17:50.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f58a4014ab0 con 0x7f58ac159c60 2023-12-19T16:17:50.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58a8ff9640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5898065a60 0x7f5898067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:50.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f58a4083990 con 0x7f58ac159c60 2023-12-19T16:17:50.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58abfff640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5898065a60 0x7f5898067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:50.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.815+0000 7f58abfff640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5898065a60 0x7f5898067f20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f589c007fd0 tx=0x7f589c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:50.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.819+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f58a4051400 con 0x7f58ac159c60 2023-12-19T16:17:50.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:50.975+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58ac0c4110 con 0x7f58ac159c60 2023-12-19T16:17:51.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.639+0000 7f58a8ff9640 1 -- 172.21.15.119:0/3370308896 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7f58a4054a20 con 0x7f58ac159c60 2023-12-19T16:17:51.647 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2023-12-19T16:17:51.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.643+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5898065a60 msgr2=0x7f5898067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:51.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.643+0000 7f58b23a6640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5898065a60 0x7f5898067f20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f589c007fd0 tx=0x7f589c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:51.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.643+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 msgr2=0x7f58ac0c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:51.649 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.643+0000 7f58b23a6640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 0x7f58ac0c0f50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f58a4007e60 tx=0x7f58a400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.647+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 shutdown_connections 2023-12-19T16:17:51.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.647+0000 7f58b23a6640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5898065a60 0x7f5898067f20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.647+0000 7f58b23a6640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58ac0ca9d0 0x7f58ac0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.647+0000 7f58b23a6640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58ac159c60 0x7f58ac0c0f50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.647+0000 7f58b23a6640 1 --2- 172.21.15.119:0/3370308896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58ac0afed0 0x7f58ac152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.647+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 >> 172.21.15.119:0/3370308896 conn(0x7f58ac0ce450 msgr2=0x7f58ac0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:51.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.651+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 shutdown_connections 2023-12-19T16:17:51.662 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.655+0000 7f58b23a6640 1 -- 172.21.15.119:0/3370308896 wait complete. 2023-12-19T16:17:51.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:17:51.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 Processor -- start 2023-12-19T16:17:51.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 -- start start 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5c8c0ca410 0x7f5c8c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5c8c159fb0 0x7f5c8c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8c15aab0 con 0x7f5c8c0ca410 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8c070df0 con 0x7f5c8c159fb0 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c93925640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c15a4f0 con 0x7f5c8c071db0 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c916c1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5c8c0ca410 0x7f5c8c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c916c1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5c8c0ca410 0x7f5c8c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48344/0 (socket says 172.21.15.119:48344) 2023-12-19T16:17:51.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.827+0000 7f5c916c1640 1 -- 172.21.15.119:0/3424893590 learned_addr learned my addr 172.21.15.119:0/3424893590 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c91ec2640 1 --2- 172.21.15.119:0/3424893590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c90ec0640 1 --2- 172.21.15.119:0/3424893590 >> v2:172.21.15.143:3300/0 conn(0x7f5c8c159fb0 0x7f5c8c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c916c1640 1 -- 172.21.15.119:0/3424893590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 msgr2=0x7f5c8c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c916c1640 1 --2- 172.21.15.119:0/3424893590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c916c1640 1 -- 172.21.15.119:0/3424893590 >> v2:172.21.15.143:3300/0 conn(0x7f5c8c159fb0 msgr2=0x7f5c8c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c916c1640 1 --2- 172.21.15.119:0/3424893590 >> v2:172.21.15.143:3300/0 conn(0x7f5c8c159fb0 0x7f5c8c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c916c1640 1 -- 172.21.15.119:0/3424893590 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c15a7d0 con 0x7f5c8c0ca410 2023-12-19T16:17:51.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c90ec0640 1 --2- 172.21.15.119:0/3424893590 >> v2:172.21.15.143:3300/0 conn(0x7f5c8c159fb0 0x7f5c8c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:51.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c916c1640 1 --2- 172.21.15.119:0/3424893590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c159a70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0cbeb0 tx=0x7f5c8801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a74054c24794a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:51.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c83fff640 1 -- 172.21.15.119:0/3424893590 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880ac600 con 0x7f5c8c0ca410 2023-12-19T16:17:51.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c83fff640 1 -- 172.21.15.119:0/3424893590 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c880a8050 con 0x7f5c8c0ca410 2023-12-19T16:17:51.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c83fff640 1 -- 172.21.15.119:0/3424893590 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880ac980 con 0x7f5c8c0ca410 2023-12-19T16:17:51.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c93925640 1 -- 172.21.15.119:0/3424893590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c0ca410 msgr2=0x7f5c8c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:51.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.831+0000 7f5c93925640 1 --2- 172.21.15.119:0/3424893590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c159a70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0cbeb0 tx=0x7f5c8801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- 172.21.15.119:0/3424893590 shutdown_connections 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 --2- 172.21.15.119:0/3424893590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 --2- 172.21.15.119:0/3424893590 >> v2:172.21.15.143:3300/0 conn(0x7f5c8c159fb0 0x7f5c8c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 --2- 172.21.15.119:0/3424893590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c159a70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- 172.21.15.119:0/3424893590 >> 172.21.15.119:0/3424893590 conn(0x7f5c8c06a2a0 msgr2=0x7f5c8c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- 172.21.15.119:0/3424893590 shutdown_connections 2023-12-19T16:17:51.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- 172.21.15.119:0/3424893590 wait complete. 2023-12-19T16:17:51.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 Processor -- start 2023-12-19T16:17:51.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- start start 2023-12-19T16:17:51.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 0x7f5c8c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c155220 con 0x7f5c8c159fb0 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c154460 con 0x7f5c8c0ca410 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c93925640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c154740 con 0x7f5c8c071db0 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 0x7f5c8c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c90ec0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 0x7f5c8c0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48350/0 (socket says 172.21.15.119:48350) 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 -- 172.21.15.119:0/4294110043 learned_addr learned my addr 172.21.15.119:0/4294110043 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:51.841 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c916c1640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 -- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 msgr2=0x7f5c8c1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:51.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 -- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c8c0ca410 msgr2=0x7f5c8c14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:51.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:51.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.835+0000 7f5c91ec2640 1 -- 172.21.15.119:0/4294110043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880094d0 con 0x7f5c8c159fb0 2023-12-19T16:17:51.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c91ec2640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 0x7f5c8c0c6b70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5c84007e60 tx=0x7f5c8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84014420 con 0x7f5c8c159fb0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c840145a0 con 0x7f5c8c159fb0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84014950 con 0x7f5c8c159fb0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c154a20 con 0x7f5c8c159fb0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c156620 con 0x7f5c8c159fb0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c04e000 con 0x7f5c8c159fb0 2023-12-19T16:17:51.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.839+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5c84014ab0 con 0x7f5c8c159fb0 2023-12-19T16:17:51.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.843+0000 7f5c81ffb640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5c70065a60 0x7f5c70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:51.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.843+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f5c84083a80 con 0x7f5c8c159fb0 2023-12-19T16:17:51.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.843+0000 7f5c916c1640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5c70065a60 0x7f5c70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:51.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.843+0000 7f5c916c1640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5c70065a60 0x7f5c70067f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5c880ae000 tx=0x7f5c880a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:51.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:51.847+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5c84051400 con 0x7f5c8c159fb0 2023-12-19T16:17:52.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.027+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c8c0c4e40 con 0x7f5c8c159fb0 2023-12-19T16:17:52.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.035+0000 7f5c81ffb640 1 -- 172.21.15.119:0/4294110043 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c84054a20 con 0x7f5c8c159fb0 2023-12-19T16:17:52.040 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 8 and data pool 9 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.051+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5c70065a60 msgr2=0x7f5c70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.051+0000 7f5c93925640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5c70065a60 0x7f5c70067f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5c880ae000 tx=0x7f5c880a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.051+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 msgr2=0x7f5c8c0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.051+0000 7f5c93925640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 0x7f5c8c0c6b70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5c84007e60 tx=0x7f5c8400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.059+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 shutdown_connections 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.059+0000 7f5c93925640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5c70065a60 0x7f5c70067f20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.059+0000 7f5c93925640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c8c0ca410 0x7f5c8c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.059+0000 7f5c93925640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c8c159fb0 0x7f5c8c0c6b70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.059+0000 7f5c93925640 1 --2- 172.21.15.119:0/4294110043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5c8c071db0 0x7f5c8c1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.059+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 >> 172.21.15.119:0/4294110043 conn(0x7f5c8c06a2a0 msgr2=0x7f5c8c15bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:52.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.063+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 shutdown_connections 2023-12-19T16:17:52.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.063+0000 7f5c93925640 1 -- 172.21.15.119:0/4294110043 wait complete. 2023-12-19T16:17:52.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:52.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f6791da6640 1 Processor -- start 2023-12-19T16:17:52.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f6791da6640 1 -- start start 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f6791da6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0cb180 0x7f678c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f6791da6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c070b80 con 0x7f678c158c20 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f6791da6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c070e60 con 0x7f678c15c800 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f6791da6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c071140 con 0x7f678c0cb180 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f678c158c20 0x7f678c0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37318/0 (socket says 172.21.15.119:37318) 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678b7fe640 1 -- 172.21.15.119:0/3245507400 learned_addr learned my addr 172.21.15.119:0/3245507400 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678affd640 1 --2- 172.21.15.119:0/3245507400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0cb180 0x7f678c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285923304 0 0) 0x7f678c070b80 con 0x7f678c158c20 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6774003530 con 0x7f678c158c20 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847495931 0 0) 0x7f678c070e60 con 0x7f678c15c800 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f678c070b80 con 0x7f678c15c800 2023-12-19T16:17:52.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599241795 0 0) 0x7f6774003530 con 0x7f678c158c20 2023-12-19T16:17:52.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678affd640 1 -- 172.21.15.119:0/3245507400 >> v1:172.21.15.143:6789/0 conn(0x7f678c15c800 legacy=0x7f678c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678affd640 1 -- 172.21.15.119:0/3245507400 >> v1:172.21.15.119:6789/0 conn(0x7f678c158c20 legacy=0x7f678c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.227+0000 7f678affd640 1 -- 172.21.15.119:0/3245507400 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c071420 con 0x7f678c0cb180 2023-12-19T16:17:52.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f678affd640 1 --2- 172.21.15.119:0/3245507400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0cb180 0x7f678c070510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67800097f0 tx=0x7f678001cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccab145034dc318d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c001680 con 0x7f678c0cb180 2023-12-19T16:17:52.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800a7050 con 0x7f678c0cb180 2023-12-19T16:17:52.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f678a7fc640 1 -- 172.21.15.119:0/3245507400 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800ab600 con 0x7f678c0cb180 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 -- 172.21.15.119:0/3245507400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0cb180 msgr2=0x7f678c070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 --2- 172.21.15.119:0/3245507400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0cb180 0x7f678c070510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67800097f0 tx=0x7f678001cd80 comp rx=0 tx=0).stop 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 -- 172.21.15.119:0/3245507400 shutdown_connections 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 --2- 172.21.15.119:0/3245507400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c0cb180 0x7f678c070510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 -- 172.21.15.119:0/3245507400 >> 172.21.15.119:0/3245507400 conn(0x7f678c06a3e0 msgr2=0x7f678c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 -- 172.21.15.119:0/3245507400 shutdown_connections 2023-12-19T16:17:52.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.231+0000 7f6791da6640 1 -- 172.21.15.119:0/3245507400 wait complete. 2023-12-19T16:17:52.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 Processor -- start 2023-12-19T16:17:52.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 -- start start 2023-12-19T16:17:52.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 0x7f678c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678c158c20 0x7f678c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c15c800 0x7f678c14b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c15af00 con 0x7f678c0cb180 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c15a0a0 con 0x7f678c158c20 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c15a2f0 con 0x7f678c15c800 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 0x7f678c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 0x7f678c0adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48356/0 (socket says 172.21.15.119:48356) 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 -- 172.21.15.119:0/4076436767 learned_addr learned my addr 172.21.15.119:0/4076436767 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678bfff640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c15c800 0x7f678c14b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678affd640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678c158c20 0x7f678c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 -- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c15c800 msgr2=0x7f678c14b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c15c800 0x7f678c14b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 -- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678c158c20 msgr2=0x7f678c159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678c158c20 0x7f678c159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 -- 172.21.15.119:0/4076436767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009420 con 0x7f678c0cb180 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678affd640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678c158c20 0x7f678c159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f678b7fe640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 0x7f678c0adde0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f677c00c750 tx=0x7f677c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c005af0 con 0x7f678c0cb180 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c005c50 con 0x7f678c0cb180 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c0c8800 con 0x7f678c0cb180 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c007070 con 0x7f678c0cb180 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.235+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c15a8b0 con 0x7f678c0cb180 2023-12-19T16:17:52.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.239+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c0735b0 con 0x7f678c0cb180 2023-12-19T16:17:52.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.239+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f677c0071d0 con 0x7f678c0cb180 2023-12-19T16:17:52.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.239+0000 7f6773fff640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6778065a60 0x7f6778067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.239+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f677c082fa0 con 0x7f678c0cb180 2023-12-19T16:17:52.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.239+0000 7f678affd640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6778065a60 0x7f6778067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.239+0000 7f678affd640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6778065a60 0x7f6778067f20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f67800ad000 tx=0x7f6780004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.243+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f677c0b40a0 con 0x7f678c0cb180 2023-12-19T16:17:52.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.395+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f678c04e000 con 0x7f678c0cb180 2023-12-19T16:17:52.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.395+0000 7f6773fff640 1 -- 172.21.15.119:0/4076436767 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16363 (secure 0 0 0) 0x7f677c050820 con 0x7f678c0cb180 2023-12-19T16:17:52.400 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:52.400 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":54,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:52.030502+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:52.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6778065a60 msgr2=0x7f6778067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6778065a60 0x7f6778067f20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f67800ad000 tx=0x7f6780004740 comp rx=0 tx=0).stop 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 msgr2=0x7f678c0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 0x7f678c0adde0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f677c00c750 tx=0x7f677c00cc10 comp rx=0 tx=0).stop 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 shutdown_connections 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6778065a60 0x7f6778067f20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f678c158c20 0x7f678c159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678c15c800 0x7f678c14b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 --2- 172.21.15.119:0/4076436767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f678c0cb180 0x7f678c0adde0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 >> 172.21.15.119:0/4076436767 conn(0x7f678c06a3e0 msgr2=0x7f678c156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 shutdown_connections 2023-12-19T16:17:52.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.399+0000 7f6791da6640 1 -- 172.21.15.119:0/4076436767 wait complete. 2023-12-19T16:17:52.422 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 Processor -- start 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 -- start start 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f95fc15ca40 0x7f95fc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 0x7f95fc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0cfa70 con 0x7f95fc0cf610 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0d11c0 con 0x7f95fc15ca40 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9603da6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0d0310 con 0x7f95fc0ce3f0 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 0x7f95fc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 0x7f95fc0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:46038/0 (socket says 172.21.15.119:46038) 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 -- 172.21.15.119:0/764861658 learned_addr learned my addr 172.21.15.119:0/764861658 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601b42640 1 --2- 172.21.15.119:0/764861658 >> v2:172.21.15.143:3300/0 conn(0x7f95fc15ca40 0x7f95fc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9602343640 1 --1- 172.21.15.119:0/764861658 >> v1:172.21.15.143:6789/0 conn(0x7f95fc0cf610 0x7f95fc1605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:47142/0 (socket says 172.21.15.119:47142) 2023-12-19T16:17:52.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 -- 172.21.15.119:0/764861658 >> v2:172.21.15.143:3300/0 conn(0x7f95fc15ca40 msgr2=0x7f95fc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:52.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 --2- 172.21.15.119:0/764861658 >> v2:172.21.15.143:3300/0 conn(0x7f95fc15ca40 0x7f95fc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 -- 172.21.15.119:0/764861658 >> v1:172.21.15.143:6789/0 conn(0x7f95fc0cf610 legacy=0x7f95fc1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.555+0000 7f9601341640 1 -- 172.21.15.119:0/764861658 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0d05b0 con 0x7f95fc0ce3f0 2023-12-19T16:17:52.563 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9601341640 1 --2- 172.21.15.119:0/764861658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 0x7f95fc0cf0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95ec006fd0 tx=0x7f95ec01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e96bd1efa5aef95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9600b40640 1 -- 172.21.15.119:0/764861658 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0ab640 con 0x7f95fc0ce3f0 2023-12-19T16:17:52.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9600b40640 1 -- 172.21.15.119:0/764861658 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec0a7070 con 0x7f95fc0ce3f0 2023-12-19T16:17:52.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9600b40640 1 -- 172.21.15.119:0/764861658 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0ab9c0 con 0x7f95fc0ce3f0 2023-12-19T16:17:52.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 -- 172.21.15.119:0/764861658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 msgr2=0x7f95fc0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.564 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 --2- 172.21.15.119:0/764861658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 0x7f95fc0cf0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95ec006fd0 tx=0x7f95ec01c520 comp rx=0 tx=0).stop 2023-12-19T16:17:52.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 -- 172.21.15.119:0/764861658 shutdown_connections 2023-12-19T16:17:52.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 --2- 172.21.15.119:0/764861658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0ce3f0 0x7f95fc0cf0d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 --2- 172.21.15.119:0/764861658 >> v2:172.21.15.143:3300/0 conn(0x7f95fc15ca40 0x7f95fc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 -- 172.21.15.119:0/764861658 >> 172.21.15.119:0/764861658 conn(0x7f95fc089fb0 msgr2=0x7f95fc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:52.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 -- 172.21.15.119:0/764861658 shutdown_connections 2023-12-19T16:17:52.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.559+0000 7f9603da6640 1 -- 172.21.15.119:0/764861658 wait complete. 2023-12-19T16:17:52.567 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 Processor -- start 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 -- start start 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95fc0ce3f0 0x7f95fc15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0cf610 0x7f95fc0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 0x7f95fc0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15afd0 con 0x7f95fc15ca40 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15c280 con 0x7f95fc0ce3f0 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15b1e0 con 0x7f95fc0cf610 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 0x7f95fc0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 0x7f95fc0b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56330/0 (socket says 172.21.15.119:56330) 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 -- 172.21.15.119:0/3709282831 learned_addr learned my addr 172.21.15.119:0/3709282831 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9601341640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0cf610 0x7f95fc0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9601b42640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95fc0ce3f0 0x7f95fc15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 -- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0cf610 msgr2=0x7f95fc0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0cf610 0x7f95fc0b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 -- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95fc0ce3f0 msgr2=0x7f95fc15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95fc0ce3f0 0x7f95fc15aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 -- 172.21.15.119:0/3709282831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009480 con 0x7f95fc15ca40 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9602343640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 0x7f95fc0b4160 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c730 tx=0x7f95f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4004d70 con 0x7f95fc15ca40 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f400a640 con 0x7f95fc15ca40 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc15b4c0 con 0x7f95fc15ca40 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400a9d0 con 0x7f95fc15ca40 2023-12-19T16:17:52.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.563+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc15ba80 con 0x7f95fc15ca40 2023-12-19T16:17:52.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.567+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc04e000 con 0x7f95fc15ca40 2023-12-19T16:17:52.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.567+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95f400ad40 con 0x7f95fc15ca40 2023-12-19T16:17:52.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.567+0000 7f95f27fc640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f95e0065a60 0x7f95e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.567+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95f4082850 con 0x7f95fc15ca40 2023-12-19T16:17:52.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.567+0000 7f9601b42640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f95e0065a60 0x7f95e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.567+0000 7f9601b42640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f95e0065a60 0x7f95e0067f20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0d1d20 tx=0x7f95f8006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.571+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f95f4050180 con 0x7f95fc15ca40 2023-12-19T16:17:52.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.723+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95fc0cff10 con 0x7f95fc15ca40 2023-12-19T16:17:52.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.723+0000 7f95f27fc640 1 -- 172.21.15.119:0/3709282831 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16363 (secure 0 0 0) 0x7f95f4018090 con 0x7f95fc15ca40 2023-12-19T16:17:52.729 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:52.729 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":54,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:52.030502+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f95e0065a60 msgr2=0x7f95e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f95e0065a60 0x7f95e0067f20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0d1d20 tx=0x7f95f8006f90 comp rx=0 tx=0).stop 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 msgr2=0x7f95fc0b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 0x7f95fc0b4160 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c730 tx=0x7f95f400cbf0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 shutdown_connections 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f95e0065a60 0x7f95e0067f20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95fc15ca40 0x7f95fc0b4160 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95fc0cf610 0x7f95fc0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 --2- 172.21.15.119:0/3709282831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95fc0ce3f0 0x7f95fc15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 >> 172.21.15.119:0/3709282831 conn(0x7f95fc089fb0 msgr2=0x7f95fc0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:52.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 shutdown_connections 2023-12-19T16:17:52.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.727+0000 7f9603da6640 1 -- 172.21.15.119:0/3709282831 wait complete. 2023-12-19T16:17:52.750 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:17:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 Processor -- start 2023-12-19T16:17:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 -- start start 2023-12-19T16:17:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdfdc15cae0 0x7fdfdc0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 0x7fdfdc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc15cec0 con 0x7fdfdc0cde90 2023-12-19T16:17:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0d0530 con 0x7fdfdc15cae0 2023-12-19T16:17:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfe221f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0d0810 con 0x7fdfdc0cf880 2023-12-19T16:17:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 0x7fdfdc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdfdc15cae0 0x7fdfdc0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 0x7fdfdc0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:46056/0 (socket says 172.21.15.119:46056) 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 -- 172.21.15.119:0/2357237078 learned_addr learned my addr 172.21.15.119:0/2357237078 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfda7fc640 1 -- 172.21.15.119:0/2357237078 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624979114 0 0) 0x7fdfdc15cec0 con 0x7fdfdc0cde90 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 -- 172.21.15.119:0/2357237078 >> v2:172.21.15.143:3300/0 conn(0x7fdfdc15cae0 msgr2=0x7fdfdc0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 --2- 172.21.15.119:0/2357237078 >> v2:172.21.15.143:3300/0 conn(0x7fdfdc15cae0 0x7fdfdc0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 -- 172.21.15.119:0/2357237078 >> v1:172.21.15.143:6789/0 conn(0x7fdfdc0cde90 legacy=0x7fdfdc0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdbfff640 1 -- 172.21.15.119:0/2357237078 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0d0af0 con 0x7fdfdc0cf880 2023-12-19T16:17:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.887+0000 7fdfdb7fe640 1 --2- 172.21.15.119:0/2357237078 >> v2:172.21.15.143:3300/0 conn(0x7fdfdc15cae0 0x7fdfdc0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfdbfff640 1 --2- 172.21.15.119:0/2357237078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 0x7fdfdc0ce2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009e50 tx=0x7fdfd401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9741e9b9f3aa2476 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfda7fc640 1 -- 172.21.15.119:0/2357237078 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40a5840 con 0x7fdfdc0cf880 2023-12-19T16:17:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfda7fc640 1 -- 172.21.15.119:0/2357237078 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40a59a0 con 0x7fdfdc0cf880 2023-12-19T16:17:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfda7fc640 1 -- 172.21.15.119:0/2357237078 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40a5d30 con 0x7fdfdc0cf880 2023-12-19T16:17:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 -- 172.21.15.119:0/2357237078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 msgr2=0x7fdfdc0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 --2- 172.21.15.119:0/2357237078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 0x7fdfdc0ce2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009e50 tx=0x7fdfd401c9e0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 -- 172.21.15.119:0/2357237078 shutdown_connections 2023-12-19T16:17:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 --2- 172.21.15.119:0/2357237078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cf880 0x7fdfdc0ce2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 --2- 172.21.15.119:0/2357237078 >> v2:172.21.15.143:3300/0 conn(0x7fdfdc15cae0 0x7fdfdc0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 -- 172.21.15.119:0/2357237078 >> 172.21.15.119:0/2357237078 conn(0x7fdfdc089fb0 msgr2=0x7fdfdc0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:52.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 -- 172.21.15.119:0/2357237078 shutdown_connections 2023-12-19T16:17:52.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.891+0000 7fdfe221f640 1 -- 172.21.15.119:0/2357237078 wait complete. 2023-12-19T16:17:52.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 Processor -- start 2023-12-19T16:17:52.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 -- start start 2023-12-19T16:17:52.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cde90 0x7fdfdc15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfdc0cf880 0x7fdfdc0c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 0x7fdfdc0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc15ef20 con 0x7fdfdc15cae0 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0c7dc0 con 0x7fdfdc0cf880 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc15e2a0 con 0x7fdfdc0cde90 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 0x7fdfdc0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 0x7fdfdc0c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56340/0 (socket says 172.21.15.119:56340) 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 -- 172.21.15.119:0/4093231791 learned_addr learned my addr 172.21.15.119:0/4093231791 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdb7fe640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cde90 0x7fdfdc15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdaffd640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfdc0cf880 0x7fdfdc0c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 -- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cde90 msgr2=0x7fdfdc15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cde90 0x7fdfdc15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 -- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfdc0cf880 msgr2=0x7fdfdc0c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:52.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfdc0cf880 0x7fdfdc0c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:52.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 -- 172.21.15.119:0/4093231791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0093b0 con 0x7fdfdc15cae0 2023-12-19T16:17:52.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdb7fe640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cde90 0x7fdfdc15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdaffd640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfdc0cf880 0x7fdfdc0c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfdbfff640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 0x7fdfdc0c7880 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdfd401a610 tx=0x7fdfd4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40b8670 con 0x7fdfdc15cae0 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd4009b30 con 0x7fdfdc15cae0 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40b87d0 con 0x7fdfdc15cae0 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.895+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40b8b80 con 0x7fdfdc15cae0 2023-12-19T16:17:52.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc15e860 con 0x7fdfdc15cae0 2023-12-19T16:17:52.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc15f060 con 0x7fdfdc15cae0 2023-12-19T16:17:52.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdfd40b8ce0 con 0x7fdfdc15cae0 2023-12-19T16:17:52.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfc3fff640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdfc8065a60 0x7fdfc8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:52.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdfd411e920 con 0x7fdfdc15cae0 2023-12-19T16:17:52.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfdb7fe640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdfc8065a60 0x7fdfc8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:52.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.899+0000 7fdfdb7fe640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdfc8065a60 0x7fdfc8067f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0cdd70 tx=0x7fdfcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:52.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:52.903+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdfdc15f060 con 0x7fdfdc15cae0 2023-12-19T16:17:53.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:53.091+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdfdc15f060 con 0x7fdfdc15cae0 2023-12-19T16:17:53.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-19T16:17:53.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-19T16:17:53.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-19T16:17:53.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-19T16:17:54.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.051+0000 7fdfc3fff640 1 -- 172.21.15.119:0/4093231791 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdfdc15f060 con 0x7fdfdc15cae0 2023-12-19T16:17:54.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdfc8065a60 msgr2=0x7fdfc8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdfc8065a60 0x7fdfc8067f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0cdd70 tx=0x7fdfcc008040 comp rx=0 tx=0).stop 2023-12-19T16:17:54.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 msgr2=0x7fdfdc0c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 0x7fdfdc0c7880 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdfd401a610 tx=0x7fdfd4019780 comp rx=0 tx=0).stop 2023-12-19T16:17:54.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 shutdown_connections 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdfc8065a60 0x7fdfc8067f20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfdc0cf880 0x7fdfdc0c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfdc15cae0 0x7fdfdc0c7880 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 --2- 172.21.15.119:0/4093231791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdfdc0cde90 0x7fdfdc15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 >> 172.21.15.119:0/4093231791 conn(0x7fdfdc089fb0 msgr2=0x7fdfdc0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 shutdown_connections 2023-12-19T16:17:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.055+0000 7fdfe221f640 1 -- 172.21.15.119:0/4093231791 wait complete. 2023-12-19T16:17:54.081 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:17:54.081 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:17:54.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.219+0000 7fe73b5f3640 1 Processor -- start 2023-12-19T16:17:54.225 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.219+0000 7fe73b5f3640 1 -- start start 2023-12-19T16:17:54.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73b5f3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7341582d0 0x7fe7340c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:54.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73b5f3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7340c9390 con 0x7fe7340ce3b0 2023-12-19T16:17:54.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73b5f3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73415aee0 con 0x7fe734070820 2023-12-19T16:17:54.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73b5f3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73415b1c0 con 0x7fe7341582d0 2023-12-19T16:17:54.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe739b90640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe7340ce3b0 0x7fe7340cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53456/0 (socket says 172.21.15.119:53456) 2023-12-19T16:17:54.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe739b90640 1 -- 172.21.15.119:0/180672293 learned_addr learned my addr 172.21.15.119:0/180672293 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:54.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73938f640 1 --2- 172.21.15.119:0/180672293 >> v2:172.21.15.143:3300/0 conn(0x7fe7341582d0 0x7fe7340c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:54.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe72bfff640 1 -- 172.21.15.119:0/180672293 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343681204 0 0) 0x7fe7340c9390 con 0x7fe7340ce3b0 2023-12-19T16:17:54.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe72bfff640 1 -- 172.21.15.119:0/180672293 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe720003530 con 0x7fe7340ce3b0 2023-12-19T16:17:54.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73938f640 1 -- 172.21.15.119:0/180672293 >> v1:172.21.15.143:6789/0 conn(0x7fe734070820 legacy=0x7fe7340ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73938f640 1 -- 172.21.15.119:0/180672293 >> v1:172.21.15.119:6789/0 conn(0x7fe7340ce3b0 legacy=0x7fe7340cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.223+0000 7fe73938f640 1 -- 172.21.15.119:0/180672293 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73415b4a0 con 0x7fe7341582d0 2023-12-19T16:17:54.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73938f640 1 --2- 172.21.15.119:0/180672293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7341582d0 0x7fe7340c8e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7300097c0 tx=0x7fe73001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a5bab56672f23f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:54.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe72bfff640 1 -- 172.21.15.119:0/180672293 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7300ab670 con 0x7fe7341582d0 2023-12-19T16:17:54.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe72bfff640 1 -- 172.21.15.119:0/180672293 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7300ab7d0 con 0x7fe7341582d0 2023-12-19T16:17:54.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe72bfff640 1 -- 172.21.15.119:0/180672293 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7300abb40 con 0x7fe7341582d0 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 -- 172.21.15.119:0/180672293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7341582d0 msgr2=0x7fe7340c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/180672293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7341582d0 0x7fe7340c8e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7300097c0 tx=0x7fe73001c450 comp rx=0 tx=0).stop 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 -- 172.21.15.119:0/180672293 shutdown_connections 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/180672293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7341582d0 0x7fe7340c8e50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 -- 172.21.15.119:0/180672293 >> 172.21.15.119:0/180672293 conn(0x7fe73406a2a0 msgr2=0x7fe7340aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 -- 172.21.15.119:0/180672293 shutdown_connections 2023-12-19T16:17:54.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 -- 172.21.15.119:0/180672293 wait complete. 2023-12-19T16:17:54.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 Processor -- start 2023-12-19T16:17:54.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.227+0000 7fe73b5f3640 1 -- start start 2023-12-19T16:17:54.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe734070820 0x7fe734151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:54.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7340ce3b0 0x7fe734152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 0x7fe7341543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7341537e0 con 0x7fe7341582d0 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7341f6800 con 0x7fe7340ce3b0 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe734152f40 con 0x7fe734070820 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 0x7fe7341543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 0x7fe7341543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56342/0 (socket says 172.21.15.119:56342) 2023-12-19T16:17:54.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 -- 172.21.15.119:0/876978914 learned_addr learned my addr 172.21.15.119:0/876978914 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe738b8e640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7340ce3b0 0x7fe734152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73938f640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe734070820 0x7fe734151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 -- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe734070820 msgr2=0x7fe734151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe734070820 0x7fe734151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 -- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7340ce3b0 msgr2=0x7fe734152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7340ce3b0 0x7fe734152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 -- 172.21.15.119:0/876978914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730009420 con 0x7fe7341582d0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe739b90640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 0x7fe7341543f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00cb70 tx=0x7fe72c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00ad40 con 0x7fe7341582d0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c012400 con 0x7fe7341582d0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00aea0 con 0x7fe7341582d0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe734153220 con 0x7fe7341582d0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7341521b0 con 0x7fe7341582d0 2023-12-19T16:17:54.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.231+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73404e000 con 0x7fe7341582d0 2023-12-19T16:17:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.235+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe72c007070 con 0x7fe7341582d0 2023-12-19T16:17:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.235+0000 7fe729ffb640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe718065a60 0x7fe718067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.235+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe72c0832e0 con 0x7fe7341582d0 2023-12-19T16:17:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.235+0000 7fe73938f640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe718065a60 0x7fe718067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.235+0000 7fe73938f640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe718065a60 0x7fe718067f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe7300af000 tx=0x7fe7300a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.239+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe72c050b70 con 0x7fe7341582d0 2023-12-19T16:17:54.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:54.419+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7341f6940 con 0x7fe7341582d0 2023-12-19T16:17:55.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe729ffb640 1 -- 172.21.15.119:0/876978914 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe72c054190 con 0x7fe7341582d0 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe718065a60 msgr2=0x7fe718067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe718065a60 0x7fe718067f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe7300af000 tx=0x7fe7300a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 msgr2=0x7fe7341543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 0x7fe7341543f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00cb70 tx=0x7fe72c00a430 comp rx=0 tx=0).stop 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 shutdown_connections 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe718065a60 0x7fe718067f20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7340ce3b0 0x7fe734152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7341582d0 0x7fe7341543f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 --2- 172.21.15.119:0/876978914 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe734070820 0x7fe734151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 >> 172.21.15.119:0/876978914 conn(0x7fe73406a2a0 msgr2=0x7fe734157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:55.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 shutdown_connections 2023-12-19T16:17:55.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.063+0000 7fe73b5f3640 1 -- 172.21.15.119:0/876978914 wait complete. 2023-12-19T16:17:55.090 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:17:55.090 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:55.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 Processor -- start 2023-12-19T16:17:55.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 -- start start 2023-12-19T16:17:55.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3e815aa10 0x7fc3e815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e815e000 con 0x7fc3e806fc80 2023-12-19T16:17:55.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e815e5c0 con 0x7fc3e815aa10 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.227+0000 7fc3ed604640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e815b4d0 con 0x7fc3e80b0460 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3e815aa10 0x7fc3e815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3e815aa10 0x7fc3e815ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56348/0 (socket says 172.21.15.119:56348) 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 -- 172.21.15.119:0/3356147200 learned_addr learned my addr 172.21.15.119:0/3356147200 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e77fe640 1 --1- 172.21.15.119:0/3356147200 >> v1:172.21.15.119:6789/0 conn(0x7fc3e806fc80 0x7fc3e80c87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53460/0 (socket says 172.21.15.119:53460) 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e6ffd640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 -- 172.21.15.119:0/3356147200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 msgr2=0x7fc3e815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:55.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 -- 172.21.15.119:0/3356147200 >> v1:172.21.15.119:6789/0 conn(0x7fc3e806fc80 legacy=0x7fc3e80c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 -- 172.21.15.119:0/3356147200 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e815b7b0 con 0x7fc3e815aa10 2023-12-19T16:17:55.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e67fc640 1 -- 172.21.15.119:0/3356147200 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949218706 0 0) 0x7fc3e815e000 con 0x7fc3e806fc80 2023-12-19T16:17:55.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e6ffd640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:55.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3de7fc640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815ae90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009870 tx=0x7fc3d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d9ee71be050830 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e67fc640 1 -- 172.21.15.119:0/3356147200 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00ac640 con 0x7fc3e815aa10 2023-12-19T16:17:55.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e67fc640 1 -- 172.21.15.119:0/3356147200 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00ac7a0 con 0x7fc3e815aa10 2023-12-19T16:17:55.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.231+0000 7fc3e67fc640 1 -- 172.21.15.119:0/3356147200 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00acb30 con 0x7fc3e815aa10 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- 172.21.15.119:0/3356147200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 msgr2=0x7fc3e815ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815ae90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009870 tx=0x7fc3d001c480 comp rx=0 tx=0).stop 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- 172.21.15.119:0/3356147200 shutdown_connections 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815ae90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 --2- 172.21.15.119:0/3356147200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- 172.21.15.119:0/3356147200 >> 172.21.15.119:0/3356147200 conn(0x7fc3e806a2a0 msgr2=0x7fc3e80cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- 172.21.15.119:0/3356147200 shutdown_connections 2023-12-19T16:17:55.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- 172.21.15.119:0/3356147200 wait complete. 2023-12-19T16:17:55.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 Processor -- start 2023-12-19T16:17:55.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- start start 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3e806fc80 0x7fc3e814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e80af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c1cc0 con 0x7fc3e815aa10 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c1fa0 con 0x7fc3e806fc80 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3ed604640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c2280 con 0x7fc3e80b0460 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3e77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3e77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56364/0 (socket says 172.21.15.119:56364) 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3e77fe640 1 -- 172.21.15.119:0/644832361 learned_addr learned my addr 172.21.15.119:0/644832361 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:55.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3de7fc640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e80af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.235+0000 7fc3e6ffd640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3e806fc80 0x7fc3e814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e77fe640 1 -- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 msgr2=0x7fc3e80af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e77fe640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e80af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e77fe640 1 -- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3e806fc80 msgr2=0x7fc3e814f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e77fe640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3e806fc80 0x7fc3e814f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e77fe640 1 -- 172.21.15.119:0/644832361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00094d0 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e77fe640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815cb70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c780 tx=0x7fc3e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000ce90 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000a640 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000a9d0 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80c2560 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e80c2b20 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e804e000 con 0x7fc3e815aa10 2023-12-19T16:17:55.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3e000ab30 con 0x7fc3e815aa10 2023-12-19T16:17:55.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3dffff640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c8065a60 0x7fc3c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3e00828b0 con 0x7fc3e815aa10 2023-12-19T16:17:55.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.239+0000 7fc3e6ffd640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c8065a60 0x7fc3c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.243+0000 7fc3e6ffd640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c8065a60 0x7fc3c8067f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009950 tx=0x7fc3d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.243+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc3e00500b0 con 0x7fc3e815aa10 2023-12-19T16:17:55.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3e80c2d10 con 0x7fc3e815aa10 2023-12-19T16:17:55.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3dffff640 1 -- 172.21.15.119:0/644832361 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fc3e0018030 con 0x7fc3e815aa10 2023-12-19T16:17:55.430 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:55.430 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:52.030827+0000","modified":"2023-12-19T16:17:55.053336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/2766727867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2766727867},{"type":"v1","addr":"172.21.15.119:6836","nonce":2766727867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:55.430 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c8065a60 msgr2=0x7fc3c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c8065a60 0x7fc3c8067f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009950 tx=0x7fc3d8008040 comp rx=0 tx=0).stop 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 msgr2=0x7fc3e815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815cb70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c780 tx=0x7fc3e000cc40 comp rx=0 tx=0).stop 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 shutdown_connections 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc3c8065a60 0x7fc3c8067f20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3e815aa10 0x7fc3e815cb70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3e80b0460 0x7fc3e80af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 --2- 172.21.15.119:0/644832361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3e806fc80 0x7fc3e814f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 >> 172.21.15.119:0/644832361 conn(0x7fc3e806a2a0 msgr2=0x7fc3e8153710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:55.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 shutdown_connections 2023-12-19T16:17:55.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.427+0000 7fc3ed604640 1 -- 172.21.15.119:0/644832361 wait complete. 2023-12-19T16:17:55.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:55.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.583+0000 7f5a45c66640 1 Processor -- start 2023-12-19T16:17:55.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.583+0000 7f5a45c66640 1 -- start start 2023-12-19T16:17:55.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a45c66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a4015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a45c66640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4015f100 con 0x7f5a4006fdb0 2023-12-19T16:17:55.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a45c66640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400ca7d0 con 0x7f5a400cac10 2023-12-19T16:17:55.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a45c66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4015e860 con 0x7f5a4015a680 2023-12-19T16:17:55.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5a4006fdb0 0x7f5a400c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53472/0 (socket says 172.21.15.119:53472) 2023-12-19T16:17:55.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3ffff640 1 -- 172.21.15.119:0/2328596955 learned_addr learned my addr 172.21.15.119:0/2328596955 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:55.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3f7fe640 1 --2- 172.21.15.119:0/2328596955 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a4015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984453543 0 0) 0x7f5a4015f100 con 0x7f5a4006fdb0 2023-12-19T16:17:55.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a28003530 con 0x7f5a4006fdb0 2023-12-19T16:17:55.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148154125 0 0) 0x7f5a400ca7d0 con 0x7f5a400cac10 2023-12-19T16:17:55.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a4015f100 con 0x7f5a400cac10 2023-12-19T16:17:55.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 483737887 0 0) 0x7f5a28003530 con 0x7f5a4006fdb0 2023-12-19T16:17:55.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/2328596955 >> v1:172.21.15.143:6789/0 conn(0x7f5a400cac10 legacy=0x7f5a4015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/2328596955 >> v1:172.21.15.119:6789/0 conn(0x7f5a4006fdb0 legacy=0x7f5a400c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.587+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/2328596955 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4015eb40 con 0x7f5a4015a680 2023-12-19T16:17:55.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a3f7fe640 1 --2- 172.21.15.119:0/2328596955 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a4015e160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a300097f0 tx=0x7f5a3001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a22a180c6aa1bf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38001a00 con 0x7f5a4015a680 2023-12-19T16:17:55.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300a7050 con 0x7f5a4015a680 2023-12-19T16:17:55.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a3e7fc640 1 -- 172.21.15.119:0/2328596955 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300ab600 con 0x7f5a4015a680 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 -- 172.21.15.119:0/2328596955 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 msgr2=0x7f5a4015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 --2- 172.21.15.119:0/2328596955 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a4015e160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a300097f0 tx=0x7f5a3001c350 comp rx=0 tx=0).stop 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 -- 172.21.15.119:0/2328596955 shutdown_connections 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 --2- 172.21.15.119:0/2328596955 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a4015e160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 -- 172.21.15.119:0/2328596955 >> 172.21.15.119:0/2328596955 conn(0x7f5a4006a3e0 msgr2=0x7f5a400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 -- 172.21.15.119:0/2328596955 shutdown_connections 2023-12-19T16:17:55.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 -- 172.21.15.119:0/2328596955 wait complete. 2023-12-19T16:17:55.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 Processor -- start 2023-12-19T16:17:55.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.591+0000 7f5a45c66640 1 -- start start 2023-12-19T16:17:55.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 0x7f5a400b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a400cac10 0x7f5a400b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a400af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c72f0 con 0x7f5a4006fdb0 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c78b0 con 0x7f5a400cac10 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400b1d50 con 0x7f5a4015a680 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 0x7f5a400b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 0x7f5a400b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56372/0 (socket says 172.21.15.119:56372) 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/4104950118 learned_addr learned my addr 172.21.15.119:0/4104950118 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3effd640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a400cac10 0x7f5a400b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3ffff640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a400af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 msgr2=0x7f5a400af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a400af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a400cac10 msgr2=0x7f5a400b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a400cac10 0x7f5a400b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 -- 172.21.15.119:0/4104950118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009420 con 0x7f5a4006fdb0 2023-12-19T16:17:55.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a3f7fe640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 0x7f5a400b3990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5a30019f80 tx=0x7f5a300190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300038b0 con 0x7f5a4006fdb0 2023-12-19T16:17:55.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30003a10 con 0x7f5a4006fdb0 2023-12-19T16:17:55.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400b1fd0 con 0x7f5a4006fdb0 2023-12-19T16:17:55.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30003d80 con 0x7f5a4006fdb0 2023-12-19T16:17:55.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400c7540 con 0x7f5a4006fdb0 2023-12-19T16:17:55.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400735b0 con 0x7f5a4006fdb0 2023-12-19T16:17:55.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.595+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a300b6420 con 0x7f5a4006fdb0 2023-12-19T16:17:55.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.599+0000 7f5a27fff640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a2c065a60 0x7f5a2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.599+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5a3011d680 con 0x7f5a4006fdb0 2023-12-19T16:17:55.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.599+0000 7f5a3effd640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a2c065a60 0x7f5a2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.599+0000 7f5a3effd640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a2c065a60 0x7f5a2c067f20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5a400b3720 tx=0x7f5a34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.603+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5a300eafb0 con 0x7f5a4006fdb0 2023-12-19T16:17:55.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.751+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a4004e000 con 0x7f5a4006fdb0 2023-12-19T16:17:55.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a27fff640 1 -- 172.21.15.119:0/4104950118 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f5a300ee5d0 con 0x7f5a4006fdb0 2023-12-19T16:17:55.759 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:55.759 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:55.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a2c065a60 msgr2=0x7f5a2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a2c065a60 0x7f5a2c067f20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5a400b3720 tx=0x7f5a34009040 comp rx=0 tx=0).stop 2023-12-19T16:17:55.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 msgr2=0x7f5a400b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 0x7f5a400b3990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5a30019f80 tx=0x7f5a300190f0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 shutdown_connections 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5a2c065a60 0x7f5a2c067f20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a400cac10 0x7f5a400b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a4015a680 0x7f5a400af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 --2- 172.21.15.119:0/4104950118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4006fdb0 0x7f5a400b3990 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 >> 172.21.15.119:0/4104950118 conn(0x7f5a4006a3e0 msgr2=0x7f5a40159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 shutdown_connections 2023-12-19T16:17:55.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.755+0000 7f5a45c66640 1 -- 172.21.15.119:0/4104950118 wait complete. 2023-12-19T16:17:55.779 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:17:55.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:55.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.911+0000 7f2029ad1640 1 Processor -- start 2023-12-19T16:17:55.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.911+0000 7f2029ad1640 1 -- start start 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2029ad1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f202406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2029ad1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f20240ca000 0x7f2024070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2029ad1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20240c9460 con 0x7f202406c320 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2029ad1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202406c7a0 con 0x7f20240ca000 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2029ad1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20241574a0 con 0x7f20241570c0 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2022ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f202406c320 0x7f20240c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53480/0 (socket says 172.21.15.119:53480) 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2022ffd640 1 -- 172.21.15.119:0/359710392 learned_addr learned my addr 172.21.15.119:0/359710392 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2023fff640 1 --2- 172.21.15.119:0/359710392 >> v2:172.21.15.143:3300/0 conn(0x7f20240ca000 0x7f2024070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f20237fe640 1 --2- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f202406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f20227fc640 1 -- 172.21.15.119:0/359710392 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572734277 0 0) 0x7f20240c9460 con 0x7f202406c320 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f20227fc640 1 -- 172.21.15.119:0/359710392 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f200c003530 con 0x7f202406c320 2023-12-19T16:17:55.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2023fff640 1 -- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 msgr2=0x7f202406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:55.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2023fff640 1 --2- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f202406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f20227fc640 1 -- 172.21.15.119:0/359710392 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1275029382 0 0) 0x7f200c003530 con 0x7f202406c320 2023-12-19T16:17:55.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2023fff640 1 -- 172.21.15.119:0/359710392 >> v1:172.21.15.119:6789/0 conn(0x7f202406c320 legacy=0x7f20240c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.915+0000 7f2023fff640 1 -- 172.21.15.119:0/359710392 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240c8b30 con 0x7f20240ca000 2023-12-19T16:17:55.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2023fff640 1 --2- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20240ca000 0x7f2024070df0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f201c009d90 tx=0x7f201c01c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee4aa1e5926f0367 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f20227fc640 1 -- 172.21.15.119:0/359710392 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018001680 con 0x7f20240ca000 2023-12-19T16:17:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f20227fc640 1 -- 172.21.15.119:0/359710392 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0a55b0 con 0x7f20240ca000 2023-12-19T16:17:55.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f20227fc640 1 -- 172.21.15.119:0/359710392 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0a5940 con 0x7f20240ca000 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 -- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20240ca000 msgr2=0x7f2024070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 --2- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20240ca000 0x7f2024070df0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f201c009d90 tx=0x7f201c01c7b0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 -- 172.21.15.119:0/359710392 shutdown_connections 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 --2- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20240ca000 0x7f2024070df0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 --2- 172.21.15.119:0/359710392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f202406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 -- 172.21.15.119:0/359710392 >> 172.21.15.119:0/359710392 conn(0x7f202406a3e0 msgr2=0x7f20240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 -- 172.21.15.119:0/359710392 shutdown_connections 2023-12-19T16:17:55.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 -- 172.21.15.119:0/359710392 wait complete. 2023-12-19T16:17:55.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 Processor -- start 2023-12-19T16:17:55.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.919+0000 7f2029ad1640 1 -- start start 2023-12-19T16:17:55.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f202406c320 0x7f20240c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 0x7f20240c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f20240cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240c5430 con 0x7f20240ca000 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240cd700 con 0x7f202406c320 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240c5680 con 0x7f20241570c0 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 0x7f20240c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 0x7f20240c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56380/0 (socket says 172.21.15.119:56380) 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 -- 172.21.15.119:0/285295489 learned_addr learned my addr 172.21.15.119:0/285295489 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f20237fe640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f202406c320 0x7f20240c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2023fff640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f20240cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 -- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 msgr2=0x7f20240cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f20240cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 -- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f202406c320 msgr2=0x7f20240c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f202406c320 0x7f20240c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 -- 172.21.15.119:0/285295489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009a70 con 0x7f20240ca000 2023-12-19T16:17:55.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f20237fe640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f202406c320 0x7f20240c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:55.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2022ffd640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 0x7f20240c7ee0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f201800c780 tx=0x7f201800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018005cf0 con 0x7f20240ca000 2023-12-19T16:17:55.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018005e50 con 0x7f20240ca000 2023-12-19T16:17:55.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180072b0 con 0x7f20240ca000 2023-12-19T16:17:55.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20240c5960 con 0x7f20240ca000 2023-12-19T16:17:55.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20240ccea0 con 0x7f20240ca000 2023-12-19T16:17:55.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20240735b0 con 0x7f20240ca000 2023-12-19T16:17:55.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.923+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2018007410 con 0x7f20240ca000 2023-12-19T16:17:55.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.927+0000 7f200bfff640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2010065a60 0x7f2010067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:55.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.927+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2018083370 con 0x7f20240ca000 2023-12-19T16:17:55.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.927+0000 7f20237fe640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2010065a60 0x7f2010067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:55.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.927+0000 7f20237fe640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2010065a60 0x7f2010067f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f20241569b0 tx=0x7f2014008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:55.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:55.927+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2018050c60 con 0x7f20240ca000 2023-12-19T16:17:56.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.079+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20240ca8a0 con 0x7f2010065a60 2023-12-19T16:17:56.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.087+0000 7f200bfff640 1 -- 172.21.15.119:0/285295489 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289242 (secure 0 0 0) 0x7f20140119a0 con 0x7f2010065a60 2023-12-19T16:17:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:56.095 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2010065a60 msgr2=0x7f2010067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2010065a60 0x7f2010067f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f20241569b0 tx=0x7f2014008040 comp rx=0 tx=0).stop 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 msgr2=0x7f20240c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 0x7f20240c7ee0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f201800c780 tx=0x7f201800cc40 comp rx=0 tx=0).stop 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 shutdown_connections 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2010065a60 0x7f2010067f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20241570c0 0x7f20240cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20240ca000 0x7f20240c7ee0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 --2- 172.21.15.119:0/285295489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f202406c320 0x7f20240c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 >> 172.21.15.119:0/285295489 conn(0x7f202406a3e0 msgr2=0x7f20240c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:56.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 shutdown_connections 2023-12-19T16:17:56.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.091+0000 7f2029ad1640 1 -- 172.21.15.119:0/285295489 wait complete. 2023-12-19T16:17:56.112 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-12-19T16:17:54.481130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221944,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752776,"statfs":{"total":773094113280,"available":772866842624,"internally_reserved":0,"allocated":6479872,"data_stored":3519628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000687"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378723+0000","last_change":"2023-12-19T16:17:52.067944+0000","last_active":"2023-12-19T16:17:53.378723+0000","last_peered":"2023-12-19T16:17:53.378723+0000","last_clean":"2023-12-19T16:17:53.378723+0000","last_became_active":"2023-12-19T16:17:52.067706+0000","last_became_peered":"2023-12-19T16:17:52.067706+0000","last_unstale":"2023-12-19T16:17:53.378723+0000","last_undegraded":"2023-12-19T16:17:53.378723+0000","last_fullsized":"2023-12-19T16:17:53.378723+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:01.221836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045606+0000","last_change":"2023-12-19T16:17:52.071041+0000","last_active":"2023-12-19T16:17:53.045606+0000","last_peered":"2023-12-19T16:17:53.045606+0000","last_clean":"2023-12-19T16:17:53.045606+0000","last_became_active":"2023-12-19T16:17:52.069815+0000","last_became_peered":"2023-12-19T16:17:52.069815+0000","last_unstale":"2023-12-19T16:17:53.045606+0000","last_undegraded":"2023-12-19T16:17:53.045606+0000","last_fullsized":"2023-12-19T16:17:53.045606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:05.449296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047154+0000","last_change":"2023-12-19T16:17:52.068692+0000","last_active":"2023-12-19T16:17:53.047154+0000","last_peered":"2023-12-19T16:17:53.047154+0000","last_clean":"2023-12-19T16:17:53.047154+0000","last_became_active":"2023-12-19T16:17:52.068290+0000","last_became_peered":"2023-12-19T16:17:52.068290+0000","last_unstale":"2023-12-19T16:17:53.047154+0000","last_undegraded":"2023-12-19T16:17:53.047154+0000","last_fullsized":"2023-12-19T16:17:53.047154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:05:15.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378874+0000","last_change":"2023-12-19T16:17:52.054804+0000","last_active":"2023-12-19T16:17:53.378874+0000","last_peered":"2023-12-19T16:17:53.378874+0000","last_clean":"2023-12-19T16:17:53.378874+0000","last_became_active":"2023-12-19T16:17:52.054240+0000","last_became_peered":"2023-12-19T16:17:52.054240+0000","last_unstale":"2023-12-19T16:17:53.378874+0000","last_undegraded":"2023-12-19T16:17:53.378874+0000","last_fullsized":"2023-12-19T16:17:53.378874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:50.398409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378513+0000","last_change":"2023-12-19T16:17:52.057657+0000","last_active":"2023-12-19T16:17:53.378513+0000","last_peered":"2023-12-19T16:17:53.378513+0000","last_clean":"2023-12-19T16:17:53.378513+0000","last_became_active":"2023-12-19T16:17:52.057398+0000","last_became_peered":"2023-12-19T16:17:52.057398+0000","last_unstale":"2023-12-19T16:17:53.378513+0000","last_undegraded":"2023-12-19T16:17:53.378513+0000","last_fullsized":"2023-12-19T16:17:53.378513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:33:06.598944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192019+0000","last_change":"2023-12-19T16:17:52.060945+0000","last_active":"2023-12-19T16:17:53.192019+0000","last_peered":"2023-12-19T16:17:53.192019+0000","last_clean":"2023-12-19T16:17:53.192019+0000","last_became_active":"2023-12-19T16:17:52.060683+0000","last_became_peered":"2023-12-19T16:17:52.060683+0000","last_unstale":"2023-12-19T16:17:53.192019+0000","last_undegraded":"2023-12-19T16:17:53.192019+0000","last_fullsized":"2023-12-19T16:17:53.192019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:20.634013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046205+0000","last_change":"2023-12-19T16:17:52.049535+0000","last_active":"2023-12-19T16:17:53.046205+0000","last_peered":"2023-12-19T16:17:53.046205+0000","last_clean":"2023-12-19T16:17:53.046205+0000","last_became_active":"2023-12-19T16:17:52.049245+0000","last_became_peered":"2023-12-19T16:17:52.049245+0000","last_unstale":"2023-12-19T16:17:53.046205+0000","last_undegraded":"2023-12-19T16:17:53.046205+0000","last_fullsized":"2023-12-19T16:17:53.046205+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:30.013265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045001+0000","last_change":"2023-12-19T16:17:52.066926+0000","last_active":"2023-12-19T16:17:53.045001+0000","last_peered":"2023-12-19T16:17:53.045001+0000","last_clean":"2023-12-19T16:17:53.045001+0000","last_became_active":"2023-12-19T16:17:52.066675+0000","last_became_peered":"2023-12-19T16:17:52.066675+0000","last_unstale":"2023-12-19T16:17:53.045001+0000","last_undegraded":"2023-12-19T16:17:53.045001+0000","last_fullsized":"2023-12-19T16:17:53.045001+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:21.699284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047995+0000","last_change":"2023-12-19T16:17:52.051575+0000","last_active":"2023-12-19T16:17:53.047995+0000","last_peered":"2023-12-19T16:17:53.047995+0000","last_clean":"2023-12-19T16:17:53.047995+0000","last_became_active":"2023-12-19T16:17:52.051237+0000","last_became_peered":"2023-12-19T16:17:52.051237+0000","last_unstale":"2023-12-19T16:17:53.047995+0000","last_undegraded":"2023-12-19T16:17:53.047995+0000","last_fullsized":"2023-12-19T16:17:53.047995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:19:30.855985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378536+0000","last_change":"2023-12-19T16:17:52.053899+0000","last_active":"2023-12-19T16:17:53.378536+0000","last_peered":"2023-12-19T16:17:53.378536+0000","last_clean":"2023-12-19T16:17:53.378536+0000","last_became_active":"2023-12-19T16:17:52.053637+0000","last_became_peered":"2023-12-19T16:17:52.053637+0000","last_unstale":"2023-12-19T16:17:53.378536+0000","last_undegraded":"2023-12-19T16:17:53.378536+0000","last_fullsized":"2023-12-19T16:17:53.378536+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:08.854840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378634+0000","last_change":"2023-12-19T16:17:52.060277+0000","last_active":"2023-12-19T16:17:53.378634+0000","last_peered":"2023-12-19T16:17:53.378634+0000","last_clean":"2023-12-19T16:17:53.378634+0000","last_became_active":"2023-12-19T16:17:52.060034+0000","last_became_peered":"2023-12-19T16:17:52.060034+0000","last_unstale":"2023-12-19T16:17:53.378634+0000","last_undegraded":"2023-12-19T16:17:53.378634+0000","last_fullsized":"2023-12-19T16:17:53.378634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:20.462995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378784+0000","last_change":"2023-12-19T16:17:52.053656+0000","last_active":"2023-12-19T16:17:53.378784+0000","last_peered":"2023-12-19T16:17:53.378784+0000","last_clean":"2023-12-19T16:17:53.378784+0000","last_became_active":"2023-12-19T16:17:52.053399+0000","last_became_peered":"2023-12-19T16:17:52.053399+0000","last_unstale":"2023-12-19T16:17:53.378784+0000","last_undegraded":"2023-12-19T16:17:53.378784+0000","last_fullsized":"2023-12-19T16:17:53.378784+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:19.888218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047377+0000","last_change":"2023-12-19T16:17:52.060226+0000","last_active":"2023-12-19T16:17:53.047377+0000","last_peered":"2023-12-19T16:17:53.047377+0000","last_clean":"2023-12-19T16:17:53.047377+0000","last_became_active":"2023-12-19T16:17:52.059812+0000","last_became_peered":"2023-12-19T16:17:52.059812+0000","last_unstale":"2023-12-19T16:17:53.047377+0000","last_undegraded":"2023-12-19T16:17:53.047377+0000","last_fullsized":"2023-12-19T16:17:53.047377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:16.101202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046781+0000","last_change":"2023-12-19T16:17:52.054809+0000","last_active":"2023-12-19T16:17:53.046781+0000","last_peered":"2023-12-19T16:17:53.046781+0000","last_clean":"2023-12-19T16:17:53.046781+0000","last_became_active":"2023-12-19T16:17:52.054518+0000","last_became_peered":"2023-12-19T16:17:52.054518+0000","last_unstale":"2023-12-19T16:17:53.046781+0000","last_undegraded":"2023-12-19T16:17:53.046781+0000","last_fullsized":"2023-12-19T16:17:53.046781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:47.177714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046360+0000","last_change":"2023-12-19T16:17:52.055437+0000","last_active":"2023-12-19T16:17:53.046360+0000","last_peered":"2023-12-19T16:17:53.046360+0000","last_clean":"2023-12-19T16:17:53.046360+0000","last_became_active":"2023-12-19T16:17:52.055159+0000","last_became_peered":"2023-12-19T16:17:52.055159+0000","last_unstale":"2023-12-19T16:17:53.046360+0000","last_undegraded":"2023-12-19T16:17:53.046360+0000","last_fullsized":"2023-12-19T16:17:53.046360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:01:26.361268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.191953+0000","last_change":"2023-12-19T16:17:52.058811+0000","last_active":"2023-12-19T16:17:53.191953+0000","last_peered":"2023-12-19T16:17:53.191953+0000","last_clean":"2023-12-19T16:17:53.191953+0000","last_became_active":"2023-12-19T16:17:52.058550+0000","last_became_peered":"2023-12-19T16:17:52.058550+0000","last_unstale":"2023-12-19T16:17:53.191953+0000","last_undegraded":"2023-12-19T16:17:53.191953+0000","last_fullsized":"2023-12-19T16:17:53.191953+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:19.888218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045656+0000","last_change":"2023-12-19T16:17:52.068269+0000","last_active":"2023-12-19T16:17:53.045656+0000","last_peered":"2023-12-19T16:17:53.045656+0000","last_clean":"2023-12-19T16:17:53.045656+0000","last_became_active":"2023-12-19T16:17:52.065405+0000","last_became_peered":"2023-12-19T16:17:52.065405+0000","last_unstale":"2023-12-19T16:17:53.045656+0000","last_undegraded":"2023-12-19T16:17:53.045656+0000","last_fullsized":"2023-12-19T16:17:53.045656+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:39.862268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047030+0000","last_change":"2023-12-19T16:17:52.067114+0000","last_active":"2023-12-19T16:17:53.047030+0000","last_peered":"2023-12-19T16:17:53.047030+0000","last_clean":"2023-12-19T16:17:53.047030+0000","last_became_active":"2023-12-19T16:17:52.066805+0000","last_became_peered":"2023-12-19T16:17:52.066805+0000","last_unstale":"2023-12-19T16:17:53.047030+0000","last_undegraded":"2023-12-19T16:17:53.047030+0000","last_fullsized":"2023-12-19T16:17:53.047030+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:08.854840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378675+0000","last_change":"2023-12-19T16:17:52.061943+0000","last_active":"2023-12-19T16:17:53.378675+0000","last_peered":"2023-12-19T16:17:53.378675+0000","last_clean":"2023-12-19T16:17:53.378675+0000","last_became_active":"2023-12-19T16:17:52.061715+0000","last_became_peered":"2023-12-19T16:17:52.061715+0000","last_unstale":"2023-12-19T16:17:53.378675+0000","last_undegraded":"2023-12-19T16:17:53.378675+0000","last_fullsized":"2023-12-19T16:17:53.378675+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:38.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045252+0000","last_change":"2023-12-19T16:17:52.071299+0000","last_active":"2023-12-19T16:17:53.045252+0000","last_peered":"2023-12-19T16:17:53.045252+0000","last_clean":"2023-12-19T16:17:53.045252+0000","last_became_active":"2023-12-19T16:17:52.070116+0000","last_became_peered":"2023-12-19T16:17:52.070116+0000","last_unstale":"2023-12-19T16:17:53.045252+0000","last_undegraded":"2023-12-19T16:17:53.045252+0000","last_fullsized":"2023-12-19T16:17:53.045252+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:08.037685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046578+0000","last_change":"2023-12-19T16:17:52.068489+0000","last_active":"2023-12-19T16:17:53.046578+0000","last_peered":"2023-12-19T16:17:53.046578+0000","last_clean":"2023-12-19T16:17:53.046578+0000","last_became_active":"2023-12-19T16:17:52.066963+0000","last_became_peered":"2023-12-19T16:17:52.066963+0000","last_unstale":"2023-12-19T16:17:53.046578+0000","last_undegraded":"2023-12-19T16:17:53.046578+0000","last_fullsized":"2023-12-19T16:17:53.046578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:02.545748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045138+0000","last_change":"2023-12-19T16:17:52.058048+0000","last_active":"2023-12-19T16:17:53.045138+0000","last_peered":"2023-12-19T16:17:53.045138+0000","last_clean":"2023-12-19T16:17:53.045138+0000","last_became_active":"2023-12-19T16:17:52.057618+0000","last_became_peered":"2023-12-19T16:17:52.057618+0000","last_unstale":"2023-12-19T16:17:53.045138+0000","last_undegraded":"2023-12-19T16:17:53.045138+0000","last_fullsized":"2023-12-19T16:17:53.045138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:13.635135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046933+0000","last_change":"2023-12-19T16:17:52.068916+0000","last_active":"2023-12-19T16:17:53.046933+0000","last_peered":"2023-12-19T16:17:53.046933+0000","last_clean":"2023-12-19T16:17:53.046933+0000","last_became_active":"2023-12-19T16:17:52.068422+0000","last_became_peered":"2023-12-19T16:17:52.068422+0000","last_unstale":"2023-12-19T16:17:53.046933+0000","last_undegraded":"2023-12-19T16:17:53.046933+0000","last_fullsized":"2023-12-19T16:17:53.046933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.822827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046542+0000","last_change":"2023-12-19T16:17:52.052069+0000","last_active":"2023-12-19T16:17:53.046542+0000","last_peered":"2023-12-19T16:17:53.046542+0000","last_clean":"2023-12-19T16:17:53.046542+0000","last_became_active":"2023-12-19T16:17:52.050586+0000","last_became_peered":"2023-12-19T16:17:52.050586+0000","last_unstale":"2023-12-19T16:17:53.046542+0000","last_undegraded":"2023-12-19T16:17:53.046542+0000","last_fullsized":"2023-12-19T16:17:53.046542+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:16.784449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378807+0000","last_change":"2023-12-19T16:17:52.061738+0000","last_active":"2023-12-19T16:17:53.378807+0000","last_peered":"2023-12-19T16:17:53.378807+0000","last_clean":"2023-12-19T16:17:53.378807+0000","last_became_active":"2023-12-19T16:17:52.061491+0000","last_became_peered":"2023-12-19T16:17:52.061491+0000","last_unstale":"2023-12-19T16:17:53.378807+0000","last_undegraded":"2023-12-19T16:17:53.378807+0000","last_fullsized":"2023-12-19T16:17:53.378807+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:42.717083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378649+0000","last_change":"2023-12-19T16:17:52.055338+0000","last_active":"2023-12-19T16:17:53.378649+0000","last_peered":"2023-12-19T16:17:53.378649+0000","last_clean":"2023-12-19T16:17:53.378649+0000","last_became_active":"2023-12-19T16:17:52.054894+0000","last_became_peered":"2023-12-19T16:17:52.054894+0000","last_unstale":"2023-12-19T16:17:53.378649+0000","last_undegraded":"2023-12-19T16:17:53.378649+0000","last_fullsized":"2023-12-19T16:17:53.378649+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:28.558969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192264+0000","last_change":"2023-12-19T16:17:52.059797+0000","last_active":"2023-12-19T16:17:53.192264+0000","last_peered":"2023-12-19T16:17:53.192264+0000","last_clean":"2023-12-19T16:17:53.192264+0000","last_became_active":"2023-12-19T16:17:52.059499+0000","last_became_peered":"2023-12-19T16:17:52.059499+0000","last_unstale":"2023-12-19T16:17:53.192264+0000","last_undegraded":"2023-12-19T16:17:53.192264+0000","last_fullsized":"2023-12-19T16:17:53.192264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.198227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378647+0000","last_change":"2023-12-19T16:17:52.052603+0000","last_active":"2023-12-19T16:17:53.378647+0000","last_peered":"2023-12-19T16:17:53.378647+0000","last_clean":"2023-12-19T16:17:53.378647+0000","last_became_active":"2023-12-19T16:17:52.052213+0000","last_became_peered":"2023-12-19T16:17:52.052213+0000","last_unstale":"2023-12-19T16:17:53.378647+0000","last_undegraded":"2023-12-19T16:17:53.378647+0000","last_fullsized":"2023-12-19T16:17:53.378647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:04.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045459+0000","last_change":"2023-12-19T16:17:52.071186+0000","last_active":"2023-12-19T16:17:53.045459+0000","last_peered":"2023-12-19T16:17:53.045459+0000","last_clean":"2023-12-19T16:17:53.045459+0000","last_became_active":"2023-12-19T16:17:52.070841+0000","last_became_peered":"2023-12-19T16:17:52.070841+0000","last_unstale":"2023-12-19T16:17:53.045459+0000","last_undegraded":"2023-12-19T16:17:53.045459+0000","last_fullsized":"2023-12-19T16:17:53.045459+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:23.457172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046508+0000","last_change":"2023-12-19T16:17:52.067725+0000","last_active":"2023-12-19T16:17:53.046508+0000","last_peered":"2023-12-19T16:17:53.046508+0000","last_clean":"2023-12-19T16:17:53.046508+0000","last_became_active":"2023-12-19T16:17:52.067448+0000","last_became_peered":"2023-12-19T16:17:52.067448+0000","last_unstale":"2023-12-19T16:17:53.046508+0000","last_undegraded":"2023-12-19T16:17:53.046508+0000","last_fullsized":"2023-12-19T16:17:53.046508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:45.659792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378205+0000","last_change":"2023-12-19T16:17:52.065409+0000","last_active":"2023-12-19T16:17:53.378205+0000","last_peered":"2023-12-19T16:17:53.378205+0000","last_clean":"2023-12-19T16:17:53.378205+0000","last_became_active":"2023-12-19T16:17:52.065020+0000","last_became_peered":"2023-12-19T16:17:52.065020+0000","last_unstale":"2023-12-19T16:17:53.378205+0000","last_undegraded":"2023-12-19T16:17:53.378205+0000","last_fullsized":"2023-12-19T16:17:53.378205+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:11:26.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192037+0000","last_change":"2023-12-19T16:17:52.068578+0000","last_active":"2023-12-19T16:17:53.192037+0000","last_peered":"2023-12-19T16:17:53.192037+0000","last_clean":"2023-12-19T16:17:53.192037+0000","last_became_active":"2023-12-19T16:17:52.068281+0000","last_became_peered":"2023-12-19T16:17:52.068281+0000","last_unstale":"2023-12-19T16:17:53.192037+0000","last_undegraded":"2023-12-19T16:17:53.192037+0000","last_fullsized":"2023-12-19T16:17:53.192037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:27:58.081684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192334+0000","last_change":"2023-12-19T16:17:52.052329+0000","last_active":"2023-12-19T16:17:53.192334+0000","last_peered":"2023-12-19T16:17:53.192334+0000","last_clean":"2023-12-19T16:17:53.192334+0000","last_became_active":"2023-12-19T16:17:52.052062+0000","last_became_peered":"2023-12-19T16:17:52.052062+0000","last_unstale":"2023-12-19T16:17:53.192334+0000","last_undegraded":"2023-12-19T16:17:53.192334+0000","last_fullsized":"2023-12-19T16:17:53.192334+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:28:45.532709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192420+0000","last_change":"2023-12-19T16:17:51.656696+0000","last_active":"2023-12-19T16:17:53.192420+0000","last_peered":"2023-12-19T16:17:53.192420+0000","last_clean":"2023-12-19T16:17:53.192420+0000","last_became_active":"2023-12-19T16:17:51.656419+0000","last_became_peered":"2023-12-19T16:17:51.656419+0000","last_unstale":"2023-12-19T16:17:53.192420+0000","last_undegraded":"2023-12-19T16:17:53.192420+0000","last_fullsized":"2023-12-19T16:17:53.192420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:19.455477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378743+0000","last_change":"2023-12-19T16:17:52.054974+0000","last_active":"2023-12-19T16:17:53.378743+0000","last_peered":"2023-12-19T16:17:53.378743+0000","last_clean":"2023-12-19T16:17:53.378743+0000","last_became_active":"2023-12-19T16:17:52.054694+0000","last_became_peered":"2023-12-19T16:17:52.054694+0000","last_unstale":"2023-12-19T16:17:53.378743+0000","last_undegraded":"2023-12-19T16:17:53.378743+0000","last_fullsized":"2023-12-19T16:17:53.378743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:54.372320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045648+0000","last_change":"2023-12-19T16:17:51.664092+0000","last_active":"2023-12-19T16:17:53.045648+0000","last_peered":"2023-12-19T16:17:53.045648+0000","last_clean":"2023-12-19T16:17:53.045648+0000","last_became_active":"2023-12-19T16:17:51.663801+0000","last_became_peered":"2023-12-19T16:17:51.663801+0000","last_unstale":"2023-12-19T16:17:53.045648+0000","last_undegraded":"2023-12-19T16:17:53.045648+0000","last_fullsized":"2023-12-19T16:17:53.045648+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:18.880699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192255+0000","last_change":"2023-12-19T16:17:52.054657+0000","last_active":"2023-12-19T16:17:53.192255+0000","last_peered":"2023-12-19T16:17:53.192255+0000","last_clean":"2023-12-19T16:17:53.192255+0000","last_became_active":"2023-12-19T16:17:52.054371+0000","last_became_peered":"2023-12-19T16:17:52.054371+0000","last_unstale":"2023-12-19T16:17:53.192255+0000","last_undegraded":"2023-12-19T16:17:53.192255+0000","last_fullsized":"2023-12-19T16:17:53.192255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:57:33.189565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192359+0000","last_change":"2023-12-19T16:17:51.656619+0000","last_active":"2023-12-19T16:17:53.192359+0000","last_peered":"2023-12-19T16:17:53.192359+0000","last_clean":"2023-12-19T16:17:53.192359+0000","last_became_active":"2023-12-19T16:17:51.656308+0000","last_became_peered":"2023-12-19T16:17:51.656308+0000","last_unstale":"2023-12-19T16:17:53.192359+0000","last_undegraded":"2023-12-19T16:17:53.192359+0000","last_fullsized":"2023-12-19T16:17:53.192359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:07.847321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192227+0000","last_change":"2023-12-19T16:17:52.061631+0000","last_active":"2023-12-19T16:17:53.192227+0000","last_peered":"2023-12-19T16:17:53.192227+0000","last_clean":"2023-12-19T16:17:53.192227+0000","last_became_active":"2023-12-19T16:17:52.061363+0000","last_became_peered":"2023-12-19T16:17:52.061363+0000","last_unstale":"2023-12-19T16:17:53.192227+0000","last_undegraded":"2023-12-19T16:17:53.192227+0000","last_fullsized":"2023-12-19T16:17:53.192227+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:01.082293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378883+0000","last_change":"2023-12-19T16:17:51.661097+0000","last_active":"2023-12-19T16:17:53.378883+0000","last_peered":"2023-12-19T16:17:53.378883+0000","last_clean":"2023-12-19T16:17:53.378883+0000","last_became_active":"2023-12-19T16:17:51.660783+0000","last_became_peered":"2023-12-19T16:17:51.660783+0000","last_unstale":"2023-12-19T16:17:53.378883+0000","last_undegraded":"2023-12-19T16:17:53.378883+0000","last_fullsized":"2023-12-19T16:17:53.378883+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:29.046336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045192+0000","last_change":"2023-12-19T16:17:52.063956+0000","last_active":"2023-12-19T16:17:53.045192+0000","last_peered":"2023-12-19T16:17:53.045192+0000","last_clean":"2023-12-19T16:17:53.045192+0000","last_became_active":"2023-12-19T16:17:52.063687+0000","last_became_peered":"2023-12-19T16:17:52.063687+0000","last_unstale":"2023-12-19T16:17:53.045192+0000","last_undegraded":"2023-12-19T16:17:53.045192+0000","last_fullsized":"2023-12-19T16:17:53.045192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:18:18.896617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047157+0000","last_change":"2023-12-19T16:17:51.658320+0000","last_active":"2023-12-19T16:17:53.047157+0000","last_peered":"2023-12-19T16:17:53.047157+0000","last_clean":"2023-12-19T16:17:53.047157+0000","last_became_active":"2023-12-19T16:17:51.657868+0000","last_became_peered":"2023-12-19T16:17:51.657868+0000","last_unstale":"2023-12-19T16:17:53.047157+0000","last_undegraded":"2023-12-19T16:17:53.047157+0000","last_fullsized":"2023-12-19T16:17:53.047157+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:07.847321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045370+0000","last_change":"2023-12-19T16:17:52.071088+0000","last_active":"2023-12-19T16:17:53.045370+0000","last_peered":"2023-12-19T16:17:53.045370+0000","last_clean":"2023-12-19T16:17:53.045370+0000","last_became_active":"2023-12-19T16:17:52.070502+0000","last_became_peered":"2023-12-19T16:17:52.070502+0000","last_unstale":"2023-12-19T16:17:53.045370+0000","last_undegraded":"2023-12-19T16:17:53.045370+0000","last_fullsized":"2023-12-19T16:17:53.045370+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:17.489021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192082+0000","last_change":"2023-12-19T16:17:51.660289+0000","last_active":"2023-12-19T16:17:53.192082+0000","last_peered":"2023-12-19T16:17:53.192082+0000","last_clean":"2023-12-19T16:17:53.192082+0000","last_became_active":"2023-12-19T16:17:51.660036+0000","last_became_peered":"2023-12-19T16:17:51.660036+0000","last_unstale":"2023-12-19T16:17:53.192082+0000","last_undegraded":"2023-12-19T16:17:53.192082+0000","last_fullsized":"2023-12-19T16:17:53.192082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.815309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046635+0000","last_change":"2023-12-19T16:17:52.061405+0000","last_active":"2023-12-19T16:17:53.046635+0000","last_peered":"2023-12-19T16:17:53.046635+0000","last_clean":"2023-12-19T16:17:53.046635+0000","last_became_active":"2023-12-19T16:17:52.061169+0000","last_became_peered":"2023-12-19T16:17:52.061169+0000","last_unstale":"2023-12-19T16:17:53.046635+0000","last_undegraded":"2023-12-19T16:17:53.046635+0000","last_fullsized":"2023-12-19T16:17:53.046635+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:18.270215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378757+0000","last_change":"2023-12-19T16:17:51.653152+0000","last_active":"2023-12-19T16:17:53.378757+0000","last_peered":"2023-12-19T16:17:53.378757+0000","last_clean":"2023-12-19T16:17:53.378757+0000","last_became_active":"2023-12-19T16:17:51.651778+0000","last_became_peered":"2023-12-19T16:17:51.651778+0000","last_unstale":"2023-12-19T16:17:53.378757+0000","last_undegraded":"2023-12-19T16:17:53.378757+0000","last_fullsized":"2023-12-19T16:17:53.378757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:53.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045148+0000","last_change":"2023-12-19T16:17:52.060380+0000","last_active":"2023-12-19T16:17:53.045148+0000","last_peered":"2023-12-19T16:17:53.045148+0000","last_clean":"2023-12-19T16:17:53.045148+0000","last_became_active":"2023-12-19T16:17:52.059908+0000","last_became_peered":"2023-12-19T16:17:52.059908+0000","last_unstale":"2023-12-19T16:17:53.045148+0000","last_undegraded":"2023-12-19T16:17:53.045148+0000","last_fullsized":"2023-12-19T16:17:53.045148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:21.420876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046622+0000","last_change":"2023-12-19T16:17:51.661349+0000","last_active":"2023-12-19T16:17:53.046622+0000","last_peered":"2023-12-19T16:17:53.046622+0000","last_clean":"2023-12-19T16:17:53.046622+0000","last_became_active":"2023-12-19T16:17:51.661044+0000","last_became_peered":"2023-12-19T16:17:51.661044+0000","last_unstale":"2023-12-19T16:17:53.046622+0000","last_undegraded":"2023-12-19T16:17:53.046622+0000","last_fullsized":"2023-12-19T16:17:53.046622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:19.455477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047981+0000","last_change":"2023-12-19T16:17:52.052259+0000","last_active":"2023-12-19T16:17:53.047981+0000","last_peered":"2023-12-19T16:17:53.047981+0000","last_clean":"2023-12-19T16:17:53.047981+0000","last_became_active":"2023-12-19T16:17:52.051905+0000","last_became_peered":"2023-12-19T16:17:52.051905+0000","last_unstale":"2023-12-19T16:17:53.047981+0000","last_undegraded":"2023-12-19T16:17:53.047981+0000","last_fullsized":"2023-12-19T16:17:53.047981+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:03:13.366961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047282+0000","last_change":"2023-12-19T16:17:51.669891+0000","last_active":"2023-12-19T16:17:53.047282+0000","last_peered":"2023-12-19T16:17:53.047282+0000","last_clean":"2023-12-19T16:17:53.047282+0000","last_became_active":"2023-12-19T16:17:51.669594+0000","last_became_peered":"2023-12-19T16:17:51.669594+0000","last_unstale":"2023-12-19T16:17:53.047282+0000","last_undegraded":"2023-12-19T16:17:53.047282+0000","last_fullsized":"2023-12-19T16:17:53.047282+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:24.434211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047247+0000","last_change":"2023-12-19T16:17:52.070575+0000","last_active":"2023-12-19T16:17:53.047247+0000","last_peered":"2023-12-19T16:17:53.047247+0000","last_clean":"2023-12-19T16:17:53.047247+0000","last_became_active":"2023-12-19T16:17:52.070261+0000","last_became_peered":"2023-12-19T16:17:52.070261+0000","last_unstale":"2023-12-19T16:17:53.047247+0000","last_undegraded":"2023-12-19T16:17:53.047247+0000","last_fullsized":"2023-12-19T16:17:53.047247+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:46.765277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045686+0000","last_change":"2023-12-19T16:17:51.665844+0000","last_active":"2023-12-19T16:17:53.045686+0000","last_peered":"2023-12-19T16:17:53.045686+0000","last_clean":"2023-12-19T16:17:53.045686+0000","last_became_active":"2023-12-19T16:17:51.665576+0000","last_became_peered":"2023-12-19T16:17:51.665576+0000","last_unstale":"2023-12-19T16:17:53.045686+0000","last_undegraded":"2023-12-19T16:17:53.045686+0000","last_fullsized":"2023-12-19T16:17:53.045686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:49.390890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378366+0000","last_change":"2023-12-19T16:17:52.055308+0000","last_active":"2023-12-19T16:17:53.378366+0000","last_peered":"2023-12-19T16:17:53.378366+0000","last_clean":"2023-12-19T16:17:53.378366+0000","last_became_active":"2023-12-19T16:17:52.055042+0000","last_became_peered":"2023-12-19T16:17:52.055042+0000","last_unstale":"2023-12-19T16:17:53.378366+0000","last_undegraded":"2023-12-19T16:17:53.378366+0000","last_fullsized":"2023-12-19T16:17:53.378366+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:07.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047461+0000","last_change":"2023-12-19T16:17:51.669775+0000","last_active":"2023-12-19T16:17:53.047461+0000","last_peered":"2023-12-19T16:17:53.047461+0000","last_clean":"2023-12-19T16:17:53.047461+0000","last_became_active":"2023-12-19T16:17:51.669477+0000","last_became_peered":"2023-12-19T16:17:51.669477+0000","last_unstale":"2023-12-19T16:17:53.047461+0000","last_undegraded":"2023-12-19T16:17:53.047461+0000","last_fullsized":"2023-12-19T16:17:53.047461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:51.466177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047281+0000","last_change":"2023-12-19T16:17:52.072334+0000","last_active":"2023-12-19T16:17:53.047281+0000","last_peered":"2023-12-19T16:17:53.047281+0000","last_clean":"2023-12-19T16:17:53.047281+0000","last_became_active":"2023-12-19T16:17:52.072056+0000","last_became_peered":"2023-12-19T16:17:52.072056+0000","last_unstale":"2023-12-19T16:17:53.047281+0000","last_undegraded":"2023-12-19T16:17:53.047281+0000","last_fullsized":"2023-12-19T16:17:53.047281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:38.183636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047862+0000","last_change":"2023-12-19T16:17:51.658398+0000","last_active":"2023-12-19T16:17:53.047862+0000","last_peered":"2023-12-19T16:17:53.047862+0000","last_clean":"2023-12-19T16:17:53.047862+0000","last_became_active":"2023-12-19T16:17:51.658089+0000","last_became_peered":"2023-12-19T16:17:51.658089+0000","last_unstale":"2023-12-19T16:17:53.047862+0000","last_undegraded":"2023-12-19T16:17:53.047862+0000","last_fullsized":"2023-12-19T16:17:53.047862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:16.761175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378507+0000","last_change":"2023-12-19T16:17:52.047300+0000","last_active":"2023-12-19T16:17:53.378507+0000","last_peered":"2023-12-19T16:17:53.378507+0000","last_clean":"2023-12-19T16:17:53.378507+0000","last_became_active":"2023-12-19T16:17:52.046842+0000","last_became_peered":"2023-12-19T16:17:52.046842+0000","last_unstale":"2023-12-19T16:17:53.378507+0000","last_undegraded":"2023-12-19T16:17:53.378507+0000","last_fullsized":"2023-12-19T16:17:53.378507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:01.082293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045381+0000","last_change":"2023-12-19T16:17:51.668536+0000","last_active":"2023-12-19T16:17:53.045381+0000","last_peered":"2023-12-19T16:17:53.045381+0000","last_clean":"2023-12-19T16:17:53.045381+0000","last_became_active":"2023-12-19T16:17:51.666732+0000","last_became_peered":"2023-12-19T16:17:51.666732+0000","last_unstale":"2023-12-19T16:17:53.045381+0000","last_undegraded":"2023-12-19T16:17:53.045381+0000","last_fullsized":"2023-12-19T16:17:53.045381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:56.116816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046732+0000","last_change":"2023-12-19T16:17:52.064394+0000","last_active":"2023-12-19T16:17:53.046732+0000","last_peered":"2023-12-19T16:17:53.046732+0000","last_clean":"2023-12-19T16:17:53.046732+0000","last_became_active":"2023-12-19T16:17:52.063918+0000","last_became_peered":"2023-12-19T16:17:52.063918+0000","last_unstale":"2023-12-19T16:17:53.046732+0000","last_undegraded":"2023-12-19T16:17:53.046732+0000","last_fullsized":"2023-12-19T16:17:53.046732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:17.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047060+0000","last_change":"2023-12-19T16:17:51.659308+0000","last_active":"2023-12-19T16:17:53.047060+0000","last_peered":"2023-12-19T16:17:53.047060+0000","last_clean":"2023-12-19T16:17:53.047060+0000","last_became_active":"2023-12-19T16:17:51.659013+0000","last_became_peered":"2023-12-19T16:17:51.659013+0000","last_unstale":"2023-12-19T16:17:53.047060+0000","last_undegraded":"2023-12-19T16:17:53.047060+0000","last_fullsized":"2023-12-19T16:17:53.047060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:48.681852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046541+0000","last_change":"2023-12-19T16:17:52.062577+0000","last_active":"2023-12-19T16:17:53.046541+0000","last_peered":"2023-12-19T16:17:53.046541+0000","last_clean":"2023-12-19T16:17:53.046541+0000","last_became_active":"2023-12-19T16:17:52.062314+0000","last_became_peered":"2023-12-19T16:17:52.062314+0000","last_unstale":"2023-12-19T16:17:53.046541+0000","last_undegraded":"2023-12-19T16:17:53.046541+0000","last_fullsized":"2023-12-19T16:17:53.046541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:34:30.935957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378747+0000","last_change":"2023-12-19T16:17:51.660917+0000","last_active":"2023-12-19T16:17:53.378747+0000","last_peered":"2023-12-19T16:17:53.378747+0000","last_clean":"2023-12-19T16:17:53.378747+0000","last_became_active":"2023-12-19T16:17:51.660605+0000","last_became_peered":"2023-12-19T16:17:51.660605+0000","last_unstale":"2023-12-19T16:17:53.378747+0000","last_undegraded":"2023-12-19T16:17:53.378747+0000","last_fullsized":"2023-12-19T16:17:53.378747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.815309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047482+0000","last_change":"2023-12-19T16:17:52.069115+0000","last_active":"2023-12-19T16:17:53.047482+0000","last_peered":"2023-12-19T16:17:53.047482+0000","last_clean":"2023-12-19T16:17:53.047482+0000","last_became_active":"2023-12-19T16:17:52.068808+0000","last_became_peered":"2023-12-19T16:17:52.068808+0000","last_unstale":"2023-12-19T16:17:53.047482+0000","last_undegraded":"2023-12-19T16:17:53.047482+0000","last_fullsized":"2023-12-19T16:17:53.047482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:30.053855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046854+0000","last_change":"2023-12-19T16:17:51.666148+0000","last_active":"2023-12-19T16:17:53.046854+0000","last_peered":"2023-12-19T16:17:53.046854+0000","last_clean":"2023-12-19T16:17:53.046854+0000","last_became_active":"2023-12-19T16:17:51.665681+0000","last_became_peered":"2023-12-19T16:17:51.665681+0000","last_unstale":"2023-12-19T16:17:53.046854+0000","last_undegraded":"2023-12-19T16:17:53.046854+0000","last_fullsized":"2023-12-19T16:17:53.046854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:55.198147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047073+0000","last_change":"2023-12-19T16:17:52.067104+0000","last_active":"2023-12-19T16:17:53.047073+0000","last_peered":"2023-12-19T16:17:53.047073+0000","last_clean":"2023-12-19T16:17:53.047073+0000","last_became_active":"2023-12-19T16:17:52.066744+0000","last_became_peered":"2023-12-19T16:17:52.066744+0000","last_unstale":"2023-12-19T16:17:53.047073+0000","last_undegraded":"2023-12-19T16:17:53.047073+0000","last_fullsized":"2023-12-19T16:17:53.047073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:17.768693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045776+0000","last_change":"2023-12-19T16:17:51.665947+0000","last_active":"2023-12-19T16:17:53.045776+0000","last_peered":"2023-12-19T16:17:53.045776+0000","last_clean":"2023-12-19T16:17:53.045776+0000","last_became_active":"2023-12-19T16:17:51.664502+0000","last_became_peered":"2023-12-19T16:17:51.664502+0000","last_unstale":"2023-12-19T16:17:53.045776+0000","last_undegraded":"2023-12-19T16:17:53.045776+0000","last_fullsized":"2023-12-19T16:17:53.045776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:57:32.182046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378909+0000","last_change":"2023-12-19T16:17:52.056789+0000","last_active":"2023-12-19T16:17:53.378909+0000","last_peered":"2023-12-19T16:17:53.378909+0000","last_clean":"2023-12-19T16:17:53.378909+0000","last_became_active":"2023-12-19T16:17:52.056587+0000","last_became_peered":"2023-12-19T16:17:52.056587+0000","last_unstale":"2023-12-19T16:17:53.378909+0000","last_undegraded":"2023-12-19T16:17:53.378909+0000","last_fullsized":"2023-12-19T16:17:53.378909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.198227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192358+0000","last_change":"2023-12-19T16:17:51.659202+0000","last_active":"2023-12-19T16:17:53.192358+0000","last_peered":"2023-12-19T16:17:53.192358+0000","last_clean":"2023-12-19T16:17:53.192358+0000","last_became_active":"2023-12-19T16:17:51.658909+0000","last_became_peered":"2023-12-19T16:17:51.658909+0000","last_unstale":"2023-12-19T16:17:53.192358+0000","last_undegraded":"2023-12-19T16:17:53.192358+0000","last_fullsized":"2023-12-19T16:17:53.192358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:06.587003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045336+0000","last_change":"2023-12-19T16:17:52.072080+0000","last_active":"2023-12-19T16:17:53.045336+0000","last_peered":"2023-12-19T16:17:53.045336+0000","last_clean":"2023-12-19T16:17:53.045336+0000","last_became_active":"2023-12-19T16:17:52.071719+0000","last_became_peered":"2023-12-19T16:17:52.071719+0000","last_unstale":"2023-12-19T16:17:53.045336+0000","last_undegraded":"2023-12-19T16:17:53.045336+0000","last_fullsized":"2023-12-19T16:17:53.045336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:23.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378865+0000","last_change":"2023-12-19T16:17:51.663881+0000","last_active":"2023-12-19T16:17:53.378865+0000","last_peered":"2023-12-19T16:17:53.378865+0000","last_clean":"2023-12-19T16:17:53.378865+0000","last_became_active":"2023-12-19T16:17:51.661537+0000","last_became_peered":"2023-12-19T16:17:51.661537+0000","last_unstale":"2023-12-19T16:17:53.378865+0000","last_undegraded":"2023-12-19T16:17:53.378865+0000","last_fullsized":"2023-12-19T16:17:53.378865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:37.176117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047325+0000","last_change":"2023-12-19T16:17:52.072263+0000","last_active":"2023-12-19T16:17:53.047325+0000","last_peered":"2023-12-19T16:17:53.047325+0000","last_clean":"2023-12-19T16:17:53.047325+0000","last_became_active":"2023-12-19T16:17:52.071995+0000","last_became_peered":"2023-12-19T16:17:52.071995+0000","last_unstale":"2023-12-19T16:17:53.047325+0000","last_undegraded":"2023-12-19T16:17:53.047325+0000","last_fullsized":"2023-12-19T16:17:53.047325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:07.383761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192219+0000","last_change":"2023-12-19T16:17:51.663046+0000","last_active":"2023-12-19T16:17:53.192219+0000","last_peered":"2023-12-19T16:17:53.192219+0000","last_clean":"2023-12-19T16:17:53.192219+0000","last_became_active":"2023-12-19T16:17:51.662731+0000","last_became_peered":"2023-12-19T16:17:51.662731+0000","last_unstale":"2023-12-19T16:17:53.192219+0000","last_undegraded":"2023-12-19T16:17:53.192219+0000","last_fullsized":"2023-12-19T16:17:53.192219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:53.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378923+0000","last_change":"2023-12-19T16:17:52.047124+0000","last_active":"2023-12-19T16:17:53.378923+0000","last_peered":"2023-12-19T16:17:53.378923+0000","last_clean":"2023-12-19T16:17:53.378923+0000","last_became_active":"2023-12-19T16:17:52.046502+0000","last_became_peered":"2023-12-19T16:17:52.046502+0000","last_unstale":"2023-12-19T16:17:53.378923+0000","last_undegraded":"2023-12-19T16:17:53.378923+0000","last_fullsized":"2023-12-19T16:17:53.378923+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:20:08.036072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045434+0000","last_change":"2023-12-19T16:17:51.662036+0000","last_active":"2023-12-19T16:17:53.045434+0000","last_peered":"2023-12-19T16:17:53.045434+0000","last_clean":"2023-12-19T16:17:53.045434+0000","last_became_active":"2023-12-19T16:17:51.661730+0000","last_became_peered":"2023-12-19T16:17:51.661730+0000","last_unstale":"2023-12-19T16:17:53.045434+0000","last_undegraded":"2023-12-19T16:17:53.045434+0000","last_fullsized":"2023-12-19T16:17:53.045434+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:19.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192134+0000","last_change":"2023-12-19T16:17:52.065189+0000","last_active":"2023-12-19T16:17:53.192134+0000","last_peered":"2023-12-19T16:17:53.192134+0000","last_clean":"2023-12-19T16:17:53.192134+0000","last_became_active":"2023-12-19T16:17:52.064521+0000","last_became_peered":"2023-12-19T16:17:52.064521+0000","last_unstale":"2023-12-19T16:17:53.192134+0000","last_undegraded":"2023-12-19T16:17:53.192134+0000","last_fullsized":"2023-12-19T16:17:53.192134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:50.398409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378278+0000","last_change":"2023-12-19T16:17:51.659564+0000","last_active":"2023-12-19T16:17:53.378278+0000","last_peered":"2023-12-19T16:17:53.378278+0000","last_clean":"2023-12-19T16:17:53.378278+0000","last_became_active":"2023-12-19T16:17:51.659300+0000","last_became_peered":"2023-12-19T16:17:51.659300+0000","last_unstale":"2023-12-19T16:17:53.378278+0000","last_undegraded":"2023-12-19T16:17:53.378278+0000","last_fullsized":"2023-12-19T16:17:53.378278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:15.776930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.191974+0000","last_change":"2023-12-19T16:17:52.060284+0000","last_active":"2023-12-19T16:17:53.191974+0000","last_peered":"2023-12-19T16:17:53.191974+0000","last_clean":"2023-12-19T16:17:53.191974+0000","last_became_active":"2023-12-19T16:17:52.060030+0000","last_became_peered":"2023-12-19T16:17:52.060030+0000","last_unstale":"2023-12-19T16:17:53.191974+0000","last_undegraded":"2023-12-19T16:17:53.191974+0000","last_fullsized":"2023-12-19T16:17:53.191974+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:57.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378608+0000","last_change":"2023-12-19T16:17:51.668993+0000","last_active":"2023-12-19T16:17:53.378608+0000","last_peered":"2023-12-19T16:17:53.378608+0000","last_clean":"2023-12-19T16:17:53.378608+0000","last_became_active":"2023-12-19T16:17:51.668675+0000","last_became_peered":"2023-12-19T16:17:51.668675+0000","last_unstale":"2023-12-19T16:17:53.378608+0000","last_undegraded":"2023-12-19T16:17:53.378608+0000","last_fullsized":"2023-12-19T16:17:53.378608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:06.376242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378763+0000","last_change":"2023-12-19T16:17:52.055160+0000","last_active":"2023-12-19T16:17:53.378763+0000","last_peered":"2023-12-19T16:17:53.378763+0000","last_clean":"2023-12-19T16:17:53.378763+0000","last_became_active":"2023-12-19T16:17:52.054059+0000","last_became_peered":"2023-12-19T16:17:52.054059+0000","last_unstale":"2023-12-19T16:17:53.378763+0000","last_undegraded":"2023-12-19T16:17:53.378763+0000","last_fullsized":"2023-12-19T16:17:53.378763+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:57:33.189565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378628+0000","last_change":"2023-12-19T16:17:51.660678+0000","last_active":"2023-12-19T16:17:53.378628+0000","last_peered":"2023-12-19T16:17:53.378628+0000","last_clean":"2023-12-19T16:17:53.378628+0000","last_became_active":"2023-12-19T16:17:51.660413+0000","last_became_peered":"2023-12-19T16:17:51.660413+0000","last_unstale":"2023-12-19T16:17:53.378628+0000","last_undegraded":"2023-12-19T16:17:53.378628+0000","last_fullsized":"2023-12-19T16:17:53.378628+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:17.262696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378956+0000","last_change":"2023-12-19T16:17:52.057271+0000","last_active":"2023-12-19T16:17:53.378956+0000","last_peered":"2023-12-19T16:17:53.378956+0000","last_clean":"2023-12-19T16:17:53.378956+0000","last_became_active":"2023-12-19T16:17:52.056160+0000","last_became_peered":"2023-12-19T16:17:52.056160+0000","last_unstale":"2023-12-19T16:17:53.378956+0000","last_undegraded":"2023-12-19T16:17:53.378956+0000","last_fullsized":"2023-12-19T16:17:53.378956+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:20.634013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192401+0000","last_change":"2023-12-19T16:17:51.661013+0000","last_active":"2023-12-19T16:17:53.192401+0000","last_peered":"2023-12-19T16:17:53.192401+0000","last_clean":"2023-12-19T16:17:53.192401+0000","last_became_active":"2023-12-19T16:17:51.660738+0000","last_became_peered":"2023-12-19T16:17:51.660738+0000","last_unstale":"2023-12-19T16:17:53.192401+0000","last_undegraded":"2023-12-19T16:17:53.192401+0000","last_fullsized":"2023-12-19T16:17:53.192401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:29.046336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378423+0000","last_change":"2023-12-19T16:17:52.055024+0000","last_active":"2023-12-19T16:17:53.378423+0000","last_peered":"2023-12-19T16:17:53.378423+0000","last_clean":"2023-12-19T16:17:53.378423+0000","last_became_active":"2023-12-19T16:17:52.054676+0000","last_became_peered":"2023-12-19T16:17:52.054676+0000","last_unstale":"2023-12-19T16:17:53.378423+0000","last_undegraded":"2023-12-19T16:17:53.378423+0000","last_fullsized":"2023-12-19T16:17:53.378423+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:17.768693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047369+0000","last_change":"2023-12-19T16:17:51.659627+0000","last_active":"2023-12-19T16:17:53.047369+0000","last_peered":"2023-12-19T16:17:53.047369+0000","last_clean":"2023-12-19T16:17:53.047369+0000","last_became_active":"2023-12-19T16:17:51.659343+0000","last_became_peered":"2023-12-19T16:17:51.659343+0000","last_unstale":"2023-12-19T16:17:53.047369+0000","last_undegraded":"2023-12-19T16:17:53.047369+0000","last_fullsized":"2023-12-19T16:17:53.047369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:51.466177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192331+0000","last_change":"2023-12-19T16:17:52.061618+0000","last_active":"2023-12-19T16:17:53.192331+0000","last_peered":"2023-12-19T16:17:53.192331+0000","last_clean":"2023-12-19T16:17:53.192331+0000","last_became_active":"2023-12-19T16:17:52.061243+0000","last_became_peered":"2023-12-19T16:17:52.061243+0000","last_unstale":"2023-12-19T16:17:53.192331+0000","last_undegraded":"2023-12-19T16:17:53.192331+0000","last_fullsized":"2023-12-19T16:17:53.192331+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:20:08.036072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378964+0000","last_change":"2023-12-19T16:17:51.650662+0000","last_active":"2023-12-19T16:17:53.378964+0000","last_peered":"2023-12-19T16:17:53.378964+0000","last_clean":"2023-12-19T16:17:53.378964+0000","last_became_active":"2023-12-19T16:17:51.650361+0000","last_became_peered":"2023-12-19T16:17:51.650361+0000","last_unstale":"2023-12-19T16:17:53.378964+0000","last_undegraded":"2023-12-19T16:17:53.378964+0000","last_fullsized":"2023-12-19T16:17:53.378964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:07.847321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045226+0000","last_change":"2023-12-19T16:17:52.067764+0000","last_active":"2023-12-19T16:17:53.045226+0000","last_peered":"2023-12-19T16:17:53.045226+0000","last_clean":"2023-12-19T16:17:53.045226+0000","last_became_active":"2023-12-19T16:17:52.067516+0000","last_became_peered":"2023-12-19T16:17:52.067516+0000","last_unstale":"2023-12-19T16:17:53.045226+0000","last_undegraded":"2023-12-19T16:17:53.045226+0000","last_fullsized":"2023-12-19T16:17:53.045226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:24.002692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378293+0000","last_change":"2023-12-19T16:17:51.649394+0000","last_active":"2023-12-19T16:17:53.378293+0000","last_peered":"2023-12-19T16:17:53.378293+0000","last_clean":"2023-12-19T16:17:53.378293+0000","last_became_active":"2023-12-19T16:17:51.649111+0000","last_became_peered":"2023-12-19T16:17:51.649111+0000","last_unstale":"2023-12-19T16:17:53.378293+0000","last_undegraded":"2023-12-19T16:17:53.378293+0000","last_fullsized":"2023-12-19T16:17:53.378293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:17:11.481775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046839+0000","last_change":"2023-12-19T16:17:52.076173+0000","last_active":"2023-12-19T16:17:53.046839+0000","last_peered":"2023-12-19T16:17:53.046839+0000","last_clean":"2023-12-19T16:17:53.046839+0000","last_became_active":"2023-12-19T16:17:52.075865+0000","last_became_peered":"2023-12-19T16:17:52.075865+0000","last_unstale":"2023-12-19T16:17:53.046839+0000","last_undegraded":"2023-12-19T16:17:53.046839+0000","last_fullsized":"2023-12-19T16:17:53.046839+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:54.372320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046863+0000","last_change":"2023-12-19T16:17:51.658185+0000","last_active":"2023-12-19T16:17:53.046863+0000","last_peered":"2023-12-19T16:17:53.046863+0000","last_clean":"2023-12-19T16:17:53.046863+0000","last_became_active":"2023-12-19T16:17:51.657843+0000","last_became_peered":"2023-12-19T16:17:51.657843+0000","last_unstale":"2023-12-19T16:17:53.046863+0000","last_undegraded":"2023-12-19T16:17:53.046863+0000","last_fullsized":"2023-12-19T16:17:53.046863+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:06.587003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378064+0000","last_change":"2023-12-19T16:17:52.049845+0000","last_active":"2023-12-19T16:17:53.378064+0000","last_peered":"2023-12-19T16:17:53.378064+0000","last_clean":"2023-12-19T16:17:53.378064+0000","last_became_active":"2023-12-19T16:17:52.049574+0000","last_became_peered":"2023-12-19T16:17:52.049574+0000","last_unstale":"2023-12-19T16:17:53.378064+0000","last_undegraded":"2023-12-19T16:17:53.378064+0000","last_fullsized":"2023-12-19T16:17:53.378064+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:30.053855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378140+0000","last_change":"2023-12-19T16:17:51.660572+0000","last_active":"2023-12-19T16:17:53.378140+0000","last_peered":"2023-12-19T16:17:53.378140+0000","last_clean":"2023-12-19T16:17:53.378140+0000","last_became_active":"2023-12-19T16:17:51.660298+0000","last_became_peered":"2023-12-19T16:17:51.660298+0000","last_unstale":"2023-12-19T16:17:53.378140+0000","last_undegraded":"2023-12-19T16:17:53.378140+0000","last_fullsized":"2023-12-19T16:17:53.378140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:15.093683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045270+0000","last_change":"2023-12-19T16:17:52.060154+0000","last_active":"2023-12-19T16:17:53.045270+0000","last_peered":"2023-12-19T16:17:53.045270+0000","last_clean":"2023-12-19T16:17:53.045270+0000","last_became_active":"2023-12-19T16:17:52.059596+0000","last_became_peered":"2023-12-19T16:17:52.059596+0000","last_unstale":"2023-12-19T16:17:53.045270+0000","last_undegraded":"2023-12-19T16:17:53.045270+0000","last_fullsized":"2023-12-19T16:17:53.045270+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:02.194566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045213+0000","last_change":"2023-12-19T16:17:51.664178+0000","last_active":"2023-12-19T16:17:53.045213+0000","last_peered":"2023-12-19T16:17:53.045213+0000","last_clean":"2023-12-19T16:17:53.045213+0000","last_became_active":"2023-12-19T16:17:51.663896+0000","last_became_peered":"2023-12-19T16:17:51.663896+0000","last_unstale":"2023-12-19T16:17:53.045213+0000","last_undegraded":"2023-12-19T16:17:53.045213+0000","last_fullsized":"2023-12-19T16:17:53.045213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:54.190708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045073+0000","last_change":"2023-12-19T16:17:52.064058+0000","last_active":"2023-12-19T16:17:53.045073+0000","last_peered":"2023-12-19T16:17:53.045073+0000","last_clean":"2023-12-19T16:17:53.045073+0000","last_became_active":"2023-12-19T16:17:52.063859+0000","last_became_peered":"2023-12-19T16:17:52.063859+0000","last_unstale":"2023-12-19T16:17:53.045073+0000","last_undegraded":"2023-12-19T16:17:53.045073+0000","last_fullsized":"2023-12-19T16:17:53.045073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:58.627316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046349+0000","last_change":"2023-12-19T16:17:51.660326+0000","last_active":"2023-12-19T16:17:53.046349+0000","last_peered":"2023-12-19T16:17:53.046349+0000","last_clean":"2023-12-19T16:17:53.046349+0000","last_became_active":"2023-12-19T16:17:51.660071+0000","last_became_peered":"2023-12-19T16:17:51.660071+0000","last_unstale":"2023-12-19T16:17:53.046349+0000","last_undegraded":"2023-12-19T16:17:53.046349+0000","last_fullsized":"2023-12-19T16:17:53.046349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:55.198147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T16:17:52.046262+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:17:52.046262+0000","last_peered":"2023-12-19T16:17:52.046262+0000","last_clean":"2023-12-19T16:17:52.046262+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:17:52.046262+0000","last_undegraded":"2023-12-19T16:17:52.046262+0000","last_fullsized":"2023-12-19T16:17:52.046262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1261568,"data_stored":885609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.64800000000000002},"min":{"1min":0.48499999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.622}]},{"osd":1,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88200000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.877}]},{"osd":3,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.82499999999999996,"5min":1.006,"15min":1.006},"last":0.753},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.91700000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.028,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91100000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83799999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82399999999999995,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.98199999999999998,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.754,"15min":0.77500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.006,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.874,"5min":1,"15min":1},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70299999999999996},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.92600000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.747},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89000000000000001,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.58199999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0309999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.94799999999999995,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":655360,"data_stored":289113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82399999999999995,"5min":1.125,"15min":1.125},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.79000000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.51400000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83499999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.85799999999999998,"5min":1.641,"15min":1.641},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.78800000000000003,"15min":0.81799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83599999999999997,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.88600000000000001,"15min":0.94199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84399999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.872,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.80300000000000005,"5min":1.135,"15min":1.135},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89100000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91500000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90300000000000002,"5min":1.74,"15min":1.74},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":671744,"data_stored":296645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83999999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.315},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.115,"15min":1.115},"last":0.29499999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95999999999999996,"5min":0.997,"15min":0.997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97799999999999998,"5min":1.179,"15min":1.179},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.44},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.50700000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92900000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91800000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68500000000000005},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86099999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.29399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55800000000000005,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.91300000000000003,"15min":0.99299999999999999},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.626,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.35299999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.54700000000000004,"15min":0.57299999999999995},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.53800000000000003,"5min":2.577,"15min":2.577},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.89600000000000002,"15min":0.96399999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68300000000000005,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.47499999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.97799999999999998,"15min":1.0569999999999999},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.432},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68600000000000005,"5min":2.907,"15min":2.907},"last":0.502}]},{"osd":4,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0249999999999999,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94799999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.754},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.99099999999999999,"15min":1.0369999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.92900000000000005,"15min":0.95099999999999996},"min":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0820000000000001,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1,"5min":1.708,"15min":1.708},"last":0.76600000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.998,"15min":1.042},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.99299999999999999,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.85899999999999999,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96599999999999997,"5min":2.742,"15min":2.742},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":655360,"data_stored":288517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.52100000000000002,"15min":0.54100000000000004},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59399999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54600000000000004,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.59499999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.5,"5min":1.962,"15min":1.962},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56200000000000006,"5min":1.974,"15min":1.974},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51700000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93100000000000005,"5min":1.877,"15min":1.877},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.85199999999999998,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83299999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.83599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.655,"15min":1.655},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.83899999999999997,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.82499999999999996,"15min":0.85099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94899999999999995,"5min":2.032,"15min":2.032},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.747}]},{"osd":7,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.91000000000000003,"15min":0.94799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97799999999999998,"5min":2.706,"15min":2.706},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.89600000000000002,"15min":0.93200000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.86899999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":288551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.52800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.501}]},{"osd":2,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.53600000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.59599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.38100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.57699999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.872,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85899999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93300000000000005,"5min":1.054,"15min":1.054},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96399999999999997,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97799999999999998,"5min":1.502,"15min":1.502},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94899999999999995,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91600000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1257472,"data_stored":880975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.44800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58999999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.502},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.626}]},{"osd":3,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.499,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.57899999999999996,"5min":1.46,"15min":1.46},"last":0.69199999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84399999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.014,"5min":1.093,"15min":1.093},"last":0.82799999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.746},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.077,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.93500000000000005,"5min":1.506,"15min":1.506},"last":0.755},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89400000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.84199999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97599999999999998,"5min":1.133,"15min":1.133},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.05,"5min":1.083,"15min":1.083},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:56.119 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:56.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.287+0000 7f9ffd841640 1 Processor -- start 2023-12-19T16:17:56.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ffd841640 1 -- start start 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ffd841640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff815ca40 0x7f9ff80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ffd841640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ff80ce3f0 0x7f9ff80cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ffd841640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80cfa70 con 0x7f9ff80cf610 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ffd841640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80d11c0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ffd841640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80d0310 con 0x7f9ff815ca40 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff67fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ff80ce3f0 0x7f9ff80cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff77fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9ff80cf610 0x7f9ff81605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53488/0 (socket says 172.21.15.119:53488) 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff77fe640 1 -- 172.21.15.119:0/1842729469 learned_addr learned my addr 172.21.15.119:0/1842729469 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff6ffd640 1 --2- 172.21.15.119:0/1842729469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff815ca40 0x7f9ff80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff67fc640 1 -- 172.21.15.119:0/1842729469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff815ca40 msgr2=0x7f9ff80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:56.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff67fc640 1 --2- 172.21.15.119:0/1842729469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff815ca40 0x7f9ff80cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff67fc640 1 -- 172.21.15.119:0/1842729469 >> v1:172.21.15.119:6789/0 conn(0x7f9ff80cf610 legacy=0x7f9ff81605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff67fc640 1 -- 172.21.15.119:0/1842729469 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80d05b0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.291+0000 7f9ff5ffb640 1 -- 172.21.15.119:0/1842729469 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439186714 0 0) 0x7f9ff80cfa70 con 0x7f9ff80cf610 2023-12-19T16:17:56.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ff67fc640 1 --2- 172.21.15.119:0/1842729469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80cf0d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0097a0 tx=0x7f9fec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd3a8692e5d6db7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:56.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ff5ffb640 1 -- 172.21.15.119:0/1842729469 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0ad680 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ff5ffb640 1 -- 172.21.15.119:0/1842729469 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec0ad7e0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ff5ffb640 1 -- 172.21.15.119:0/1842729469 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0adb70 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 -- 172.21.15.119:0/1842729469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 msgr2=0x7f9ff80cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 --2- 172.21.15.119:0/1842729469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80cf0d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0097a0 tx=0x7f9fec01c460 comp rx=0 tx=0).stop 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 -- 172.21.15.119:0/1842729469 shutdown_connections 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 --2- 172.21.15.119:0/1842729469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80cf0d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 --2- 172.21.15.119:0/1842729469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff815ca40 0x7f9ff80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 -- 172.21.15.119:0/1842729469 >> 172.21.15.119:0/1842729469 conn(0x7f9ff8089fb0 msgr2=0x7f9ff80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 -- 172.21.15.119:0/1842729469 shutdown_connections 2023-12-19T16:17:56.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 -- 172.21.15.119:0/1842729469 wait complete. 2023-12-19T16:17:56.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 Processor -- start 2023-12-19T16:17:56.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.295+0000 7f9ffd841640 1 -- start start 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff80cf610 0x7f9ff815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff815ca40 0x7f9ff8155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff815ba70 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81546d0 con 0x7f9ff815ca40 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80c8ea0 con 0x7f9ff80cf610 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56402/0 (socket says 172.21.15.119:56402) 2023-12-19T16:17:56.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 -- 172.21.15.119:0/4026986099 learned_addr learned my addr 172.21.15.119:0/4026986099 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff77fe640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff815ca40 0x7f9ff8155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff67fc640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff80cf610 0x7f9ff815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 -- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff80cf610 msgr2=0x7f9ff815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff80cf610 0x7f9ff815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 -- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff815ca40 msgr2=0x7f9ff8155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff815ca40 0x7f9ff8155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 -- 172.21.15.119:0/4026986099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0093b0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff77fe640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff815ca40 0x7f9ff8155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff67fc640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff80cf610 0x7f9ff815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ff6ffd640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80c7a10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800d800 tx=0x7f9fe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8018070 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80059a0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8005b50 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8154a30 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff8154ff0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff81598e0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.299+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9fe8005cb0 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.303+0000 7f9fdffff640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe4065a60 0x7f9fe4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.303+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fe8083240 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.303+0000 7f9ff67fc640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe4065a60 0x7f9fe4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.303+0000 7f9ff67fc640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe4065a60 0x7f9fe4067f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:56.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.307+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9fe8050a20 con 0x7f9ff80ce3f0 2023-12-19T16:17:56.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.451+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ff81548b0 con 0x7f9fe4065a60 2023-12-19T16:17:56.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.459+0000 7f9fdffff640 1 -- 172.21.15.119:0/4026986099 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289242 (secure 0 0 0) 0x7f9fec0bc090 con 0x7f9fe4065a60 2023-12-19T16:17:56.467 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:56.469 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:17:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe4065a60 msgr2=0x7f9fe4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe4065a60 0x7f9fe4067f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec0a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 msgr2=0x7f9ff80c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80c7a10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800d800 tx=0x7f9fe800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 shutdown_connections 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe4065a60 0x7f9fe4067f20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff815ca40 0x7f9ff8155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff80cf610 0x7f9ff815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 --2- 172.21.15.119:0/4026986099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff80ce3f0 0x7f9ff80c7a10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 >> 172.21.15.119:0/4026986099 conn(0x7f9ff8089fb0 msgr2=0x7f9ff806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 shutdown_connections 2023-12-19T16:17:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.463+0000 7f9ffd841640 1 -- 172.21.15.119:0/4026986099 wait complete. 2023-12-19T16:17:56.488 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-12-19T16:17:54.481130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221944,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752776,"statfs":{"total":773094113280,"available":772866842624,"internally_reserved":0,"allocated":6479872,"data_stored":3519628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000687"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378723+0000","last_change":"2023-12-19T16:17:52.067944+0000","last_active":"2023-12-19T16:17:53.378723+0000","last_peered":"2023-12-19T16:17:53.378723+0000","last_clean":"2023-12-19T16:17:53.378723+0000","last_became_active":"2023-12-19T16:17:52.067706+0000","last_became_peered":"2023-12-19T16:17:52.067706+0000","last_unstale":"2023-12-19T16:17:53.378723+0000","last_undegraded":"2023-12-19T16:17:53.378723+0000","last_fullsized":"2023-12-19T16:17:53.378723+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:29:01.221836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045606+0000","last_change":"2023-12-19T16:17:52.071041+0000","last_active":"2023-12-19T16:17:53.045606+0000","last_peered":"2023-12-19T16:17:53.045606+0000","last_clean":"2023-12-19T16:17:53.045606+0000","last_became_active":"2023-12-19T16:17:52.069815+0000","last_became_peered":"2023-12-19T16:17:52.069815+0000","last_unstale":"2023-12-19T16:17:53.045606+0000","last_undegraded":"2023-12-19T16:17:53.045606+0000","last_fullsized":"2023-12-19T16:17:53.045606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:05.449296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047154+0000","last_change":"2023-12-19T16:17:52.068692+0000","last_active":"2023-12-19T16:17:53.047154+0000","last_peered":"2023-12-19T16:17:53.047154+0000","last_clean":"2023-12-19T16:17:53.047154+0000","last_became_active":"2023-12-19T16:17:52.068290+0000","last_became_peered":"2023-12-19T16:17:52.068290+0000","last_unstale":"2023-12-19T16:17:53.047154+0000","last_undegraded":"2023-12-19T16:17:53.047154+0000","last_fullsized":"2023-12-19T16:17:53.047154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:05:15.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378874+0000","last_change":"2023-12-19T16:17:52.054804+0000","last_active":"2023-12-19T16:17:53.378874+0000","last_peered":"2023-12-19T16:17:53.378874+0000","last_clean":"2023-12-19T16:17:53.378874+0000","last_became_active":"2023-12-19T16:17:52.054240+0000","last_became_peered":"2023-12-19T16:17:52.054240+0000","last_unstale":"2023-12-19T16:17:53.378874+0000","last_undegraded":"2023-12-19T16:17:53.378874+0000","last_fullsized":"2023-12-19T16:17:53.378874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:50.398409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378513+0000","last_change":"2023-12-19T16:17:52.057657+0000","last_active":"2023-12-19T16:17:53.378513+0000","last_peered":"2023-12-19T16:17:53.378513+0000","last_clean":"2023-12-19T16:17:53.378513+0000","last_became_active":"2023-12-19T16:17:52.057398+0000","last_became_peered":"2023-12-19T16:17:52.057398+0000","last_unstale":"2023-12-19T16:17:53.378513+0000","last_undegraded":"2023-12-19T16:17:53.378513+0000","last_fullsized":"2023-12-19T16:17:53.378513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:33:06.598944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192019+0000","last_change":"2023-12-19T16:17:52.060945+0000","last_active":"2023-12-19T16:17:53.192019+0000","last_peered":"2023-12-19T16:17:53.192019+0000","last_clean":"2023-12-19T16:17:53.192019+0000","last_became_active":"2023-12-19T16:17:52.060683+0000","last_became_peered":"2023-12-19T16:17:52.060683+0000","last_unstale":"2023-12-19T16:17:53.192019+0000","last_undegraded":"2023-12-19T16:17:53.192019+0000","last_fullsized":"2023-12-19T16:17:53.192019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:20.634013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046205+0000","last_change":"2023-12-19T16:17:52.049535+0000","last_active":"2023-12-19T16:17:53.046205+0000","last_peered":"2023-12-19T16:17:53.046205+0000","last_clean":"2023-12-19T16:17:53.046205+0000","last_became_active":"2023-12-19T16:17:52.049245+0000","last_became_peered":"2023-12-19T16:17:52.049245+0000","last_unstale":"2023-12-19T16:17:53.046205+0000","last_undegraded":"2023-12-19T16:17:53.046205+0000","last_fullsized":"2023-12-19T16:17:53.046205+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:30.013265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045001+0000","last_change":"2023-12-19T16:17:52.066926+0000","last_active":"2023-12-19T16:17:53.045001+0000","last_peered":"2023-12-19T16:17:53.045001+0000","last_clean":"2023-12-19T16:17:53.045001+0000","last_became_active":"2023-12-19T16:17:52.066675+0000","last_became_peered":"2023-12-19T16:17:52.066675+0000","last_unstale":"2023-12-19T16:17:53.045001+0000","last_undegraded":"2023-12-19T16:17:53.045001+0000","last_fullsized":"2023-12-19T16:17:53.045001+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:21.699284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047995+0000","last_change":"2023-12-19T16:17:52.051575+0000","last_active":"2023-12-19T16:17:53.047995+0000","last_peered":"2023-12-19T16:17:53.047995+0000","last_clean":"2023-12-19T16:17:53.047995+0000","last_became_active":"2023-12-19T16:17:52.051237+0000","last_became_peered":"2023-12-19T16:17:52.051237+0000","last_unstale":"2023-12-19T16:17:53.047995+0000","last_undegraded":"2023-12-19T16:17:53.047995+0000","last_fullsized":"2023-12-19T16:17:53.047995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:19:30.855985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378536+0000","last_change":"2023-12-19T16:17:52.053899+0000","last_active":"2023-12-19T16:17:53.378536+0000","last_peered":"2023-12-19T16:17:53.378536+0000","last_clean":"2023-12-19T16:17:53.378536+0000","last_became_active":"2023-12-19T16:17:52.053637+0000","last_became_peered":"2023-12-19T16:17:52.053637+0000","last_unstale":"2023-12-19T16:17:53.378536+0000","last_undegraded":"2023-12-19T16:17:53.378536+0000","last_fullsized":"2023-12-19T16:17:53.378536+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:08.854840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378634+0000","last_change":"2023-12-19T16:17:52.060277+0000","last_active":"2023-12-19T16:17:53.378634+0000","last_peered":"2023-12-19T16:17:53.378634+0000","last_clean":"2023-12-19T16:17:53.378634+0000","last_became_active":"2023-12-19T16:17:52.060034+0000","last_became_peered":"2023-12-19T16:17:52.060034+0000","last_unstale":"2023-12-19T16:17:53.378634+0000","last_undegraded":"2023-12-19T16:17:53.378634+0000","last_fullsized":"2023-12-19T16:17:53.378634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:20.462995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378784+0000","last_change":"2023-12-19T16:17:52.053656+0000","last_active":"2023-12-19T16:17:53.378784+0000","last_peered":"2023-12-19T16:17:53.378784+0000","last_clean":"2023-12-19T16:17:53.378784+0000","last_became_active":"2023-12-19T16:17:52.053399+0000","last_became_peered":"2023-12-19T16:17:52.053399+0000","last_unstale":"2023-12-19T16:17:53.378784+0000","last_undegraded":"2023-12-19T16:17:53.378784+0000","last_fullsized":"2023-12-19T16:17:53.378784+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:19.888218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047377+0000","last_change":"2023-12-19T16:17:52.060226+0000","last_active":"2023-12-19T16:17:53.047377+0000","last_peered":"2023-12-19T16:17:53.047377+0000","last_clean":"2023-12-19T16:17:53.047377+0000","last_became_active":"2023-12-19T16:17:52.059812+0000","last_became_peered":"2023-12-19T16:17:52.059812+0000","last_unstale":"2023-12-19T16:17:53.047377+0000","last_undegraded":"2023-12-19T16:17:53.047377+0000","last_fullsized":"2023-12-19T16:17:53.047377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:16.101202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046781+0000","last_change":"2023-12-19T16:17:52.054809+0000","last_active":"2023-12-19T16:17:53.046781+0000","last_peered":"2023-12-19T16:17:53.046781+0000","last_clean":"2023-12-19T16:17:53.046781+0000","last_became_active":"2023-12-19T16:17:52.054518+0000","last_became_peered":"2023-12-19T16:17:52.054518+0000","last_unstale":"2023-12-19T16:17:53.046781+0000","last_undegraded":"2023-12-19T16:17:53.046781+0000","last_fullsized":"2023-12-19T16:17:53.046781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:47.177714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046360+0000","last_change":"2023-12-19T16:17:52.055437+0000","last_active":"2023-12-19T16:17:53.046360+0000","last_peered":"2023-12-19T16:17:53.046360+0000","last_clean":"2023-12-19T16:17:53.046360+0000","last_became_active":"2023-12-19T16:17:52.055159+0000","last_became_peered":"2023-12-19T16:17:52.055159+0000","last_unstale":"2023-12-19T16:17:53.046360+0000","last_undegraded":"2023-12-19T16:17:53.046360+0000","last_fullsized":"2023-12-19T16:17:53.046360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:01:26.361268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.191953+0000","last_change":"2023-12-19T16:17:52.058811+0000","last_active":"2023-12-19T16:17:53.191953+0000","last_peered":"2023-12-19T16:17:53.191953+0000","last_clean":"2023-12-19T16:17:53.191953+0000","last_became_active":"2023-12-19T16:17:52.058550+0000","last_became_peered":"2023-12-19T16:17:52.058550+0000","last_unstale":"2023-12-19T16:17:53.191953+0000","last_undegraded":"2023-12-19T16:17:53.191953+0000","last_fullsized":"2023-12-19T16:17:53.191953+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:19.888218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045656+0000","last_change":"2023-12-19T16:17:52.068269+0000","last_active":"2023-12-19T16:17:53.045656+0000","last_peered":"2023-12-19T16:17:53.045656+0000","last_clean":"2023-12-19T16:17:53.045656+0000","last_became_active":"2023-12-19T16:17:52.065405+0000","last_became_peered":"2023-12-19T16:17:52.065405+0000","last_unstale":"2023-12-19T16:17:53.045656+0000","last_undegraded":"2023-12-19T16:17:53.045656+0000","last_fullsized":"2023-12-19T16:17:53.045656+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:39.862268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047030+0000","last_change":"2023-12-19T16:17:52.067114+0000","last_active":"2023-12-19T16:17:53.047030+0000","last_peered":"2023-12-19T16:17:53.047030+0000","last_clean":"2023-12-19T16:17:53.047030+0000","last_became_active":"2023-12-19T16:17:52.066805+0000","last_became_peered":"2023-12-19T16:17:52.066805+0000","last_unstale":"2023-12-19T16:17:53.047030+0000","last_undegraded":"2023-12-19T16:17:53.047030+0000","last_fullsized":"2023-12-19T16:17:53.047030+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:08.854840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378675+0000","last_change":"2023-12-19T16:17:52.061943+0000","last_active":"2023-12-19T16:17:53.378675+0000","last_peered":"2023-12-19T16:17:53.378675+0000","last_clean":"2023-12-19T16:17:53.378675+0000","last_became_active":"2023-12-19T16:17:52.061715+0000","last_became_peered":"2023-12-19T16:17:52.061715+0000","last_unstale":"2023-12-19T16:17:53.378675+0000","last_undegraded":"2023-12-19T16:17:53.378675+0000","last_fullsized":"2023-12-19T16:17:53.378675+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:38.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045252+0000","last_change":"2023-12-19T16:17:52.071299+0000","last_active":"2023-12-19T16:17:53.045252+0000","last_peered":"2023-12-19T16:17:53.045252+0000","last_clean":"2023-12-19T16:17:53.045252+0000","last_became_active":"2023-12-19T16:17:52.070116+0000","last_became_peered":"2023-12-19T16:17:52.070116+0000","last_unstale":"2023-12-19T16:17:53.045252+0000","last_undegraded":"2023-12-19T16:17:53.045252+0000","last_fullsized":"2023-12-19T16:17:53.045252+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:08.037685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046578+0000","last_change":"2023-12-19T16:17:52.068489+0000","last_active":"2023-12-19T16:17:53.046578+0000","last_peered":"2023-12-19T16:17:53.046578+0000","last_clean":"2023-12-19T16:17:53.046578+0000","last_became_active":"2023-12-19T16:17:52.066963+0000","last_became_peered":"2023-12-19T16:17:52.066963+0000","last_unstale":"2023-12-19T16:17:53.046578+0000","last_undegraded":"2023-12-19T16:17:53.046578+0000","last_fullsized":"2023-12-19T16:17:53.046578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:02.545748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045138+0000","last_change":"2023-12-19T16:17:52.058048+0000","last_active":"2023-12-19T16:17:53.045138+0000","last_peered":"2023-12-19T16:17:53.045138+0000","last_clean":"2023-12-19T16:17:53.045138+0000","last_became_active":"2023-12-19T16:17:52.057618+0000","last_became_peered":"2023-12-19T16:17:52.057618+0000","last_unstale":"2023-12-19T16:17:53.045138+0000","last_undegraded":"2023-12-19T16:17:53.045138+0000","last_fullsized":"2023-12-19T16:17:53.045138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:13.635135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046933+0000","last_change":"2023-12-19T16:17:52.068916+0000","last_active":"2023-12-19T16:17:53.046933+0000","last_peered":"2023-12-19T16:17:53.046933+0000","last_clean":"2023-12-19T16:17:53.046933+0000","last_became_active":"2023-12-19T16:17:52.068422+0000","last_became_peered":"2023-12-19T16:17:52.068422+0000","last_unstale":"2023-12-19T16:17:53.046933+0000","last_undegraded":"2023-12-19T16:17:53.046933+0000","last_fullsized":"2023-12-19T16:17:53.046933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:23.822827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046542+0000","last_change":"2023-12-19T16:17:52.052069+0000","last_active":"2023-12-19T16:17:53.046542+0000","last_peered":"2023-12-19T16:17:53.046542+0000","last_clean":"2023-12-19T16:17:53.046542+0000","last_became_active":"2023-12-19T16:17:52.050586+0000","last_became_peered":"2023-12-19T16:17:52.050586+0000","last_unstale":"2023-12-19T16:17:53.046542+0000","last_undegraded":"2023-12-19T16:17:53.046542+0000","last_fullsized":"2023-12-19T16:17:53.046542+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:16.784449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378807+0000","last_change":"2023-12-19T16:17:52.061738+0000","last_active":"2023-12-19T16:17:53.378807+0000","last_peered":"2023-12-19T16:17:53.378807+0000","last_clean":"2023-12-19T16:17:53.378807+0000","last_became_active":"2023-12-19T16:17:52.061491+0000","last_became_peered":"2023-12-19T16:17:52.061491+0000","last_unstale":"2023-12-19T16:17:53.378807+0000","last_undegraded":"2023-12-19T16:17:53.378807+0000","last_fullsized":"2023-12-19T16:17:53.378807+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:42.717083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378649+0000","last_change":"2023-12-19T16:17:52.055338+0000","last_active":"2023-12-19T16:17:53.378649+0000","last_peered":"2023-12-19T16:17:53.378649+0000","last_clean":"2023-12-19T16:17:53.378649+0000","last_became_active":"2023-12-19T16:17:52.054894+0000","last_became_peered":"2023-12-19T16:17:52.054894+0000","last_unstale":"2023-12-19T16:17:53.378649+0000","last_undegraded":"2023-12-19T16:17:53.378649+0000","last_fullsized":"2023-12-19T16:17:53.378649+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:28.558969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192264+0000","last_change":"2023-12-19T16:17:52.059797+0000","last_active":"2023-12-19T16:17:53.192264+0000","last_peered":"2023-12-19T16:17:53.192264+0000","last_clean":"2023-12-19T16:17:53.192264+0000","last_became_active":"2023-12-19T16:17:52.059499+0000","last_became_peered":"2023-12-19T16:17:52.059499+0000","last_unstale":"2023-12-19T16:17:53.192264+0000","last_undegraded":"2023-12-19T16:17:53.192264+0000","last_fullsized":"2023-12-19T16:17:53.192264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.198227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378647+0000","last_change":"2023-12-19T16:17:52.052603+0000","last_active":"2023-12-19T16:17:53.378647+0000","last_peered":"2023-12-19T16:17:53.378647+0000","last_clean":"2023-12-19T16:17:53.378647+0000","last_became_active":"2023-12-19T16:17:52.052213+0000","last_became_peered":"2023-12-19T16:17:52.052213+0000","last_unstale":"2023-12-19T16:17:53.378647+0000","last_undegraded":"2023-12-19T16:17:53.378647+0000","last_fullsized":"2023-12-19T16:17:53.378647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:45:04.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045459+0000","last_change":"2023-12-19T16:17:52.071186+0000","last_active":"2023-12-19T16:17:53.045459+0000","last_peered":"2023-12-19T16:17:53.045459+0000","last_clean":"2023-12-19T16:17:53.045459+0000","last_became_active":"2023-12-19T16:17:52.070841+0000","last_became_peered":"2023-12-19T16:17:52.070841+0000","last_unstale":"2023-12-19T16:17:53.045459+0000","last_undegraded":"2023-12-19T16:17:53.045459+0000","last_fullsized":"2023-12-19T16:17:53.045459+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:23.457172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046508+0000","last_change":"2023-12-19T16:17:52.067725+0000","last_active":"2023-12-19T16:17:53.046508+0000","last_peered":"2023-12-19T16:17:53.046508+0000","last_clean":"2023-12-19T16:17:53.046508+0000","last_became_active":"2023-12-19T16:17:52.067448+0000","last_became_peered":"2023-12-19T16:17:52.067448+0000","last_unstale":"2023-12-19T16:17:53.046508+0000","last_undegraded":"2023-12-19T16:17:53.046508+0000","last_fullsized":"2023-12-19T16:17:53.046508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:45.659792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378205+0000","last_change":"2023-12-19T16:17:52.065409+0000","last_active":"2023-12-19T16:17:53.378205+0000","last_peered":"2023-12-19T16:17:53.378205+0000","last_clean":"2023-12-19T16:17:53.378205+0000","last_became_active":"2023-12-19T16:17:52.065020+0000","last_became_peered":"2023-12-19T16:17:52.065020+0000","last_unstale":"2023-12-19T16:17:53.378205+0000","last_undegraded":"2023-12-19T16:17:53.378205+0000","last_fullsized":"2023-12-19T16:17:53.378205+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:11:26.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192037+0000","last_change":"2023-12-19T16:17:52.068578+0000","last_active":"2023-12-19T16:17:53.192037+0000","last_peered":"2023-12-19T16:17:53.192037+0000","last_clean":"2023-12-19T16:17:53.192037+0000","last_became_active":"2023-12-19T16:17:52.068281+0000","last_became_peered":"2023-12-19T16:17:52.068281+0000","last_unstale":"2023-12-19T16:17:53.192037+0000","last_undegraded":"2023-12-19T16:17:53.192037+0000","last_fullsized":"2023-12-19T16:17:53.192037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:27:58.081684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192334+0000","last_change":"2023-12-19T16:17:52.052329+0000","last_active":"2023-12-19T16:17:53.192334+0000","last_peered":"2023-12-19T16:17:53.192334+0000","last_clean":"2023-12-19T16:17:53.192334+0000","last_became_active":"2023-12-19T16:17:52.052062+0000","last_became_peered":"2023-12-19T16:17:52.052062+0000","last_unstale":"2023-12-19T16:17:53.192334+0000","last_undegraded":"2023-12-19T16:17:53.192334+0000","last_fullsized":"2023-12-19T16:17:53.192334+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:28:45.532709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192420+0000","last_change":"2023-12-19T16:17:51.656696+0000","last_active":"2023-12-19T16:17:53.192420+0000","last_peered":"2023-12-19T16:17:53.192420+0000","last_clean":"2023-12-19T16:17:53.192420+0000","last_became_active":"2023-12-19T16:17:51.656419+0000","last_became_peered":"2023-12-19T16:17:51.656419+0000","last_unstale":"2023-12-19T16:17:53.192420+0000","last_undegraded":"2023-12-19T16:17:53.192420+0000","last_fullsized":"2023-12-19T16:17:53.192420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:19.455477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378743+0000","last_change":"2023-12-19T16:17:52.054974+0000","last_active":"2023-12-19T16:17:53.378743+0000","last_peered":"2023-12-19T16:17:53.378743+0000","last_clean":"2023-12-19T16:17:53.378743+0000","last_became_active":"2023-12-19T16:17:52.054694+0000","last_became_peered":"2023-12-19T16:17:52.054694+0000","last_unstale":"2023-12-19T16:17:53.378743+0000","last_undegraded":"2023-12-19T16:17:53.378743+0000","last_fullsized":"2023-12-19T16:17:53.378743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:54.372320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045648+0000","last_change":"2023-12-19T16:17:51.664092+0000","last_active":"2023-12-19T16:17:53.045648+0000","last_peered":"2023-12-19T16:17:53.045648+0000","last_clean":"2023-12-19T16:17:53.045648+0000","last_became_active":"2023-12-19T16:17:51.663801+0000","last_became_peered":"2023-12-19T16:17:51.663801+0000","last_unstale":"2023-12-19T16:17:53.045648+0000","last_undegraded":"2023-12-19T16:17:53.045648+0000","last_fullsized":"2023-12-19T16:17:53.045648+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:18.880699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192255+0000","last_change":"2023-12-19T16:17:52.054657+0000","last_active":"2023-12-19T16:17:53.192255+0000","last_peered":"2023-12-19T16:17:53.192255+0000","last_clean":"2023-12-19T16:17:53.192255+0000","last_became_active":"2023-12-19T16:17:52.054371+0000","last_became_peered":"2023-12-19T16:17:52.054371+0000","last_unstale":"2023-12-19T16:17:53.192255+0000","last_undegraded":"2023-12-19T16:17:53.192255+0000","last_fullsized":"2023-12-19T16:17:53.192255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:57:33.189565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192359+0000","last_change":"2023-12-19T16:17:51.656619+0000","last_active":"2023-12-19T16:17:53.192359+0000","last_peered":"2023-12-19T16:17:53.192359+0000","last_clean":"2023-12-19T16:17:53.192359+0000","last_became_active":"2023-12-19T16:17:51.656308+0000","last_became_peered":"2023-12-19T16:17:51.656308+0000","last_unstale":"2023-12-19T16:17:53.192359+0000","last_undegraded":"2023-12-19T16:17:53.192359+0000","last_fullsized":"2023-12-19T16:17:53.192359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:07.847321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192227+0000","last_change":"2023-12-19T16:17:52.061631+0000","last_active":"2023-12-19T16:17:53.192227+0000","last_peered":"2023-12-19T16:17:53.192227+0000","last_clean":"2023-12-19T16:17:53.192227+0000","last_became_active":"2023-12-19T16:17:52.061363+0000","last_became_peered":"2023-12-19T16:17:52.061363+0000","last_unstale":"2023-12-19T16:17:53.192227+0000","last_undegraded":"2023-12-19T16:17:53.192227+0000","last_fullsized":"2023-12-19T16:17:53.192227+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:01.082293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378883+0000","last_change":"2023-12-19T16:17:51.661097+0000","last_active":"2023-12-19T16:17:53.378883+0000","last_peered":"2023-12-19T16:17:53.378883+0000","last_clean":"2023-12-19T16:17:53.378883+0000","last_became_active":"2023-12-19T16:17:51.660783+0000","last_became_peered":"2023-12-19T16:17:51.660783+0000","last_unstale":"2023-12-19T16:17:53.378883+0000","last_undegraded":"2023-12-19T16:17:53.378883+0000","last_fullsized":"2023-12-19T16:17:53.378883+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:29.046336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045192+0000","last_change":"2023-12-19T16:17:52.063956+0000","last_active":"2023-12-19T16:17:53.045192+0000","last_peered":"2023-12-19T16:17:53.045192+0000","last_clean":"2023-12-19T16:17:53.045192+0000","last_became_active":"2023-12-19T16:17:52.063687+0000","last_became_peered":"2023-12-19T16:17:52.063687+0000","last_unstale":"2023-12-19T16:17:53.045192+0000","last_undegraded":"2023-12-19T16:17:53.045192+0000","last_fullsized":"2023-12-19T16:17:53.045192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:18:18.896617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047157+0000","last_change":"2023-12-19T16:17:51.658320+0000","last_active":"2023-12-19T16:17:53.047157+0000","last_peered":"2023-12-19T16:17:53.047157+0000","last_clean":"2023-12-19T16:17:53.047157+0000","last_became_active":"2023-12-19T16:17:51.657868+0000","last_became_peered":"2023-12-19T16:17:51.657868+0000","last_unstale":"2023-12-19T16:17:53.047157+0000","last_undegraded":"2023-12-19T16:17:53.047157+0000","last_fullsized":"2023-12-19T16:17:53.047157+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:07.847321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045370+0000","last_change":"2023-12-19T16:17:52.071088+0000","last_active":"2023-12-19T16:17:53.045370+0000","last_peered":"2023-12-19T16:17:53.045370+0000","last_clean":"2023-12-19T16:17:53.045370+0000","last_became_active":"2023-12-19T16:17:52.070502+0000","last_became_peered":"2023-12-19T16:17:52.070502+0000","last_unstale":"2023-12-19T16:17:53.045370+0000","last_undegraded":"2023-12-19T16:17:53.045370+0000","last_fullsized":"2023-12-19T16:17:53.045370+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:17.489021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192082+0000","last_change":"2023-12-19T16:17:51.660289+0000","last_active":"2023-12-19T16:17:53.192082+0000","last_peered":"2023-12-19T16:17:53.192082+0000","last_clean":"2023-12-19T16:17:53.192082+0000","last_became_active":"2023-12-19T16:17:51.660036+0000","last_became_peered":"2023-12-19T16:17:51.660036+0000","last_unstale":"2023-12-19T16:17:53.192082+0000","last_undegraded":"2023-12-19T16:17:53.192082+0000","last_fullsized":"2023-12-19T16:17:53.192082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.815309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046635+0000","last_change":"2023-12-19T16:17:52.061405+0000","last_active":"2023-12-19T16:17:53.046635+0000","last_peered":"2023-12-19T16:17:53.046635+0000","last_clean":"2023-12-19T16:17:53.046635+0000","last_became_active":"2023-12-19T16:17:52.061169+0000","last_became_peered":"2023-12-19T16:17:52.061169+0000","last_unstale":"2023-12-19T16:17:53.046635+0000","last_undegraded":"2023-12-19T16:17:53.046635+0000","last_fullsized":"2023-12-19T16:17:53.046635+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:18.270215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378757+0000","last_change":"2023-12-19T16:17:51.653152+0000","last_active":"2023-12-19T16:17:53.378757+0000","last_peered":"2023-12-19T16:17:53.378757+0000","last_clean":"2023-12-19T16:17:53.378757+0000","last_became_active":"2023-12-19T16:17:51.651778+0000","last_became_peered":"2023-12-19T16:17:51.651778+0000","last_unstale":"2023-12-19T16:17:53.378757+0000","last_undegraded":"2023-12-19T16:17:53.378757+0000","last_fullsized":"2023-12-19T16:17:53.378757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:53.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045148+0000","last_change":"2023-12-19T16:17:52.060380+0000","last_active":"2023-12-19T16:17:53.045148+0000","last_peered":"2023-12-19T16:17:53.045148+0000","last_clean":"2023-12-19T16:17:53.045148+0000","last_became_active":"2023-12-19T16:17:52.059908+0000","last_became_peered":"2023-12-19T16:17:52.059908+0000","last_unstale":"2023-12-19T16:17:53.045148+0000","last_undegraded":"2023-12-19T16:17:53.045148+0000","last_fullsized":"2023-12-19T16:17:53.045148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:21.420876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046622+0000","last_change":"2023-12-19T16:17:51.661349+0000","last_active":"2023-12-19T16:17:53.046622+0000","last_peered":"2023-12-19T16:17:53.046622+0000","last_clean":"2023-12-19T16:17:53.046622+0000","last_became_active":"2023-12-19T16:17:51.661044+0000","last_became_peered":"2023-12-19T16:17:51.661044+0000","last_unstale":"2023-12-19T16:17:53.046622+0000","last_undegraded":"2023-12-19T16:17:53.046622+0000","last_fullsized":"2023-12-19T16:17:53.046622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:19.455477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047981+0000","last_change":"2023-12-19T16:17:52.052259+0000","last_active":"2023-12-19T16:17:53.047981+0000","last_peered":"2023-12-19T16:17:53.047981+0000","last_clean":"2023-12-19T16:17:53.047981+0000","last_became_active":"2023-12-19T16:17:52.051905+0000","last_became_peered":"2023-12-19T16:17:52.051905+0000","last_unstale":"2023-12-19T16:17:53.047981+0000","last_undegraded":"2023-12-19T16:17:53.047981+0000","last_fullsized":"2023-12-19T16:17:53.047981+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:03:13.366961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047282+0000","last_change":"2023-12-19T16:17:51.669891+0000","last_active":"2023-12-19T16:17:53.047282+0000","last_peered":"2023-12-19T16:17:53.047282+0000","last_clean":"2023-12-19T16:17:53.047282+0000","last_became_active":"2023-12-19T16:17:51.669594+0000","last_became_peered":"2023-12-19T16:17:51.669594+0000","last_unstale":"2023-12-19T16:17:53.047282+0000","last_undegraded":"2023-12-19T16:17:53.047282+0000","last_fullsized":"2023-12-19T16:17:53.047282+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:24.434211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047247+0000","last_change":"2023-12-19T16:17:52.070575+0000","last_active":"2023-12-19T16:17:53.047247+0000","last_peered":"2023-12-19T16:17:53.047247+0000","last_clean":"2023-12-19T16:17:53.047247+0000","last_became_active":"2023-12-19T16:17:52.070261+0000","last_became_peered":"2023-12-19T16:17:52.070261+0000","last_unstale":"2023-12-19T16:17:53.047247+0000","last_undegraded":"2023-12-19T16:17:53.047247+0000","last_fullsized":"2023-12-19T16:17:53.047247+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:46.765277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045686+0000","last_change":"2023-12-19T16:17:51.665844+0000","last_active":"2023-12-19T16:17:53.045686+0000","last_peered":"2023-12-19T16:17:53.045686+0000","last_clean":"2023-12-19T16:17:53.045686+0000","last_became_active":"2023-12-19T16:17:51.665576+0000","last_became_peered":"2023-12-19T16:17:51.665576+0000","last_unstale":"2023-12-19T16:17:53.045686+0000","last_undegraded":"2023-12-19T16:17:53.045686+0000","last_fullsized":"2023-12-19T16:17:53.045686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:49.390890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378366+0000","last_change":"2023-12-19T16:17:52.055308+0000","last_active":"2023-12-19T16:17:53.378366+0000","last_peered":"2023-12-19T16:17:53.378366+0000","last_clean":"2023-12-19T16:17:53.378366+0000","last_became_active":"2023-12-19T16:17:52.055042+0000","last_became_peered":"2023-12-19T16:17:52.055042+0000","last_unstale":"2023-12-19T16:17:53.378366+0000","last_undegraded":"2023-12-19T16:17:53.378366+0000","last_fullsized":"2023-12-19T16:17:53.378366+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:07.594522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047461+0000","last_change":"2023-12-19T16:17:51.669775+0000","last_active":"2023-12-19T16:17:53.047461+0000","last_peered":"2023-12-19T16:17:53.047461+0000","last_clean":"2023-12-19T16:17:53.047461+0000","last_became_active":"2023-12-19T16:17:51.669477+0000","last_became_peered":"2023-12-19T16:17:51.669477+0000","last_unstale":"2023-12-19T16:17:53.047461+0000","last_undegraded":"2023-12-19T16:17:53.047461+0000","last_fullsized":"2023-12-19T16:17:53.047461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:51.466177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047281+0000","last_change":"2023-12-19T16:17:52.072334+0000","last_active":"2023-12-19T16:17:53.047281+0000","last_peered":"2023-12-19T16:17:53.047281+0000","last_clean":"2023-12-19T16:17:53.047281+0000","last_became_active":"2023-12-19T16:17:52.072056+0000","last_became_peered":"2023-12-19T16:17:52.072056+0000","last_unstale":"2023-12-19T16:17:53.047281+0000","last_undegraded":"2023-12-19T16:17:53.047281+0000","last_fullsized":"2023-12-19T16:17:53.047281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:38.183636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047862+0000","last_change":"2023-12-19T16:17:51.658398+0000","last_active":"2023-12-19T16:17:53.047862+0000","last_peered":"2023-12-19T16:17:53.047862+0000","last_clean":"2023-12-19T16:17:53.047862+0000","last_became_active":"2023-12-19T16:17:51.658089+0000","last_became_peered":"2023-12-19T16:17:51.658089+0000","last_unstale":"2023-12-19T16:17:53.047862+0000","last_undegraded":"2023-12-19T16:17:53.047862+0000","last_fullsized":"2023-12-19T16:17:53.047862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:16.761175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378507+0000","last_change":"2023-12-19T16:17:52.047300+0000","last_active":"2023-12-19T16:17:53.378507+0000","last_peered":"2023-12-19T16:17:53.378507+0000","last_clean":"2023-12-19T16:17:53.378507+0000","last_became_active":"2023-12-19T16:17:52.046842+0000","last_became_peered":"2023-12-19T16:17:52.046842+0000","last_unstale":"2023-12-19T16:17:53.378507+0000","last_undegraded":"2023-12-19T16:17:53.378507+0000","last_fullsized":"2023-12-19T16:17:53.378507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:36:01.082293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045381+0000","last_change":"2023-12-19T16:17:51.668536+0000","last_active":"2023-12-19T16:17:53.045381+0000","last_peered":"2023-12-19T16:17:53.045381+0000","last_clean":"2023-12-19T16:17:53.045381+0000","last_became_active":"2023-12-19T16:17:51.666732+0000","last_became_peered":"2023-12-19T16:17:51.666732+0000","last_unstale":"2023-12-19T16:17:53.045381+0000","last_undegraded":"2023-12-19T16:17:53.045381+0000","last_fullsized":"2023-12-19T16:17:53.045381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:56.116816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046732+0000","last_change":"2023-12-19T16:17:52.064394+0000","last_active":"2023-12-19T16:17:53.046732+0000","last_peered":"2023-12-19T16:17:53.046732+0000","last_clean":"2023-12-19T16:17:53.046732+0000","last_became_active":"2023-12-19T16:17:52.063918+0000","last_became_peered":"2023-12-19T16:17:52.063918+0000","last_unstale":"2023-12-19T16:17:53.046732+0000","last_undegraded":"2023-12-19T16:17:53.046732+0000","last_fullsized":"2023-12-19T16:17:53.046732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:17.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047060+0000","last_change":"2023-12-19T16:17:51.659308+0000","last_active":"2023-12-19T16:17:53.047060+0000","last_peered":"2023-12-19T16:17:53.047060+0000","last_clean":"2023-12-19T16:17:53.047060+0000","last_became_active":"2023-12-19T16:17:51.659013+0000","last_became_peered":"2023-12-19T16:17:51.659013+0000","last_unstale":"2023-12-19T16:17:53.047060+0000","last_undegraded":"2023-12-19T16:17:53.047060+0000","last_fullsized":"2023-12-19T16:17:53.047060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:15:48.681852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046541+0000","last_change":"2023-12-19T16:17:52.062577+0000","last_active":"2023-12-19T16:17:53.046541+0000","last_peered":"2023-12-19T16:17:53.046541+0000","last_clean":"2023-12-19T16:17:53.046541+0000","last_became_active":"2023-12-19T16:17:52.062314+0000","last_became_peered":"2023-12-19T16:17:52.062314+0000","last_unstale":"2023-12-19T16:17:53.046541+0000","last_undegraded":"2023-12-19T16:17:53.046541+0000","last_fullsized":"2023-12-19T16:17:53.046541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:34:30.935957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378747+0000","last_change":"2023-12-19T16:17:51.660917+0000","last_active":"2023-12-19T16:17:53.378747+0000","last_peered":"2023-12-19T16:17:53.378747+0000","last_clean":"2023-12-19T16:17:53.378747+0000","last_became_active":"2023-12-19T16:17:51.660605+0000","last_became_peered":"2023-12-19T16:17:51.660605+0000","last_unstale":"2023-12-19T16:17:53.378747+0000","last_undegraded":"2023-12-19T16:17:53.378747+0000","last_fullsized":"2023-12-19T16:17:53.378747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:22.815309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047482+0000","last_change":"2023-12-19T16:17:52.069115+0000","last_active":"2023-12-19T16:17:53.047482+0000","last_peered":"2023-12-19T16:17:53.047482+0000","last_clean":"2023-12-19T16:17:53.047482+0000","last_became_active":"2023-12-19T16:17:52.068808+0000","last_became_peered":"2023-12-19T16:17:52.068808+0000","last_unstale":"2023-12-19T16:17:53.047482+0000","last_undegraded":"2023-12-19T16:17:53.047482+0000","last_fullsized":"2023-12-19T16:17:53.047482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:30.053855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046854+0000","last_change":"2023-12-19T16:17:51.666148+0000","last_active":"2023-12-19T16:17:53.046854+0000","last_peered":"2023-12-19T16:17:53.046854+0000","last_clean":"2023-12-19T16:17:53.046854+0000","last_became_active":"2023-12-19T16:17:51.665681+0000","last_became_peered":"2023-12-19T16:17:51.665681+0000","last_unstale":"2023-12-19T16:17:53.046854+0000","last_undegraded":"2023-12-19T16:17:53.046854+0000","last_fullsized":"2023-12-19T16:17:53.046854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:55.198147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047073+0000","last_change":"2023-12-19T16:17:52.067104+0000","last_active":"2023-12-19T16:17:53.047073+0000","last_peered":"2023-12-19T16:17:53.047073+0000","last_clean":"2023-12-19T16:17:53.047073+0000","last_became_active":"2023-12-19T16:17:52.066744+0000","last_became_peered":"2023-12-19T16:17:52.066744+0000","last_unstale":"2023-12-19T16:17:53.047073+0000","last_undegraded":"2023-12-19T16:17:53.047073+0000","last_fullsized":"2023-12-19T16:17:53.047073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:17.768693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045776+0000","last_change":"2023-12-19T16:17:51.665947+0000","last_active":"2023-12-19T16:17:53.045776+0000","last_peered":"2023-12-19T16:17:53.045776+0000","last_clean":"2023-12-19T16:17:53.045776+0000","last_became_active":"2023-12-19T16:17:51.664502+0000","last_became_peered":"2023-12-19T16:17:51.664502+0000","last_unstale":"2023-12-19T16:17:53.045776+0000","last_undegraded":"2023-12-19T16:17:53.045776+0000","last_fullsized":"2023-12-19T16:17:53.045776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:57:32.182046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378909+0000","last_change":"2023-12-19T16:17:52.056789+0000","last_active":"2023-12-19T16:17:53.378909+0000","last_peered":"2023-12-19T16:17:53.378909+0000","last_clean":"2023-12-19T16:17:53.378909+0000","last_became_active":"2023-12-19T16:17:52.056587+0000","last_became_peered":"2023-12-19T16:17:52.056587+0000","last_unstale":"2023-12-19T16:17:53.378909+0000","last_undegraded":"2023-12-19T16:17:53.378909+0000","last_fullsized":"2023-12-19T16:17:53.378909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:55.198227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192358+0000","last_change":"2023-12-19T16:17:51.659202+0000","last_active":"2023-12-19T16:17:53.192358+0000","last_peered":"2023-12-19T16:17:53.192358+0000","last_clean":"2023-12-19T16:17:53.192358+0000","last_became_active":"2023-12-19T16:17:51.658909+0000","last_became_peered":"2023-12-19T16:17:51.658909+0000","last_unstale":"2023-12-19T16:17:53.192358+0000","last_undegraded":"2023-12-19T16:17:53.192358+0000","last_fullsized":"2023-12-19T16:17:53.192358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:06.587003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045336+0000","last_change":"2023-12-19T16:17:52.072080+0000","last_active":"2023-12-19T16:17:53.045336+0000","last_peered":"2023-12-19T16:17:53.045336+0000","last_clean":"2023-12-19T16:17:53.045336+0000","last_became_active":"2023-12-19T16:17:52.071719+0000","last_became_peered":"2023-12-19T16:17:52.071719+0000","last_unstale":"2023-12-19T16:17:53.045336+0000","last_undegraded":"2023-12-19T16:17:53.045336+0000","last_fullsized":"2023-12-19T16:17:53.045336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:23.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378865+0000","last_change":"2023-12-19T16:17:51.663881+0000","last_active":"2023-12-19T16:17:53.378865+0000","last_peered":"2023-12-19T16:17:53.378865+0000","last_clean":"2023-12-19T16:17:53.378865+0000","last_became_active":"2023-12-19T16:17:51.661537+0000","last_became_peered":"2023-12-19T16:17:51.661537+0000","last_unstale":"2023-12-19T16:17:53.378865+0000","last_undegraded":"2023-12-19T16:17:53.378865+0000","last_fullsized":"2023-12-19T16:17:53.378865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:37.176117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047325+0000","last_change":"2023-12-19T16:17:52.072263+0000","last_active":"2023-12-19T16:17:53.047325+0000","last_peered":"2023-12-19T16:17:53.047325+0000","last_clean":"2023-12-19T16:17:53.047325+0000","last_became_active":"2023-12-19T16:17:52.071995+0000","last_became_peered":"2023-12-19T16:17:52.071995+0000","last_unstale":"2023-12-19T16:17:53.047325+0000","last_undegraded":"2023-12-19T16:17:53.047325+0000","last_fullsized":"2023-12-19T16:17:53.047325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:07.383761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192219+0000","last_change":"2023-12-19T16:17:51.663046+0000","last_active":"2023-12-19T16:17:53.192219+0000","last_peered":"2023-12-19T16:17:53.192219+0000","last_clean":"2023-12-19T16:17:53.192219+0000","last_became_active":"2023-12-19T16:17:51.662731+0000","last_became_peered":"2023-12-19T16:17:51.662731+0000","last_unstale":"2023-12-19T16:17:53.192219+0000","last_undegraded":"2023-12-19T16:17:53.192219+0000","last_fullsized":"2023-12-19T16:17:53.192219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:53.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378923+0000","last_change":"2023-12-19T16:17:52.047124+0000","last_active":"2023-12-19T16:17:53.378923+0000","last_peered":"2023-12-19T16:17:53.378923+0000","last_clean":"2023-12-19T16:17:53.378923+0000","last_became_active":"2023-12-19T16:17:52.046502+0000","last_became_peered":"2023-12-19T16:17:52.046502+0000","last_unstale":"2023-12-19T16:17:53.378923+0000","last_undegraded":"2023-12-19T16:17:53.378923+0000","last_fullsized":"2023-12-19T16:17:53.378923+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:20:08.036072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045434+0000","last_change":"2023-12-19T16:17:51.662036+0000","last_active":"2023-12-19T16:17:53.045434+0000","last_peered":"2023-12-19T16:17:53.045434+0000","last_clean":"2023-12-19T16:17:53.045434+0000","last_became_active":"2023-12-19T16:17:51.661730+0000","last_became_peered":"2023-12-19T16:17:51.661730+0000","last_unstale":"2023-12-19T16:17:53.045434+0000","last_undegraded":"2023-12-19T16:17:53.045434+0000","last_fullsized":"2023-12-19T16:17:53.045434+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:19.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192134+0000","last_change":"2023-12-19T16:17:52.065189+0000","last_active":"2023-12-19T16:17:53.192134+0000","last_peered":"2023-12-19T16:17:53.192134+0000","last_clean":"2023-12-19T16:17:53.192134+0000","last_became_active":"2023-12-19T16:17:52.064521+0000","last_became_peered":"2023-12-19T16:17:52.064521+0000","last_unstale":"2023-12-19T16:17:53.192134+0000","last_undegraded":"2023-12-19T16:17:53.192134+0000","last_fullsized":"2023-12-19T16:17:53.192134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:50.398409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378278+0000","last_change":"2023-12-19T16:17:51.659564+0000","last_active":"2023-12-19T16:17:53.378278+0000","last_peered":"2023-12-19T16:17:53.378278+0000","last_clean":"2023-12-19T16:17:53.378278+0000","last_became_active":"2023-12-19T16:17:51.659300+0000","last_became_peered":"2023-12-19T16:17:51.659300+0000","last_unstale":"2023-12-19T16:17:53.378278+0000","last_undegraded":"2023-12-19T16:17:53.378278+0000","last_fullsized":"2023-12-19T16:17:53.378278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:55:15.776930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.191974+0000","last_change":"2023-12-19T16:17:52.060284+0000","last_active":"2023-12-19T16:17:53.191974+0000","last_peered":"2023-12-19T16:17:53.191974+0000","last_clean":"2023-12-19T16:17:53.191974+0000","last_became_active":"2023-12-19T16:17:52.060030+0000","last_became_peered":"2023-12-19T16:17:52.060030+0000","last_unstale":"2023-12-19T16:17:53.191974+0000","last_undegraded":"2023-12-19T16:17:53.191974+0000","last_fullsized":"2023-12-19T16:17:53.191974+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:20:57.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378608+0000","last_change":"2023-12-19T16:17:51.668993+0000","last_active":"2023-12-19T16:17:53.378608+0000","last_peered":"2023-12-19T16:17:53.378608+0000","last_clean":"2023-12-19T16:17:53.378608+0000","last_became_active":"2023-12-19T16:17:51.668675+0000","last_became_peered":"2023-12-19T16:17:51.668675+0000","last_unstale":"2023-12-19T16:17:53.378608+0000","last_undegraded":"2023-12-19T16:17:53.378608+0000","last_fullsized":"2023-12-19T16:17:53.378608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:06.376242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378763+0000","last_change":"2023-12-19T16:17:52.055160+0000","last_active":"2023-12-19T16:17:53.378763+0000","last_peered":"2023-12-19T16:17:53.378763+0000","last_clean":"2023-12-19T16:17:53.378763+0000","last_became_active":"2023-12-19T16:17:52.054059+0000","last_became_peered":"2023-12-19T16:17:52.054059+0000","last_unstale":"2023-12-19T16:17:53.378763+0000","last_undegraded":"2023-12-19T16:17:53.378763+0000","last_fullsized":"2023-12-19T16:17:53.378763+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:57:33.189565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378628+0000","last_change":"2023-12-19T16:17:51.660678+0000","last_active":"2023-12-19T16:17:53.378628+0000","last_peered":"2023-12-19T16:17:53.378628+0000","last_clean":"2023-12-19T16:17:53.378628+0000","last_became_active":"2023-12-19T16:17:51.660413+0000","last_became_peered":"2023-12-19T16:17:51.660413+0000","last_unstale":"2023-12-19T16:17:53.378628+0000","last_undegraded":"2023-12-19T16:17:53.378628+0000","last_fullsized":"2023-12-19T16:17:53.378628+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:05:17.262696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378956+0000","last_change":"2023-12-19T16:17:52.057271+0000","last_active":"2023-12-19T16:17:53.378956+0000","last_peered":"2023-12-19T16:17:53.378956+0000","last_clean":"2023-12-19T16:17:53.378956+0000","last_became_active":"2023-12-19T16:17:52.056160+0000","last_became_peered":"2023-12-19T16:17:52.056160+0000","last_unstale":"2023-12-19T16:17:53.378956+0000","last_undegraded":"2023-12-19T16:17:53.378956+0000","last_fullsized":"2023-12-19T16:17:53.378956+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:20.634013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192401+0000","last_change":"2023-12-19T16:17:51.661013+0000","last_active":"2023-12-19T16:17:53.192401+0000","last_peered":"2023-12-19T16:17:53.192401+0000","last_clean":"2023-12-19T16:17:53.192401+0000","last_became_active":"2023-12-19T16:17:51.660738+0000","last_became_peered":"2023-12-19T16:17:51.660738+0000","last_unstale":"2023-12-19T16:17:53.192401+0000","last_undegraded":"2023-12-19T16:17:53.192401+0000","last_fullsized":"2023-12-19T16:17:53.192401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:29.046336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378423+0000","last_change":"2023-12-19T16:17:52.055024+0000","last_active":"2023-12-19T16:17:53.378423+0000","last_peered":"2023-12-19T16:17:53.378423+0000","last_clean":"2023-12-19T16:17:53.378423+0000","last_became_active":"2023-12-19T16:17:52.054676+0000","last_became_peered":"2023-12-19T16:17:52.054676+0000","last_unstale":"2023-12-19T16:17:53.378423+0000","last_undegraded":"2023-12-19T16:17:53.378423+0000","last_fullsized":"2023-12-19T16:17:53.378423+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:49:17.768693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.047369+0000","last_change":"2023-12-19T16:17:51.659627+0000","last_active":"2023-12-19T16:17:53.047369+0000","last_peered":"2023-12-19T16:17:53.047369+0000","last_clean":"2023-12-19T16:17:53.047369+0000","last_became_active":"2023-12-19T16:17:51.659343+0000","last_became_peered":"2023-12-19T16:17:51.659343+0000","last_unstale":"2023-12-19T16:17:53.047369+0000","last_undegraded":"2023-12-19T16:17:53.047369+0000","last_fullsized":"2023-12-19T16:17:53.047369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:51.466177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.192331+0000","last_change":"2023-12-19T16:17:52.061618+0000","last_active":"2023-12-19T16:17:53.192331+0000","last_peered":"2023-12-19T16:17:53.192331+0000","last_clean":"2023-12-19T16:17:53.192331+0000","last_became_active":"2023-12-19T16:17:52.061243+0000","last_became_peered":"2023-12-19T16:17:52.061243+0000","last_unstale":"2023-12-19T16:17:53.192331+0000","last_undegraded":"2023-12-19T16:17:53.192331+0000","last_fullsized":"2023-12-19T16:17:53.192331+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:20:08.036072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378964+0000","last_change":"2023-12-19T16:17:51.650662+0000","last_active":"2023-12-19T16:17:53.378964+0000","last_peered":"2023-12-19T16:17:53.378964+0000","last_clean":"2023-12-19T16:17:53.378964+0000","last_became_active":"2023-12-19T16:17:51.650361+0000","last_became_peered":"2023-12-19T16:17:51.650361+0000","last_unstale":"2023-12-19T16:17:53.378964+0000","last_undegraded":"2023-12-19T16:17:53.378964+0000","last_fullsized":"2023-12-19T16:17:53.378964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:07.847321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045226+0000","last_change":"2023-12-19T16:17:52.067764+0000","last_active":"2023-12-19T16:17:53.045226+0000","last_peered":"2023-12-19T16:17:53.045226+0000","last_clean":"2023-12-19T16:17:53.045226+0000","last_became_active":"2023-12-19T16:17:52.067516+0000","last_became_peered":"2023-12-19T16:17:52.067516+0000","last_unstale":"2023-12-19T16:17:53.045226+0000","last_undegraded":"2023-12-19T16:17:53.045226+0000","last_fullsized":"2023-12-19T16:17:53.045226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:24:24.002692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378293+0000","last_change":"2023-12-19T16:17:51.649394+0000","last_active":"2023-12-19T16:17:53.378293+0000","last_peered":"2023-12-19T16:17:53.378293+0000","last_clean":"2023-12-19T16:17:53.378293+0000","last_became_active":"2023-12-19T16:17:51.649111+0000","last_became_peered":"2023-12-19T16:17:51.649111+0000","last_unstale":"2023-12-19T16:17:53.378293+0000","last_undegraded":"2023-12-19T16:17:53.378293+0000","last_fullsized":"2023-12-19T16:17:53.378293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:17:11.481775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046839+0000","last_change":"2023-12-19T16:17:52.076173+0000","last_active":"2023-12-19T16:17:53.046839+0000","last_peered":"2023-12-19T16:17:53.046839+0000","last_clean":"2023-12-19T16:17:53.046839+0000","last_became_active":"2023-12-19T16:17:52.075865+0000","last_became_peered":"2023-12-19T16:17:52.075865+0000","last_unstale":"2023-12-19T16:17:53.046839+0000","last_undegraded":"2023-12-19T16:17:53.046839+0000","last_fullsized":"2023-12-19T16:17:53.046839+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:54.372320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046863+0000","last_change":"2023-12-19T16:17:51.658185+0000","last_active":"2023-12-19T16:17:53.046863+0000","last_peered":"2023-12-19T16:17:53.046863+0000","last_clean":"2023-12-19T16:17:53.046863+0000","last_became_active":"2023-12-19T16:17:51.657843+0000","last_became_peered":"2023-12-19T16:17:51.657843+0000","last_unstale":"2023-12-19T16:17:53.046863+0000","last_undegraded":"2023-12-19T16:17:53.046863+0000","last_fullsized":"2023-12-19T16:17:53.046863+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:30:06.587003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378064+0000","last_change":"2023-12-19T16:17:52.049845+0000","last_active":"2023-12-19T16:17:53.378064+0000","last_peered":"2023-12-19T16:17:53.378064+0000","last_clean":"2023-12-19T16:17:53.378064+0000","last_became_active":"2023-12-19T16:17:52.049574+0000","last_became_peered":"2023-12-19T16:17:52.049574+0000","last_unstale":"2023-12-19T16:17:53.378064+0000","last_undegraded":"2023-12-19T16:17:53.378064+0000","last_fullsized":"2023-12-19T16:17:53.378064+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:30.053855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.378140+0000","last_change":"2023-12-19T16:17:51.660572+0000","last_active":"2023-12-19T16:17:53.378140+0000","last_peered":"2023-12-19T16:17:53.378140+0000","last_clean":"2023-12-19T16:17:53.378140+0000","last_became_active":"2023-12-19T16:17:51.660298+0000","last_became_peered":"2023-12-19T16:17:51.660298+0000","last_unstale":"2023-12-19T16:17:53.378140+0000","last_undegraded":"2023-12-19T16:17:53.378140+0000","last_fullsized":"2023-12-19T16:17:53.378140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:15.093683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045270+0000","last_change":"2023-12-19T16:17:52.060154+0000","last_active":"2023-12-19T16:17:53.045270+0000","last_peered":"2023-12-19T16:17:53.045270+0000","last_clean":"2023-12-19T16:17:53.045270+0000","last_became_active":"2023-12-19T16:17:52.059596+0000","last_became_peered":"2023-12-19T16:17:52.059596+0000","last_unstale":"2023-12-19T16:17:53.045270+0000","last_undegraded":"2023-12-19T16:17:53.045270+0000","last_fullsized":"2023-12-19T16:17:53.045270+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:02.194566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045213+0000","last_change":"2023-12-19T16:17:51.664178+0000","last_active":"2023-12-19T16:17:53.045213+0000","last_peered":"2023-12-19T16:17:53.045213+0000","last_clean":"2023-12-19T16:17:53.045213+0000","last_became_active":"2023-12-19T16:17:51.663896+0000","last_became_peered":"2023-12-19T16:17:51.663896+0000","last_unstale":"2023-12-19T16:17:53.045213+0000","last_undegraded":"2023-12-19T16:17:53.045213+0000","last_fullsized":"2023-12-19T16:17:53.045213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:54.190708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.045073+0000","last_change":"2023-12-19T16:17:52.064058+0000","last_active":"2023-12-19T16:17:53.045073+0000","last_peered":"2023-12-19T16:17:53.045073+0000","last_clean":"2023-12-19T16:17:53.045073+0000","last_became_active":"2023-12-19T16:17:52.063859+0000","last_became_peered":"2023-12-19T16:17:52.063859+0000","last_unstale":"2023-12-19T16:17:53.045073+0000","last_undegraded":"2023-12-19T16:17:53.045073+0000","last_fullsized":"2023-12-19T16:17:53.045073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:51.630956+0000","last_clean_scrub_stamp":"2023-12-19T16:17:51.630956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:58.627316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-19T16:17:53.046349+0000","last_change":"2023-12-19T16:17:51.660326+0000","last_active":"2023-12-19T16:17:53.046349+0000","last_peered":"2023-12-19T16:17:53.046349+0000","last_clean":"2023-12-19T16:17:53.046349+0000","last_became_active":"2023-12-19T16:17:51.660071+0000","last_became_peered":"2023-12-19T16:17:51.660071+0000","last_unstale":"2023-12-19T16:17:53.046349+0000","last_undegraded":"2023-12-19T16:17:53.046349+0000","last_fullsized":"2023-12-19T16:17:53.046349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:50.623438+0000","last_clean_scrub_stamp":"2023-12-19T16:17:50.623438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:50:55.198147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T16:17:52.046262+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:17:52.046262+0000","last_peered":"2023-12-19T16:17:52.046262+0000","last_clean":"2023-12-19T16:17:52.046262+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:17:52.046262+0000","last_undegraded":"2023-12-19T16:17:52.046262+0000","last_fullsized":"2023-12-19T16:17:52.046262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1261568,"data_stored":885609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64900000000000002,"15min":0.64800000000000002},"min":{"1min":0.48499999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.622}]},{"osd":1,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88200000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.877}]},{"osd":3,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.82499999999999996,"5min":1.006,"15min":1.006},"last":0.753},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.91700000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.028,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91100000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83799999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82399999999999995,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.98199999999999998,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.754,"15min":0.77500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.006,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.874,"5min":1,"15min":1},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70299999999999996},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.92600000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.747},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89000000000000001,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.58199999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0309999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.94799999999999995,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":655360,"data_stored":289113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82399999999999995,"5min":1.125,"15min":1.125},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.79000000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.51400000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83499999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.85799999999999998,"5min":1.641,"15min":1.641},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.78800000000000003,"15min":0.81799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83599999999999997,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.88600000000000001,"15min":0.94199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84399999999999997,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.872,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.80300000000000005,"5min":1.135,"15min":1.135},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89100000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91500000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90300000000000002,"5min":1.74,"15min":1.74},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":671744,"data_stored":296645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83999999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.315},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.115,"15min":1.115},"last":0.29499999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95999999999999996,"5min":0.997,"15min":0.997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97799999999999998,"5min":1.179,"15min":1.179},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.44},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.50700000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92900000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91800000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68500000000000005},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86099999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.002},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.29399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55800000000000005,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.91300000000000003,"15min":0.99299999999999999},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.626,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.35299999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.54700000000000004,"15min":0.57299999999999995},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.53800000000000003,"5min":2.577,"15min":2.577},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.89600000000000002,"15min":0.96399999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68300000000000005,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.47499999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.97799999999999998,"15min":1.0569999999999999},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.432},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68600000000000005,"5min":2.907,"15min":2.907},"last":0.502}]},{"osd":4,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0249999999999999,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94799999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.754},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.99099999999999999,"15min":1.0369999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.052,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.92900000000000005,"15min":0.95099999999999996},"min":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0820000000000001,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1,"5min":1.708,"15min":1.708},"last":0.76600000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.998,"15min":1.042},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.99299999999999999,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.85899999999999999,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96599999999999997,"5min":2.742,"15min":2.742},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":655360,"data_stored":288517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.52100000000000002,"15min":0.54100000000000004},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59399999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54600000000000004,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.59499999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.5,"5min":1.962,"15min":1.962},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.56200000000000006,"5min":1.974,"15min":1.974},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.51700000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93100000000000005,"5min":1.877,"15min":1.877},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.85199999999999998,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83299999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.83599999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.655,"15min":1.655},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.83899999999999997,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.82499999999999996,"15min":0.85099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94899999999999995,"5min":2.032,"15min":2.032},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.747}]},{"osd":7,"last update":"Tue Dec 19 16:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.91000000000000003,"15min":0.94799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97799999999999998,"5min":2.706,"15min":2.706},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.89600000000000002,"15min":0.93200000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.86899999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":288551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.52800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.501}]},{"osd":2,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.53600000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.59599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.38100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.57699999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.872,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85899999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93300000000000005,"5min":1.054,"15min":1.054},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96399999999999997,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97799999999999998,"5min":1.502,"15min":1.502},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94899999999999995,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91600000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1257472,"data_stored":880975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.44800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58999999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.502},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.626}]},{"osd":3,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.499,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.57899999999999996,"5min":1.46,"15min":1.46},"last":0.69199999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84399999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.014,"5min":1.093,"15min":1.093},"last":0.82799999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.746},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.077,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.93500000000000005,"5min":1.506,"15min":1.506},"last":0.755},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89400000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.84199999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97599999999999998,"5min":1.133,"15min":1.133},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.05,"5min":1.083,"15min":1.083},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:56.493 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:17:56.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T16:17:56.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 Processor -- start 2023-12-19T16:17:56.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 -- start start 2023-12-19T16:17:56.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97c40ad290 0x7f97c40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40cdca0 0x7f97c40afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f97c40b0410 0x7f97c41609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40adcc0 con 0x7f97c40ad290 2023-12-19T16:17:56.676 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40b0870 con 0x7f97c40b0410 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97cb82d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40ccd60 con 0x7f97c40cdca0 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97c40ad290 0x7f97c40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97c40ad290 0x7f97c40cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56416/0 (socket says 172.21.15.119:56416) 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 -- 172.21.15.119:0/2524843229 learned_addr learned my addr 172.21.15.119:0/2524843229 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c9dca640 1 --2- 172.21.15.119:0/2524843229 >> v2:172.21.15.143:3300/0 conn(0x7f97c40b0410 0x7f97c41609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c8dc8640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40cdca0 0x7f97c40afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 -- 172.21.15.119:0/2524843229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40cdca0 msgr2=0x7f97c40afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40cdca0 0x7f97c40afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 -- 172.21.15.119:0/2524843229 >> v2:172.21.15.143:3300/0 conn(0x7f97c40b0410 msgr2=0x7f97c41609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 --2- 172.21.15.119:0/2524843229 >> v2:172.21.15.143:3300/0 conn(0x7f97c40b0410 0x7f97c41609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c95c9640 1 -- 172.21.15.119:0/2524843229 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c415d580 con 0x7f97c40ad290 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c8dc8640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40cdca0 0x7f97c40afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:56.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.671+0000 7f97c9dca640 1 --2- 172.21.15.119:0/2524843229 >> v2:172.21.15.143:3300/0 conn(0x7f97c40b0410 0x7f97c41609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:56.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97c95c9640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40ad290 0x7f97c40cc820 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f97c40c8910 tx=0x7f97c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a302ff55a7a32b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:56.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97bbfff640 1 -- 172.21.15.119:0/2524843229 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c00ac620 con 0x7f97c40ad290 2023-12-19T16:17:56.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97bbfff640 1 -- 172.21.15.119:0/2524843229 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c00ac780 con 0x7f97c40ad290 2023-12-19T16:17:56.679 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97bbfff640 1 -- 172.21.15.119:0/2524843229 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c00acb10 con 0x7f97c40ad290 2023-12-19T16:17:56.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 -- 172.21.15.119:0/2524843229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40ad290 msgr2=0x7f97c40cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40ad290 0x7f97c40cc820 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f97c40c8910 tx=0x7f97c001c400 comp rx=0 tx=0).stop 2023-12-19T16:17:56.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 -- 172.21.15.119:0/2524843229 shutdown_connections 2023-12-19T16:17:56.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 --2- 172.21.15.119:0/2524843229 >> v2:172.21.15.143:3300/0 conn(0x7f97c40b0410 0x7f97c41609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40cdca0 0x7f97c40afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 --2- 172.21.15.119:0/2524843229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40ad290 0x7f97c40cc820 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 -- 172.21.15.119:0/2524843229 >> 172.21.15.119:0/2524843229 conn(0x7f97c40ce450 msgr2=0x7f97c40ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 -- 172.21.15.119:0/2524843229 shutdown_connections 2023-12-19T16:17:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.675+0000 7f97cb82d640 1 -- 172.21.15.119:0/2524843229 wait complete. 2023-12-19T16:17:56.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 Processor -- start 2023-12-19T16:17:56.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 -- start start 2023-12-19T16:17:56.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c40ad290 0x7f97c415cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40b0410 0x7f97c41522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 0x7f97c4151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b1a10 con 0x7f97c40cdca0 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4157d50 con 0x7f97c40ad290 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b1cb0 con 0x7f97c40b0410 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 0x7f97c4151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 0x7f97c4151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56418/0 (socket says 172.21.15.119:56418) 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 -- 172.21.15.119:0/443269042 learned_addr learned my addr 172.21.15.119:0/443269042 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c95c9640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c40ad290 0x7f97c415cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.684 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c8dc8640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40b0410 0x7f97c41522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 -- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40b0410 msgr2=0x7f97c41522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40b0410 0x7f97c41522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 -- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c40ad290 msgr2=0x7f97c415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c40ad290 0x7f97c415cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 -- 172.21.15.119:0/443269042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00094d0 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97c9dca640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 0x7f97c4151a90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007db0 tx=0x7f97bc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0039a0 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc00f040 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc003d60 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c40b1f90 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.679+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c4151fd0 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.683+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c4066e70 con 0x7f97c40cdca0 2023-12-19T16:17:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.683+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f97bc004030 con 0x7f97c40cdca0 2023-12-19T16:17:56.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.683+0000 7f97b9ffb640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a8065a60 0x7f97a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:56.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.683+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f97bc083550 con 0x7f97c40cdca0 2023-12-19T16:17:56.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.683+0000 7f97c95c9640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a8065a60 0x7f97a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:56.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.683+0000 7f97c95c9640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a8065a60 0x7f97a8067f20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f97c00ae000 tx=0x7f97c00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:56.692 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.687+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f97bc050de0 con 0x7f97c40cdca0 2023-12-19T16:17:56.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.891+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f97c404e000 con 0x7f97c40cdca0 2023-12-19T16:17:56.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97b9ffb640 1 -- 172.21.15.119:0/443269042 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f97bc054400 con 0x7f97c40cdca0 2023-12-19T16:17:56.899 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:17:56.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a8065a60 msgr2=0x7f97a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a8065a60 0x7f97a8067f20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f97c00ae000 tx=0x7f97c00a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 msgr2=0x7f97c4151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 0x7f97c4151a90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007db0 tx=0x7f97bc00d4a0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 shutdown_connections 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f97a8065a60 0x7f97a8067f20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97c40cdca0 0x7f97c4151a90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97c40b0410 0x7f97c41522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.895+0000 7f97cb82d640 1 --2- 172.21.15.119:0/443269042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97c40ad290 0x7f97c415cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.899+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 >> 172.21.15.119:0/443269042 conn(0x7f97c40ce450 msgr2=0x7f97c40cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.899+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 shutdown_connections 2023-12-19T16:17:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:56.899+0000 7f97cb82d640 1 -- 172.21.15.119:0/443269042 wait complete. 2023-12-19T16:17:56.921 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:57.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.055+0000 7f953956d640 1 Processor -- start 2023-12-19T16:17:57.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.055+0000 7f953956d640 1 -- start start 2023-12-19T16:17:57.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.055+0000 7f953956d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9534157080 0x7f95340ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.055+0000 7f953956d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340d1320 con 0x7f95340cd730 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.055+0000 7f953956d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340cc970 con 0x7f95340d0cc0 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.055+0000 7f953956d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340d1130 con 0x7f9534157080 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f952bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f95340cd730 0x7f95340d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53498/0 (socket says 172.21.15.119:53498) 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f952bfff640 1 -- 172.21.15.119:0/2570455806 learned_addr learned my addr 172.21.15.119:0/2570455806 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f9532ffd640 1 --2- 172.21.15.119:0/2570455806 >> v2:172.21.15.143:3300/0 conn(0x7f9534157080 0x7f95340ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.063 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f95327fc640 1 -- 172.21.15.119:0/2570455806 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185366330 0 0) 0x7f95340d1320 con 0x7f95340cd730 2023-12-19T16:17:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f95327fc640 1 -- 172.21.15.119:0/2570455806 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9520003530 con 0x7f95340cd730 2023-12-19T16:17:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f9532ffd640 1 -- 172.21.15.119:0/2570455806 >> v1:172.21.15.143:6789/0 conn(0x7f95340d0cc0 legacy=0x7f95340cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f95327fc640 1 -- 172.21.15.119:0/2570455806 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042192628 0 0) 0x7f9520003530 con 0x7f95340cd730 2023-12-19T16:17:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f9532ffd640 1 -- 172.21.15.119:0/2570455806 >> v1:172.21.15.119:6789/0 conn(0x7f95340cd730 legacy=0x7f95340d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f9532ffd640 1 -- 172.21.15.119:0/2570455806 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340ccc50 con 0x7f9534157080 2023-12-19T16:17:57.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.059+0000 7f9532ffd640 1 --2- 172.21.15.119:0/2570455806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9534157080 0x7f95340ce210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95240097f0 tx=0x7f952401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaec07dab042d7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f95327fc640 1 -- 172.21.15.119:0/2570455806 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c001680 con 0x7f9534157080 2023-12-19T16:17:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f95327fc640 1 -- 172.21.15.119:0/2570455806 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95240a7050 con 0x7f9534157080 2023-12-19T16:17:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f95327fc640 1 -- 172.21.15.119:0/2570455806 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95240ab600 con 0x7f9534157080 2023-12-19T16:17:57.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 -- 172.21.15.119:0/2570455806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9534157080 msgr2=0x7f95340ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 --2- 172.21.15.119:0/2570455806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9534157080 0x7f95340ce210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95240097f0 tx=0x7f952401c3a0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 -- 172.21.15.119:0/2570455806 shutdown_connections 2023-12-19T16:17:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 --2- 172.21.15.119:0/2570455806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9534157080 0x7f95340ce210 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 -- 172.21.15.119:0/2570455806 >> 172.21.15.119:0/2570455806 conn(0x7f9534069ca0 msgr2=0x7f953406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 -- 172.21.15.119:0/2570455806 shutdown_connections 2023-12-19T16:17:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 -- 172.21.15.119:0/2570455806 wait complete. 2023-12-19T16:17:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 Processor -- start 2023-12-19T16:17:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.063+0000 7f953956d640 1 -- start start 2023-12-19T16:17:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95340cd730 0x7f9534151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 0x7f953414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9534157080 0x7f95340c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95340ca020 con 0x7f95340d0cc0 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953414fa10 con 0x7f95340cd730 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9534161360 con 0x7f9534157080 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 0x7f953414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 0x7f953414ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56434/0 (socket says 172.21.15.119:56434) 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 -- 172.21.15.119:0/4130298522 learned_addr learned my addr 172.21.15.119:0/4130298522 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f95337fe640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9534157080 0x7f95340c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f9532ffd640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95340cd730 0x7f9534151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 -- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9534157080 msgr2=0x7f95340c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9534157080 0x7f95340c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 -- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95340cd730 msgr2=0x7f9534151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95340cd730 0x7f9534151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 -- 172.21.15.119:0/4130298522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524009420 con 0x7f95340d0cc0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952bfff640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 0x7f953414ecd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c730 tx=0x7f951c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c005ae0 con 0x7f95340d0cc0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c005c60 con 0x7f95340d0cc0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c007070 con 0x7f95340d0cc0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95340c9a60 con 0x7f95340d0cc0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953414f6a0 con 0x7f95340d0cc0 2023-12-19T16:17:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.067+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953414f500 con 0x7f95340d0cc0 2023-12-19T16:17:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.071+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f951c0071d0 con 0x7f95340d0cc0 2023-12-19T16:17:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.071+0000 7f952b7fe640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9514065a60 0x7f9514067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.071+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f951c0837a0 con 0x7f95340d0cc0 2023-12-19T16:17:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.071+0000 7f9532ffd640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9514065a60 0x7f9514067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.075+0000 7f9532ffd640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9514065a60 0x7f9514067f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f95240ad000 tx=0x7f9524008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.075+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f951c051200 con 0x7f95340d0cc0 2023-12-19T16:17:57.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f953414f500 con 0x7f95340d0cc0 2023-12-19T16:17:57.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f952b7fe640 1 -- 172.21.15.119:0/4130298522 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f953414f500 con 0x7f95340d0cc0 2023-12-19T16:17:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:17:57.263 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:52.030827+0000","modified":"2023-12-19T16:17:55.053336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/2766727867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2766727867},{"type":"v1","addr":"172.21.15.119:6836","nonce":2766727867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:57.263 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9514065a60 msgr2=0x7f9514067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9514065a60 0x7f9514067f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f95240ad000 tx=0x7f9524008040 comp rx=0 tx=0).stop 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 msgr2=0x7f953414ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 0x7f953414ecd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c730 tx=0x7f951c00cbf0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 shutdown_connections 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9514065a60 0x7f9514067f20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9534157080 0x7f95340c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95340d0cc0 0x7f953414ecd0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 --2- 172.21.15.119:0/4130298522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95340cd730 0x7f9534151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 >> 172.21.15.119:0/4130298522 conn(0x7f9534069ca0 msgr2=0x7f95340cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 shutdown_connections 2023-12-19T16:17:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.259+0000 7f953956d640 1 -- 172.21.15.119:0/4130298522 wait complete. 2023-12-19T16:17:57.627 INFO:tasks.ceph.mds.c.smithi119.stderr:2023-12-19T16:17:57.623+0000 7f4f2a75e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:17:57.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:17:52.030827+0000', 'modified': '2023-12-19T16:17:55.053336+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6836/2766727867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 2766727867}, {'type': 'v1', 'addr': '172.21.15.119:6836', 'nonce': 2766727867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:17:57.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:17:57.686 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T16:17:57.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 Processor -- start 2023-12-19T16:17:57.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 -- start start 2023-12-19T16:17:57.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81a006c4f0 0x7f81a00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00c9460 con 0x7f81a01570c0 2023-12-19T16:17:57.828 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a01574a0 con 0x7f81a006c4f0 2023-12-19T16:17:57.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a7dc0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00c8b30 con 0x7f81a00c9e30 2023-12-19T16:17:57.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a5b5c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f81a01570c0 0x7f81a006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53500/0 (socket says 172.21.15.119:53500) 2023-12-19T16:17:57.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a5b5c640 1 -- 172.21.15.119:0/3406442741 learned_addr learned my addr 172.21.15.119:0/3406442741 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:17:57.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a535b640 1 --2- 172.21.15.119:0/3406442741 >> v2:172.21.15.119:3300/0 conn(0x7f81a006c4f0 0x7f81a00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a635d640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a4b5a640 1 -- 172.21.15.119:0/3406442741 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759850248 0 0) 0x7f81a00c9460 con 0x7f81a01570c0 2023-12-19T16:17:57.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a4b5a640 1 -- 172.21.15.119:0/3406442741 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f818c003530 con 0x7f81a01570c0 2023-12-19T16:17:57.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a535b640 1 -- 172.21.15.119:0/3406442741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 msgr2=0x7f81a0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a535b640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a0070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a535b640 1 -- 172.21.15.119:0/3406442741 >> v1:172.21.15.119:6789/0 conn(0x7f81a01570c0 legacy=0x7f81a006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a535b640 1 -- 172.21.15.119:0/3406442741 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00c8e10 con 0x7f81a006c4f0 2023-12-19T16:17:57.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.823+0000 7f81a635d640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a0070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:57.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a535b640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00c98f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f81900097c0 tx=0x7f819001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94b6fc64a040033 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a4b5a640 1 -- 172.21.15.119:0/3406442741 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900ab600 con 0x7f81a006c4f0 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a4b5a640 1 -- 172.21.15.119:0/3406442741 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81900a7050 con 0x7f81a006c4f0 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a4b5a640 1 -- 172.21.15.119:0/3406442741 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900ab960 con 0x7f81a006c4f0 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 -- 172.21.15.119:0/3406442741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 msgr2=0x7f81a00c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00c98f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f81900097c0 tx=0x7f819001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 -- 172.21.15.119:0/3406442741 shutdown_connections 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a0070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.833 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/3406442741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00c98f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 -- 172.21.15.119:0/3406442741 >> 172.21.15.119:0/3406442741 conn(0x7f81a006a3e0 msgr2=0x7f81a00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 -- 172.21.15.119:0/3406442741 shutdown_connections 2023-12-19T16:17:57.834 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 -- 172.21.15.119:0/3406442741 wait complete. 2023-12-19T16:17:57.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.827+0000 7f81a7dc0640 1 Processor -- start 2023-12-19T16:17:57.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 -- start start 2023-12-19T16:17:57.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a01570c0 0x7f81a00c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00ae3e0 con 0x7f81a006c4f0 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00ae6c0 con 0x7f81a01570c0 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00ae9a0 con 0x7f81a00c9e30 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56452/0 (socket says 172.21.15.119:56452) 2023-12-19T16:17:57.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 -- 172.21.15.119:0/1112734317 learned_addr learned my addr 172.21.15.119:0/1112734317 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:57.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a535b640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a635d640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a01570c0 0x7f81a00c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 -- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 msgr2=0x7f81a00acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a00acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 -- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a01570c0 msgr2=0x7f81a00c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.840 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a01570c0 0x7f81a00c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 -- 172.21.15.119:0/1112734317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009420 con 0x7f81a006c4f0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00ade00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c3c0 tx=0x7f819c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81967fc640 1 -- 172.21.15.119:0/1112734317 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c005cf0 con 0x7f81a006c4f0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81967fc640 1 -- 172.21.15.119:0/1112734317 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c005e50 con 0x7f81a006c4f0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a00aec80 con 0x7f81a006c4f0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81967fc640 1 -- 172.21.15.119:0/1112734317 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0072f0 con 0x7f81a006c4f0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.831+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a00c8490 con 0x7f81a006c4f0 2023-12-19T16:17:57.842 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81967fc640 1 -- 172.21.15.119:0/1112734317 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f819c007450 con 0x7f81a006c4f0 2023-12-19T16:17:57.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81967fc640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8184065a60 0x7f8184067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81967fc640 1 -- 172.21.15.119:0/1112734317 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f819c0828b0 con 0x7f81a006c4f0 2023-12-19T16:17:57.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81a535b640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8184065a60 0x7f8184067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 Processor -- start 2023-12-19T16:17:57.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 -- start start 2023-12-19T16:17:57.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81a535b640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8184065a60 0x7f8184067f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f81900ad000 tx=0x7f81900a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa3b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3bbe0 0x5614ca9f1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca810c90 con 0x5614ca9f15d0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca842220 con 0x5614caa3bbe0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ca83f7f0 con 0x5614caa3b2c0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81a635d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81a635d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56456/0 (socket says 172.21.15.119:56456) 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.835+0000 7f81a635d640 1 -- 172.21.15.119:0/2031169879 learned_addr learned my addr 172.21.15.119:0/2031169879 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a535b640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3bbe0 0x5614ca9f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa3b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 -- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 msgr2=0x5614caa3b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa3b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 -- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3bbe0 msgr2=0x5614ca9f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3bbe0 0x5614ca9f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 -- 172.21.15.119:0/2031169879 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614ca537890 con 0x5614ca9f15d0 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a535b640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3bbe0 0x5614ca9f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa3b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9f19b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8198009aa0 tx=0x7f8198009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2a6ad696f4596 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81837fe640 1 -- 172.21.15.119:0/2031169879 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198014610 con 0x5614ca9f15d0 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81837fe640 1 -- 172.21.15.119:0/2031169879 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800f050 con 0x5614ca9f15d0 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81837fe640 1 -- 172.21.15.119:0/2031169879 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198014990 con 0x5614ca9f15d0 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- 172.21.15.119:0/2031169879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 msgr2=0x5614ca9f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9f19b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8198009aa0 tx=0x7f8198009f60 comp rx=0 tx=0).stop 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- 172.21.15.119:0/2031169879 shutdown_connections 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3bbe0 0x5614ca9f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9f19b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- 172.21.15.119:0/2031169879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa3b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- 172.21.15.119:0/2031169879 >> 172.21.15.119:0/2031169879 conn(0x5614ca9f3950 msgr2=0x5614ca9eb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- 172.21.15.119:0/2031169879 shutdown_connections 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- 172.21.15.119:0/2031169879 wait complete. 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- start start 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 Processor -- start 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614ca9f15d0 0x5614caa28aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa28fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 0x5614caa29520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca83b0e0 con 0x5614caa3bbe0 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca7da310 con 0x5614ca9f15d0 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ca7f8770 con 0x5614caa3b2c0 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81ab133000 10 client.0 _ll_register_callbacks cb 0x5614ca9d8b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 0x5614caa29520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 0x5614caa29520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56466/0 (socket says 172.21.15.119:56466) 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.839+0000 7f81a635d640 1 -- 172.21.15.119:0/689363137 learned_addr learned my addr 172.21.15.119:0/689363137 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:57.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a535b640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa28fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614ca9f15d0 0x5614caa28aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a635d640 1 -- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 msgr2=0x5614caa28fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a635d640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa28fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a635d640 1 -- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614ca9f15d0 msgr2=0x5614caa28aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a635d640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614ca9f15d0 0x5614caa28aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a635d640 1 -- 172.21.15.119:0/689363137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81980096d0 con 0x5614caa3bbe0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a535b640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa28fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614ca9f15d0 0x5614caa28aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a635d640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 0x5614caa29520 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8198016040 tx=0x7f8198004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26c29dfecb5858d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 1 -- 172.21.15.119:0/689363137 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198003e40 con 0x5614caa3bbe0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 1 -- 172.21.15.119:0/689363137 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8198014e10 con 0x5614caa3bbe0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614ca80ac10 con 0x5614caa3bbe0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 1 -- 172.21.15.119:0/689363137 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8198026410 con 0x5614caa3bbe0 2023-12-19T16:17:57.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 10 client.6318 fetch_fsmap learned FSMap version 26 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5614ca800260 con 0x5614caa3bbe0 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 1 -- 172.21.15.119:0/689363137 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614ca80ac10 con 0x5614caa3bbe0 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 1 -- 172.21.15.119:0/689363137 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8198026570 con 0x5614caa3bbe0 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 10 client.6318 fetch_fsmap finished waiting for FSMap version 26 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 10 client.6318 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 20 client.6318 populate_metadata read hostname 'smithi119' 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa29dc0 0x5614caa4c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 4 client.6318 mds_command: new command op to 6174 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 --> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614ca839a30 con 0x5614caa29dc0 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa29dc0 0x5614caa4c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa29dc0 0x5614caa4c830 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=881a7fd567158b5e server_cookie=e84f2880a89f3712 in_seq=0 out_seq=0 2023-12-19T16:17:57.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 10 client.6318 ms_handle_connect on v2:172.21.15.119:6834/2766727867 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 1 -- 172.21.15.119:0/689363137 <== mds.0 v2:172.21.15.119:6834/2766727867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5614ca839a30 con 0x5614caa29dc0 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 10 client.6318 handle_command_reply: tid=0 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 client.6318 shutdown 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 msgr2=0x5614caa29520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 0x5614caa29520 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8198016040 tx=0x7f8198004ac0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 shutdown_connections 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa29dc0 0x5614caa4c830 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614caa3bbe0 0x5614caa29520 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614caa3b2c0 0x5614caa28fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f8180ff9640 0 client.6318 ms_handle_reset on v2:172.21.15.119:6834/2766727867 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 --2- 172.21.15.119:0/689363137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614ca9f15d0 0x5614caa28aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 >> 172.21.15.119:0/689363137 conn(0x5614ca9f3950 msgr2=0x5614ca9eacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 shutdown_connections 2023-12-19T16:17:57.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 1 -- 172.21.15.119:0/689363137 wait complete. 2023-12-19T16:17:57.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.843+0000 7f81ab133000 20 client.6318 trim_cache size 0 max 16384 2023-12-19T16:17:57.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 Processor -- start 2023-12-19T16:17:57.863 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 -- start start 2023-12-19T16:17:57.864 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614ca9ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9ec220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa263d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca4f8940 con 0x5614ca9f15d0 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca7e3860 con 0x5614caa3b2c0 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ca7e0770 con 0x5614ca9f3950 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9ec220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56472/0 (socket says 172.21.15.119:56472) 2023-12-19T16:17:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 -- 172.21.15.119:0/1473626068 learned_addr learned my addr 172.21.15.119:0/1473626068 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614ca9ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a635d640 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 -- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 msgr2=0x5614ca9ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614ca9ebce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 -- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 msgr2=0x5614caa263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 -- 172.21.15.119:0/1473626068 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614ca7e63b0 con 0x5614ca9f15d0 2023-12-19T16:17:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.859+0000 7f81a535b640 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9ec220 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f819001c8a0 tx=0x7f8190004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b2a5c2de7923bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f8183fff640 1 -- 172.21.15.119:0/1473626068 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900bc040 con 0x5614ca9f15d0 2023-12-19T16:17:57.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f8183fff640 1 -- 172.21.15.119:0/1473626068 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81900b6450 con 0x5614ca9f15d0 2023-12-19T16:17:57.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f8183fff640 1 -- 172.21.15.119:0/1473626068 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900b67c0 con 0x5614ca9f15d0 2023-12-19T16:17:57.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- 172.21.15.119:0/1473626068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 msgr2=0x5614ca9ec220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9ec220 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f819001c8a0 tx=0x7f8190004740 comp rx=0 tx=0).stop 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- 172.21.15.119:0/1473626068 shutdown_connections 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614ca9ec220 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- 172.21.15.119:0/1473626068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614ca9ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- 172.21.15.119:0/1473626068 >> 172.21.15.119:0/1473626068 conn(0x5614ca9f8820 msgr2=0x5614ca9f28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- 172.21.15.119:0/1473626068 shutdown_connections 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- 172.21.15.119:0/1473626068 wait complete. 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- start start 2023-12-19T16:17:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 Processor -- start 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614caa98380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614caa988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa4be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca837ee0 con 0x5614ca9f15d0 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ca83b990 con 0x5614caa3b2c0 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ca8fceb0 con 0x5614ca9f3950 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 10 client.0 _ll_register_callbacks cb 0x5614ca7e9640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614caa98380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614caa98380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56488/0 (socket says 172.21.15.119:56488) 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 -- 172.21.15.119:0/2947438519 learned_addr learned my addr 172.21.15.119:0/2947438519 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a635d640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa4be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a535b640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614caa988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 -- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 msgr2=0x5614caa988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614caa988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 -- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 msgr2=0x5614caa4be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa4be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 -- 172.21.15.119:0/2947438519 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a00c8e10 con 0x5614ca9f15d0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81a5b5c640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614caa98380 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f819c05b820 tx=0x7f819c05be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984bd23852801598 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f8180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f8180ff9640 1 -- 172.21.15.119:0/2947438519 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c050530 con 0x5614ca9f15d0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f8180ff9640 1 -- 172.21.15.119:0/2947438519 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f819c050690 con 0x5614ca9f15d0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.863+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614ca800e00 con 0x5614ca9f15d0 2023-12-19T16:17:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 1 -- 172.21.15.119:0/2947438519 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f819c070200 con 0x5614ca9f15d0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 10 client.6324 fetch_fsmap learned FSMap version 26 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5614ca537cc0 con 0x5614ca9f15d0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 1 -- 172.21.15.119:0/2947438519 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614ca800e00 con 0x5614ca9f15d0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 1 -- 172.21.15.119:0/2947438519 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f819c05b8c0 con 0x5614ca9f15d0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 10 client.6324 fetch_fsmap finished waiting for FSMap version 26 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 10 client.6324 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 20 client.6324 populate_metadata read hostname 'smithi119' 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa3bbe0 0x5614caa4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 4 client.6324 mds_command: new command op to 6174 tid=0[{"prefix": "status"}] 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 --> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5614ca834160 con 0x5614caa3bbe0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a535b640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa3bbe0 0x5614caa4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a535b640 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa3bbe0 0x5614caa4c350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8933b5d91f2bba2 server_cookie=1a61adb79c2594b in_seq=0 out_seq=0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 10 client.6324 ms_handle_connect on v2:172.21.15.119:6834/2766727867 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 1 -- 172.21.15.119:0/2947438519 <== mds.0 v2:172.21.15.119:6834/2766727867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5614ca834160 con 0x5614caa3bbe0 2023-12-19T16:17:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 10 client.6324 handle_command_reply: tid=0 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 client.6324 shutdown 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 msgr2=0x5614caa98380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614caa98380 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f819c05b820 tx=0x7f819c05be70 comp rx=0 tx=0).stop 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 shutdown_connections 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:6834/2766727867,v1:172.21.15.119:6836/2766727867] conn(0x5614caa3bbe0 0x5614caa4c350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5614caa3b2c0 0x5614caa4be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5614ca9f3950 0x5614caa988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f8180ff9640 0 client.6324 ms_handle_reset on v2:172.21.15.119:6834/2766727867 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 --2- 172.21.15.119:0/2947438519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614ca9f15d0 0x5614caa98380 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 >> 172.21.15.119:0/2947438519 conn(0x5614ca9f8820 msgr2=0x5614caa263d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 shutdown_connections 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 1 -- 172.21.15.119:0/2947438519 wait complete. 2023-12-19T16:17:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81ab133000 20 client.6324 trim_cache size 0 max 16384 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "95401411-8d68-4720-80be-89deeb6bcc32", 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6174, 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 5.8359824160000002, 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 26, 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 55, 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 55, 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 11.074562673999999 2023-12-19T16:17:57.876 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:17:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8184065a60 msgr2=0x7f8184067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8184065a60 0x7f8184067f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f81900ad000 tx=0x7f81900a6000 comp rx=0 tx=0).stop 2023-12-19T16:17:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 msgr2=0x7f81a00ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00ade00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c3c0 tx=0x7f819c00c880 comp rx=0 tx=0).stop 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 shutdown_connections 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8184065a60 0x7f8184067f20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a01570c0 0x7f81a00c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a00c9e30 0x7f81a00acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 --2- 172.21.15.119:0/1112734317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a006c4f0 0x7f81a00ade00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 >> 172.21.15.119:0/1112734317 conn(0x7f81a006a3e0 msgr2=0x7f81a00c4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 shutdown_connections 2023-12-19T16:17:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:57.867+0000 7f81a7dc0640 1 -- 172.21.15.119:0/1112734317 wait complete. 2023-12-19T16:17:57.890 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:17:58.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.023+0000 7f1ee676d640 1 Processor -- start 2023-12-19T16:17:58.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.023+0000 7f1ee676d640 1 -- start start 2023-12-19T16:17:58.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee676d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1ee00cdd40 0x7f1ee00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:58.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee676d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 0x7f1ee0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:58.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee676d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee0160690 con 0x7f1ee015c9d0 2023-12-19T16:17:58.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee676d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee01603f0 con 0x7f1ee00cdd40 2023-12-19T16:17:58.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee676d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00b0d80 con 0x7f1ee006fdb0 2023-12-19T16:17:58.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 0x7f1ee0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1edf7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1ee00cdd40 0x7f1ee00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 0x7f1ee0070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:46264/0 (socket says 172.21.15.119:46264) 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/3099430393 learned_addr learned my addr 172.21.15.119:0/3099430393 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/3099430393 >> v2:172.21.15.143:3300/0 conn(0x7f1ee00cdd40 msgr2=0x7f1ee00cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 --2- 172.21.15.119:0/3099430393 >> v2:172.21.15.143:3300/0 conn(0x7f1ee00cdd40 0x7f1ee00cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/3099430393 >> v1:172.21.15.143:6789/0 conn(0x7f1ee015c9d0 legacy=0x7f1ee0160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:58.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.027+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/3099430393 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee00ccb00 con 0x7f1ee006fdb0 2023-12-19T16:17:58.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee4d0a640 1 --2- 172.21.15.119:0/3099430393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 0x7f1ee0070240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009e50 tx=0x7f1ed801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8abe5146fe9d2d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:58.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1edeffd640 1 -- 172.21.15.119:0/3099430393 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed80a5900 con 0x7f1ee006fdb0 2023-12-19T16:17:58.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1edeffd640 1 -- 172.21.15.119:0/3099430393 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed80a5a60 con 0x7f1ee006fdb0 2023-12-19T16:17:58.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1edeffd640 1 -- 172.21.15.119:0/3099430393 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed80a5df0 con 0x7f1ee006fdb0 2023-12-19T16:17:58.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 -- 172.21.15.119:0/3099430393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 msgr2=0x7f1ee0070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 --2- 172.21.15.119:0/3099430393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 0x7f1ee0070240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009e50 tx=0x7f1ed801ca10 comp rx=0 tx=0).stop 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 -- 172.21.15.119:0/3099430393 shutdown_connections 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 --2- 172.21.15.119:0/3099430393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee006fdb0 0x7f1ee0070240 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 --2- 172.21.15.119:0/3099430393 >> v2:172.21.15.143:3300/0 conn(0x7f1ee00cdd40 0x7f1ee00cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 -- 172.21.15.119:0/3099430393 >> 172.21.15.119:0/3099430393 conn(0x7f1ee006a3e0 msgr2=0x7f1ee00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 -- 172.21.15.119:0/3099430393 shutdown_connections 2023-12-19T16:17:58.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 -- 172.21.15.119:0/3099430393 wait complete. 2023-12-19T16:17:58.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 Processor -- start 2023-12-19T16:17:58.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.031+0000 7f1ee676d640 1 -- start start 2023-12-19T16:17:58.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ee006fdb0 0x7f1ee015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:58.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee00cdd40 0x7f1ee015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:58.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 0x7f1ee0152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:58.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00706e0 con 0x7f1ee015c9d0 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00709c0 con 0x7f1ee006fdb0 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0070ca0 con 0x7f1ee00cdd40 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 0x7f1ee0152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 0x7f1ee0152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56504/0 (socket says 172.21.15.119:56504) 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/1458143292 learned_addr learned my addr 172.21.15.119:0/1458143292 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1edffff640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ee006fdb0 0x7f1ee015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1edf7fe640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee00cdd40 0x7f1ee015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee00cdd40 msgr2=0x7f1ee015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee00cdd40 0x7f1ee015ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ee006fdb0 msgr2=0x7f1ee015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ee006fdb0 0x7f1ee015a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 -- 172.21.15.119:0/1458143292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8009b30 con 0x7f1ee015c9d0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee4d0a640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 0x7f1ee0152670 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80af040 tx=0x7f1ed80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed80b8670 con 0x7f1ee015c9d0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed80b87d0 con 0x7f1ee015c9d0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed80b8b80 con 0x7f1ee015c9d0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee01613b0 con 0x7f1ee015c9d0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee0071260 con 0x7f1ee015c9d0 2023-12-19T16:17:58.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.035+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee00735b0 con 0x7f1ee015c9d0 2023-12-19T16:17:58.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.039+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ed80b8ce0 con 0x7f1ee015c9d0 2023-12-19T16:17:58.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.039+0000 7f1edcff9640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ecc065a60 0x7f1ecc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:58.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.039+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1ed811e630 con 0x7f1ee015c9d0 2023-12-19T16:17:58.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.039+0000 7f1edffff640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ecc065a60 0x7f1ecc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:58.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.039+0000 7f1edffff640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ecc065a60 0x7f1ecc067f20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0007fd0 tx=0x7f1ed0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:58.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.043+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ed80ec070 con 0x7f1ee015c9d0 2023-12-19T16:17:58.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.227+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ee004e000 con 0x7f1ee015c9d0 2023-12-19T16:17:58.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.227+0000 7f1edcff9640 1 -- 172.21.15.119:0/1458143292 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ed80ef690 con 0x7f1ee015c9d0 2023-12-19T16:17:58.232 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:17:58.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ecc065a60 msgr2=0x7f1ecc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:58.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ecc065a60 0x7f1ecc067f20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0007fd0 tx=0x7f1ed0009040 comp rx=0 tx=0).stop 2023-12-19T16:17:58.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 msgr2=0x7f1ee0152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:58.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 0x7f1ee0152670 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80af040 tx=0x7f1ed80197b0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 shutdown_connections 2023-12-19T16:17:58.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1ecc065a60 0x7f1ecc067f20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ee015c9d0 0x7f1ee0152670 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ee00cdd40 0x7f1ee015ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 --2- 172.21.15.119:0/1458143292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ee006fdb0 0x7f1ee015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 >> 172.21.15.119:0/1458143292 conn(0x7f1ee006a3e0 msgr2=0x7f1ee00aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 shutdown_connections 2023-12-19T16:17:58.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:58.231+0000 7f1ee676d640 1 -- 172.21.15.119:0/1458143292 wait complete. 2023-12-19T16:17:58.253 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:17:58.254 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:58.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.254 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:17:58.264 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:17:58.264 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:17:58.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:17:58.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:58.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.267 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:17:58.327 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:17:58.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.329 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:58.384 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:17:58.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.385 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:17:58.385 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:17:58.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:17:58.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:17:58.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:17:58.385 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:17:58.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.476 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:17:58.486 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:17:58.486 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:17:58.486 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:58.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:17:58.550 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:17:58.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:58.550 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:58.601 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:58.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:58.602 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:58.652 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:17:58.713 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:17:58.714 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:17:58.775 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:17:58.777 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:17:58.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.777 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:17:58.829 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:17:58.829 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:17:58.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:17:58.898 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:17:58.898 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:17:58.960 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:17:58.961 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:17:58.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:58.962 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:17:58.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:17:58.967+0000 7f78934ed580 -1 init, newargv = 0x5626a54fd770 newargc=15 2023-12-19T16:17:58.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[52324]: starting ceph client 2023-12-19T16:17:58.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[52324]: starting fuse 2023-12-19T16:17:58.983 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:17:58.983 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:17:58.983 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:17:58.983 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:17:58.983 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:17:58.983 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:17:58.983 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:17:58.983 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:17:58.984 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:17:58.985 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:17:59.110 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.52324.asok 2023-12-19T16:17:59.294 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52324.asok 2023-12-19T16:17:59.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:59.295 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52324.asok status 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "52324", 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:17:59.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6333, 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 6333 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1711978174 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:17:59.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1711978174 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.6333 192.168.0.1:0/1711978174", 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/1711978174", 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 26, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 55, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:17:59.467 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:17:59.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:59.481 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:17:59.481 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:59.491 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:17:59.491 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:59.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:59.491 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:59.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:59.553 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-12-19T16:17:59.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-12-19T16:17:59.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.807+0000 7f2f02454640 1 Processor -- start 2023-12-19T16:17:59.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.807+0000 7f2f02454640 1 -- start start 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f02454640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2efc160b20 0x7f2efc0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f02454640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc1648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f02454640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0cc8d0 con 0x7f2efc164e20 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f02454640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc165640 con 0x7f2efc160b20 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f02454640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0cbfa0 con 0x7f2efc0cb0a0 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2efc160b20 0x7f2efc0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2efc160b20 0x7f2efc0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56508/0 (socket says 172.21.15.119:56508) 2023-12-19T16:17:59.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 -- 172.21.15.119:0/4021923810 learned_addr learned my addr 172.21.15.119:0/4021923810 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:59.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01c53640 1 --1- 172.21.15.119:0/4021923810 >> v1:172.21.15.119:6789/0 conn(0x7f2efc164e20 0x7f2efc06bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53502/0 (socket says 172.21.15.119:53502) 2023-12-19T16:17:59.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f00c51640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc1648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 -- 172.21.15.119:0/4021923810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 msgr2=0x7f2efc1648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:59.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc1648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 -- 172.21.15.119:0/4021923810 >> v1:172.21.15.119:6789/0 conn(0x7f2efc164e20 legacy=0x7f2efc06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f01452640 1 -- 172.21.15.119:0/4021923810 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0cc280 con 0x7f2efc160b20 2023-12-19T16:17:59.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2ef3fff640 1 -- 172.21.15.119:0/4021923810 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023224517 0 0) 0x7f2efc0cc8d0 con 0x7f2efc164e20 2023-12-19T16:17:59.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.811+0000 7f2f00c51640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc1648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:59.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f01452640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc0cab60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009870 tx=0x7f2ef801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d35869e555d6b86 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:59.817 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2ef3fff640 1 -- 172.21.15.119:0/4021923810 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80ab650 con 0x7f2efc160b20 2023-12-19T16:17:59.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2ef3fff640 1 -- 172.21.15.119:0/4021923810 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef80ab7b0 con 0x7f2efc160b20 2023-12-19T16:17:59.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2ef3fff640 1 -- 172.21.15.119:0/4021923810 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80abb40 con 0x7f2efc160b20 2023-12-19T16:17:59.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- 172.21.15.119:0/4021923810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 msgr2=0x7f2efc0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc0cab60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009870 tx=0x7f2ef801c510 comp rx=0 tx=0).stop 2023-12-19T16:17:59.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- 172.21.15.119:0/4021923810 shutdown_connections 2023-12-19T16:17:59.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc1648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 --2- 172.21.15.119:0/4021923810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc0cab60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- 172.21.15.119:0/4021923810 >> 172.21.15.119:0/4021923810 conn(0x7f2efc06a350 msgr2=0x7f2efc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:59.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- 172.21.15.119:0/4021923810 shutdown_connections 2023-12-19T16:17:59.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- 172.21.15.119:0/4021923810 wait complete. 2023-12-19T16:17:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 Processor -- start 2023-12-19T16:17:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- start start 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2efc164e20 0x7f2efc155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc156b50 con 0x7f2efc160b20 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc156220 con 0x7f2efc164e20 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.815+0000 7f2f02454640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc156500 con 0x7f2efc0cb0a0 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56510/0 (socket says 172.21.15.119:56510) 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 -- 172.21.15.119:0/497489790 learned_addr learned my addr 172.21.15.119:0/497489790 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f01452640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f01c53640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2efc164e20 0x7f2efc155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 -- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 msgr2=0x7f2efc15f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc15f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 -- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2efc164e20 msgr2=0x7f2efc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2efc164e20 0x7f2efc155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 -- 172.21.15.119:0/497489790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80094d0 con 0x7f2efc160b20 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f01c53640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2efc164e20 0x7f2efc155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f00c51640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc1555b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7c0 tx=0x7f2eec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec007a30 con 0x7f2efc160b20 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec007b90 con 0x7f2efc160b20 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc1567e0 con 0x7f2efc160b20 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00ce70 con 0x7f2efc160b20 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc157d80 con 0x7f2efc160b20 2023-12-19T16:17:59.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc04e000 con 0x7f2efc160b20 2023-12-19T16:17:59.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.819+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2eec0113f0 con 0x7f2efc160b20 2023-12-19T16:17:59.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.823+0000 7f2ef1ffb640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ee0065a90 0x7f2ee0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.823+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2eec0836d0 con 0x7f2efc160b20 2023-12-19T16:17:59.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.823+0000 7f2f01452640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ee0065a90 0x7f2ee0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.826 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.823+0000 7f2f01452640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ee0065a90 0x7f2ee0067f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80af000 tx=0x7f2ef80b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:17:59.827+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2eec050ff0 con 0x7f2efc160b20 2023-12-19T16:18:00.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.027+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f2efc0b0c60 con 0x7f2efc160b20 2023-12-19T16:18:00.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2ef1ffb640 1 -- 172.21.15.119:0/497489790 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+0 (secure 0 0 0) 0x7f2eec054610 con 0x7f2efc160b20 2023-12-19T16:18:00.038 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ee0065a90 msgr2=0x7f2ee0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ee0065a90 0x7f2ee0067f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80af000 tx=0x7f2ef80b6040 comp rx=0 tx=0).stop 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 msgr2=0x7f2efc1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc1555b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7c0 tx=0x7f2eec00cc80 comp rx=0 tx=0).stop 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 shutdown_connections 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f2ee0065a90 0x7f2ee0067f50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2efc164e20 0x7f2efc155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2efc160b20 0x7f2efc1555b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 --2- 172.21.15.119:0/497489790 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2efc0cb0a0 0x7f2efc15f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 >> 172.21.15.119:0/497489790 conn(0x7f2efc06a350 msgr2=0x7f2efc0cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:00.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 shutdown_connections 2023-12-19T16:18:00.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.035+0000 7f2f02454640 1 -- 172.21.15.119:0/497489790 wait complete. 2023-12-19T16:18:00.060 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:00.060 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:00.071 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:00.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d944640 1 Processor -- start 2023-12-19T16:18:00.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d944640 1 -- start start 2023-12-19T16:18:00.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d944640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb78167280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d944640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780b65c0 con 0x7fbb780cea00 2023-12-19T16:18:00.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d944640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7815cb10 con 0x7fbb7815c730 2023-12-19T16:18:00.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d944640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780cd960 con 0x7fbb780cf670 2023-12-19T16:18:00.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb77fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbb780cea00 0x7fbb780cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53510/0 (socket says 172.21.15.119:53510) 2023-12-19T16:18:00.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb77fff640 1 -- 172.21.15.119:0/2888399151 learned_addr learned my addr 172.21.15.119:0/2888399151 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:00.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d143640 1 --2- 172.21.15.119:0/2888399151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb78167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205454292 0 0) 0x7fbb780b65c0 con 0x7fbb780cea00 2023-12-19T16:18:00.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb68003530 con 0x7fbb780cea00 2023-12-19T16:18:00.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110685815 0 0) 0x7fbb7815cb10 con 0x7fbb7815c730 2023-12-19T16:18:00.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb780b65c0 con 0x7fbb7815c730 2023-12-19T16:18:00.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d143640 1 -- 172.21.15.119:0/2888399151 >> v1:172.21.15.143:6789/0 conn(0x7fbb7815c730 legacy=0x7fbb780b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d143640 1 -- 172.21.15.119:0/2888399151 >> v1:172.21.15.119:6789/0 conn(0x7fbb780cea00 legacy=0x7fbb780cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.251+0000 7fbb7d143640 1 -- 172.21.15.119:0/2888399151 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780cdc40 con 0x7fbb780cf670 2023-12-19T16:18:00.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d143640 1 --2- 172.21.15.119:0/2888399151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb78167280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009dc0 tx=0x7fbb7001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d971b1b008d58de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700af600 con 0x7fbb780cf670 2023-12-19T16:18:00.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700ab050 con 0x7fbb780cf670 2023-12-19T16:18:00.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb777fe640 1 -- 172.21.15.119:0/2888399151 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700af980 con 0x7fbb780cf670 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 -- 172.21.15.119:0/2888399151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 msgr2=0x7fbb78167280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 --2- 172.21.15.119:0/2888399151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb78167280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009dc0 tx=0x7fbb7001f150 comp rx=0 tx=0).stop 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 -- 172.21.15.119:0/2888399151 shutdown_connections 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 --2- 172.21.15.119:0/2888399151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb78167280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 -- 172.21.15.119:0/2888399151 >> 172.21.15.119:0/2888399151 conn(0x7fbb7806b120 msgr2=0x7fbb7806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 -- 172.21.15.119:0/2888399151 shutdown_connections 2023-12-19T16:18:00.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.255+0000 7fbb7d944640 1 -- 172.21.15.119:0/2888399151 wait complete. 2023-12-19T16:18:00.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 Processor -- start 2023-12-19T16:18:00.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 -- start start 2023-12-19T16:18:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 0x7fbb78149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb7815d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb7815c730 0x7fbb780c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780cb4d0 con 0x7fbb780cea00 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780c68d0 con 0x7fbb7815c730 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7815de10 con 0x7fbb780cf670 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 0x7fbb78149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 0x7fbb78149950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56526/0 (socket says 172.21.15.119:56526) 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 -- 172.21.15.119:0/63415784 learned_addr learned my addr 172.21.15.119:0/63415784 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d143640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb7815c730 0x7fbb780c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb77fff640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb7815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 -- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 msgr2=0x7fbb7815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb7815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 -- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb7815c730 msgr2=0x7fbb780c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb7815c730 0x7fbb780c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 -- 172.21.15.119:0/63415784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009a70 con 0x7fbb780cea00 2023-12-19T16:18:00.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7c942640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 0x7fbb78149950 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00c430 tx=0x7fbb6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0052d0 con 0x7fbb780cea00 2023-12-19T16:18:00.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c005450 con 0x7fbb780cea00 2023-12-19T16:18:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c003840 con 0x7fbb780cea00 2023-12-19T16:18:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb780c97c0 con 0x7fbb780cea00 2023-12-19T16:18:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.259+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb780c9d80 con 0x7fbb780cea00 2023-12-19T16:18:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.263+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb780c9620 con 0x7fbb780cea00 2023-12-19T16:18:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.263+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb6c0039a0 con 0x7fbb780cea00 2023-12-19T16:18:00.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.263+0000 7fbb757fa640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb5c065a90 0x7fbb5c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.263+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbb6c0828f0 con 0x7fbb780cea00 2023-12-19T16:18:00.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.263+0000 7fbb77fff640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb5c065a90 0x7fbb5c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.263+0000 7fbb77fff640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb5c065a90 0x7fbb5c067f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbb64007fd0 tx=0x7fbb64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.275 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.271+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb780c9620 con 0x7fbb780cea00 2023-12-19T16:18:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.423+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb780c9620 con 0x7fbb780cea00 2023-12-19T16:18:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb757fa640 1 -- 172.21.15.119:0/63415784 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fbb780c9620 con 0x7fbb780cea00 2023-12-19T16:18:00.430 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:00.430 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb5c065a90 msgr2=0x7fbb5c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb5c065a90 0x7fbb5c067f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbb64007fd0 tx=0x7fbb64009040 comp rx=0 tx=0).stop 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 msgr2=0x7fbb78149950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 0x7fbb78149950 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00c430 tx=0x7fbb6c00c8f0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 shutdown_connections 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb5c065a90 0x7fbb5c067f50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb7815c730 0x7fbb780c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb780cf670 0x7fbb7815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 --2- 172.21.15.119:0/63415784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780cea00 0x7fbb78149950 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 >> 172.21.15.119:0/63415784 conn(0x7fbb7806b120 msgr2=0x7fbb780d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 shutdown_connections 2023-12-19T16:18:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.427+0000 7fbb7d944640 1 -- 172.21.15.119:0/63415784 wait complete. 2023-12-19T16:18:00.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:49.778202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:51.022485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:00.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:00.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 Processor -- start 2023-12-19T16:18:00.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 -- start start 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f535015c770 0x7f535015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53500cd840 0x7f5350142340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5350156b70 con 0x7f53500cd3d0 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500cdc50 con 0x7f535015c770 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5356d44640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535015d090 con 0x7f53500cd840 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.591+0000 7f5355d42640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f535015c770 0x7f535015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f535015c770 0x7f535015cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56528/0 (socket says 172.21.15.119:56528) 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 -- 172.21.15.119:0/609577240 learned_addr learned my addr 172.21.15.119:0/609577240 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5356543640 1 --2- 172.21.15.119:0/609577240 >> v2:172.21.15.143:3300/0 conn(0x7f53500cd840 0x7f5350142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 -- 172.21.15.119:0/609577240 >> v2:172.21.15.143:3300/0 conn(0x7f53500cd840 msgr2=0x7f5350142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 --2- 172.21.15.119:0/609577240 >> v2:172.21.15.143:3300/0 conn(0x7f53500cd840 0x7f5350142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 -- 172.21.15.119:0/609577240 >> v1:172.21.15.143:6789/0 conn(0x7f53500cd3d0 legacy=0x7f5350141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 -- 172.21.15.119:0/609577240 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535006a7e0 con 0x7f535015c770 2023-12-19T16:18:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5356543640 1 --2- 172.21.15.119:0/609577240 >> v2:172.21.15.143:3300/0 conn(0x7f53500cd840 0x7f5350142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:00.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5355d42640 1 --2- 172.21.15.119:0/609577240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f535015c770 0x7f535015cb50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f53500c9060 tx=0x7f534c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5918a7dd5f3fe64 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5354d40640 1 -- 172.21.15.119:0/609577240 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0ab600 con 0x7f535015c770 2023-12-19T16:18:00.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5354d40640 1 -- 172.21.15.119:0/609577240 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0a7050 con 0x7f535015c770 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.595+0000 7f5354d40640 1 -- 172.21.15.119:0/609577240 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0ab980 con 0x7f535015c770 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- 172.21.15.119:0/609577240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f535015c770 msgr2=0x7f535015cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 --2- 172.21.15.119:0/609577240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f535015c770 0x7f535015cb50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f53500c9060 tx=0x7f534c01c370 comp rx=0 tx=0).stop 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- 172.21.15.119:0/609577240 shutdown_connections 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 --2- 172.21.15.119:0/609577240 >> v2:172.21.15.143:3300/0 conn(0x7f53500cd840 0x7f5350142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 --2- 172.21.15.119:0/609577240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f535015c770 0x7f535015cb50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- 172.21.15.119:0/609577240 >> 172.21.15.119:0/609577240 conn(0x7f53500cb540 msgr2=0x7f53500cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- 172.21.15.119:0/609577240 shutdown_connections 2023-12-19T16:18:00.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- 172.21.15.119:0/609577240 wait complete. 2023-12-19T16:18:00.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 Processor -- start 2023-12-19T16:18:00.603 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- start start 2023-12-19T16:18:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53500cd3d0 0x7f535014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 0x7f5350142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f535015c770 0x7f5350144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350144990 con 0x7f53500cd840 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535014b780 con 0x7f53500cd3d0 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356d44640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535014c120 con 0x7f535015c770 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 0x7f5350142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 0x7f5350142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56538/0 (socket says 172.21.15.119:56538) 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 -- 172.21.15.119:0/642800199 learned_addr learned my addr 172.21.15.119:0/642800199 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355d42640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53500cd3d0 0x7f535014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5356543640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f535015c770 0x7f5350144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 -- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f535015c770 msgr2=0x7f5350144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f535015c770 0x7f5350144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 -- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53500cd3d0 msgr2=0x7f535014bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53500cd3d0 0x7f535014bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 -- 172.21.15.119:0/642800199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0094d0 con 0x7f53500cd840 2023-12-19T16:18:00.606 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.599+0000 7f5355541640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 0x7f5350142e10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f534000b410 tx=0x7f534000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340004020 con 0x7f53500cd840 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340004180 con 0x7f53500cd840 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535014b1c0 con 0x7f53500cd840 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011630 con 0x7f53500cd840 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5350156db0 con 0x7f53500cd840 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535004e850 con 0x7f53500cd840 2023-12-19T16:18:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5340011790 con 0x7f53500cd840 2023-12-19T16:18:00.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f53467fc640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5334065a60 0x7f5334067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5340082f70 con 0x7f53500cd840 2023-12-19T16:18:00.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.603+0000 7f5355d42640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5334065a60 0x7f5334067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.607+0000 7f5355d42640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5334065a60 0x7f5334067f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f534c0ad000 tx=0x7f534c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.607+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53400b40a0 con 0x7f53500cd840 2023-12-19T16:18:00.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.759+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f535006b330 con 0x7f53500cd840 2023-12-19T16:18:00.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.759+0000 7f53467fc640 1 -- 172.21.15.119:0/642800199 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5340015020 con 0x7f53500cd840 2023-12-19T16:18:00.764 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:18:00.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5334065a60 msgr2=0x7f5334067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5334065a60 0x7f5334067f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f534c0ad000 tx=0x7f534c008040 comp rx=0 tx=0).stop 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 msgr2=0x7f5350142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 0x7f5350142e10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f534000b410 tx=0x7f534000b8d0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 shutdown_connections 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f5334065a60 0x7f5334067f20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f535015c770 0x7f5350144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53500cd840 0x7f5350142e10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 --2- 172.21.15.119:0/642800199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53500cd3d0 0x7f535014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 >> 172.21.15.119:0/642800199 conn(0x7f53500cb540 msgr2=0x7f5350146610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 shutdown_connections 2023-12-19T16:18:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.763+0000 7f5356d44640 1 -- 172.21.15.119:0/642800199 wait complete. 2023-12-19T16:18:00.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:00.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.919+0000 7fb4411db640 1 Processor -- start 2023-12-19T16:18:00.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb4411db640 1 -- start start 2023-12-19T16:18:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb4411db640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb43c070820 0x7fb43c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb4411db640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb4411db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0c9390 con 0x7fb43c1582d0 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb4411db640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0ced80 con 0x7fb43c070820 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb4411db640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c15aee0 con 0x7fb43c0ce3b0 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb433fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb43c070820 0x7fb43c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb43ad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb43c1582d0 0x7fb43c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53518/0 (socket says 172.21.15.119:53518) 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb433fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb43c070820 0x7fb43c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56542/0 (socket says 172.21.15.119:56542) 2023-12-19T16:18:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb43ad9d640 1 -- 172.21.15.119:0/2050915210 learned_addr learned my addr 172.21.15.119:0/2050915210 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb433fff640 1 -- 172.21.15.119:0/2050915210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 msgr2=0x7fb43c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb43b59e640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb433fff640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb433fff640 1 -- 172.21.15.119:0/2050915210 >> v1:172.21.15.119:6789/0 conn(0x7fb43c1582d0 legacy=0x7fb43c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb433fff640 1 -- 172.21.15.119:0/2050915210 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c15b1c0 con 0x7fb43c070820 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb43a59c640 1 -- 172.21.15.119:0/2050915210 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426275801 0 0) 0x7fb43c0c9390 con 0x7fb43c1582d0 2023-12-19T16:18:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.923+0000 7fb43b59e640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb433fff640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c070820 0x7fb43c0c8e50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097c0 tx=0x7fb42401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832d440494e648e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb43a59c640 1 -- 172.21.15.119:0/2050915210 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240ab650 con 0x7fb43c070820 2023-12-19T16:18:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb43a59c640 1 -- 172.21.15.119:0/2050915210 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4240ab7b0 con 0x7fb43c070820 2023-12-19T16:18:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb43a59c640 1 -- 172.21.15.119:0/2050915210 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240abb40 con 0x7fb43c070820 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 -- 172.21.15.119:0/2050915210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c070820 msgr2=0x7fb43c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c070820 0x7fb43c0c8e50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097c0 tx=0x7fb42401c450 comp rx=0 tx=0).stop 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 -- 172.21.15.119:0/2050915210 shutdown_connections 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 --2- 172.21.15.119:0/2050915210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c070820 0x7fb43c0c8e50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 -- 172.21.15.119:0/2050915210 >> 172.21.15.119:0/2050915210 conn(0x7fb43c06a2a0 msgr2=0x7fb43c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 -- 172.21.15.119:0/2050915210 shutdown_connections 2023-12-19T16:18:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 -- 172.21.15.119:0/2050915210 wait complete. 2023-12-19T16:18:00.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 Processor -- start 2023-12-19T16:18:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.927+0000 7fb4411db640 1 -- start start 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c070820 0x7fb43c14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 0x7fb43c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c15d880 con 0x7fb43c1582d0 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c14e670 con 0x7fb43c070820 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c14ddd0 con 0x7fb43c0ce3b0 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 0x7fb43c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 0x7fb43c0ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56552/0 (socket says 172.21.15.119:56552) 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 -- 172.21.15.119:0/3822366846 learned_addr learned my addr 172.21.15.119:0/3822366846 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb433fff640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43ad9d640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c070820 0x7fb43c14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 -- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 msgr2=0x7fb43c1496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c1496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 -- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c070820 msgr2=0x7fb43c14d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c070820 0x7fb43c14d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 -- 172.21.15.119:0/3822366846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009420 con 0x7fb43c1582d0 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb433fff640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c1496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43ad9d640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c070820 0x7fb43c14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb43b59e640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 0x7fb43c0ae8d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb43400cef0 tx=0x7fb43400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400d840 con 0x7fb43c1582d0 2023-12-19T16:18:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400d9c0 con 0x7fb43c1582d0 2023-12-19T16:18:00.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c14e0b0 con 0x7fb43c1582d0 2023-12-19T16:18:00.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400dd70 con 0x7fb43c1582d0 2023-12-19T16:18:00.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c14da10 con 0x7fb43c1582d0 2023-12-19T16:18:00.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c15d9c0 con 0x7fb43c1582d0 2023-12-19T16:18:00.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.931+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb43401e3b0 con 0x7fb43c1582d0 2023-12-19T16:18:00.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.935+0000 7fb4337fe640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb41c065a60 0x7fb41c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:00.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.935+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb434083da0 con 0x7fb43c1582d0 2023-12-19T16:18:00.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.935+0000 7fb43ad9d640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb41c065a60 0x7fb41c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:00.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.935+0000 7fb43ad9d640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb41c065a60 0x7fb41c067f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb42c007fd0 tx=0x7fb42c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:00.939+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb43c15d9c0 con 0x7fb43c1582d0 2023-12-19T16:18:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb43c15d9c0 con 0x7fb43c1582d0 2023-12-19T16:18:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4337fe640 1 -- 172.21.15.119:0/3822366846 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb43401a020 con 0x7fb43c1582d0 2023-12-19T16:18:01.091 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb41c065a60 msgr2=0x7fb41c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb41c065a60 0x7fb41c067f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb42c007fd0 tx=0x7fb42c009040 comp rx=0 tx=0).stop 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 msgr2=0x7fb43c0ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 0x7fb43c0ae8d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb43400cef0 tx=0x7fb43400a710 comp rx=0 tx=0).stop 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 shutdown_connections 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb41c065a60 0x7fb41c067f20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb43c1582d0 0x7fb43c0ae8d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c0ce3b0 0x7fb43c1496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 --2- 172.21.15.119:0/3822366846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c070820 0x7fb43c14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 >> 172.21.15.119:0/3822366846 conn(0x7fb43c06a2a0 msgr2=0x7fb43c0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 shutdown_connections 2023-12-19T16:18:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.087+0000 7fb4411db640 1 -- 172.21.15.119:0/3822366846 wait complete. 2023-12-19T16:18:01.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.247+0000 7f870e198640 1 Processor -- start 2023-12-19T16:18:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.247+0000 7f870e198640 1 -- start start 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f870e198640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8708153020 0x7f87080c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f870e198640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87081598d0 0x7f87080ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f870e198640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87080ce8d0 0x7f8708070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f870e198640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080ced60 con 0x7f8708153020 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f870e198640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080c9730 con 0x7f87081598d0 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f870e198640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87080c8e00 con 0x7f87080ce8d0 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8708153020 0x7f87080c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8708153020 0x7f87080c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56562/0 (socket says 172.21.15.119:56562) 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 -- 172.21.15.119:0/3296685395 learned_addr learned my addr 172.21.15.119:0/3296685395 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f8706ffd640 1 --2- 172.21.15.119:0/3296685395 >> v2:172.21.15.143:3300/0 conn(0x7f87081598d0 0x7f87080ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f8707fff640 1 --2- 172.21.15.119:0/3296685395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87080ce8d0 0x7f8708070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 -- 172.21.15.119:0/3296685395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87080ce8d0 msgr2=0x7f8708070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 --2- 172.21.15.119:0/3296685395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87080ce8d0 0x7f8708070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 -- 172.21.15.119:0/3296685395 >> v2:172.21.15.143:3300/0 conn(0x7f87081598d0 msgr2=0x7f87080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 --2- 172.21.15.119:0/3296685395 >> v2:172.21.15.143:3300/0 conn(0x7f87081598d0 0x7f87080ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f87077fe640 1 -- 172.21.15.119:0/3296685395 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080c90e0 con 0x7f8708153020 2023-12-19T16:18:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.251+0000 7f8706ffd640 1 --2- 172.21.15.119:0/3296685395 >> v2:172.21.15.143:3300/0 conn(0x7f87081598d0 0x7f87080ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f87077fe640 1 --2- 172.21.15.119:0/3296685395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8708153020 0x7f87080c9bc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f87080ce340 tx=0x7f86f801d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0de2c8d5109129c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f87067fc640 1 -- 172.21.15.119:0/3296685395 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80a67d0 con 0x7f8708153020 2023-12-19T16:18:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f87067fc640 1 -- 172.21.15.119:0/3296685395 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f80a6930 con 0x7f8708153020 2023-12-19T16:18:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f87067fc640 1 -- 172.21.15.119:0/3296685395 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80a6cc0 con 0x7f8708153020 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 -- 172.21.15.119:0/3296685395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8708153020 msgr2=0x7f87080c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 --2- 172.21.15.119:0/3296685395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8708153020 0x7f87080c9bc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f87080ce340 tx=0x7f86f801d780 comp rx=0 tx=0).stop 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 -- 172.21.15.119:0/3296685395 shutdown_connections 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 --2- 172.21.15.119:0/3296685395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87080ce8d0 0x7f8708070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 --2- 172.21.15.119:0/3296685395 >> v2:172.21.15.143:3300/0 conn(0x7f87081598d0 0x7f87080ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 --2- 172.21.15.119:0/3296685395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8708153020 0x7f87080c9bc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 -- 172.21.15.119:0/3296685395 >> 172.21.15.119:0/3296685395 conn(0x7f870806a2a0 msgr2=0x7f87080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 -- 172.21.15.119:0/3296685395 shutdown_connections 2023-12-19T16:18:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 -- 172.21.15.119:0/3296685395 wait complete. 2023-12-19T16:18:01.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 Processor -- start 2023-12-19T16:18:01.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.255+0000 7f870e198640 1 -- start start 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 0x7f870814fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8708153020 0x7f87080b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87081598d0 0x7f87080b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87080b39f0 con 0x7f87080ce8d0 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87080b1220 con 0x7f87081598d0 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87080b1500 con 0x7f8708153020 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 0x7f870814fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 0x7f870814fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56572/0 (socket says 172.21.15.119:56572) 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 -- 172.21.15.119:0/3716339751 learned_addr learned my addr 172.21.15.119:0/3716339751 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:01.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f8706ffd640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8708153020 0x7f87080b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f8707fff640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87081598d0 0x7f87080b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 -- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8708153020 msgr2=0x7f87080b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8708153020 0x7f87080b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 -- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87081598d0 msgr2=0x7f87080b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87081598d0 0x7f87080b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 -- 172.21.15.119:0/3716339751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f800a670 con 0x7f87080ce8d0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f8707fff640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87081598d0 0x7f87080b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f8706ffd640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8708153020 0x7f87080b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f87077fe640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 0x7f870814fd70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f86f800a1c0 tx=0x7f86f801a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80ae910 con 0x7f87080ce8d0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f80aea70 con 0x7f87080ce8d0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87080b17e0 con 0x7f87080ce8d0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80aee20 con 0x7f87080ce8d0 2023-12-19T16:18:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87080b1da0 con 0x7f87080ce8d0 2023-12-19T16:18:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87080b1f90 con 0x7f87080ce8d0 2023-12-19T16:18:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.259+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86f80b9480 con 0x7f87080ce8d0 2023-12-19T16:18:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.263+0000 7f86effff640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86f4065a60 0x7f86f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.263+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f86f811e1e0 con 0x7f87080ce8d0 2023-12-19T16:18:01.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.263+0000 7f8706ffd640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86f4065a60 0x7f86f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.263+0000 7f8706ffd640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86f4065a60 0x7f86f4067f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87080ce280 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.267+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86f80eb9c0 con 0x7f87080ce8d0 2023-12-19T16:18:01.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.415+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f870804e000 con 0x7f87080ce8d0 2023-12-19T16:18:01.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f86effff640 1 -- 172.21.15.119:0/3716339751 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86f80b3020 con 0x7f87080ce8d0 2023-12-19T16:18:01.421 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:18:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86f4065a60 msgr2=0x7f86f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86f4065a60 0x7f86f4067f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87080ce280 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2023-12-19T16:18:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 msgr2=0x7f870814fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 0x7f870814fd70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f86f800a1c0 tx=0x7f86f801a520 comp rx=0 tx=0).stop 2023-12-19T16:18:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 shutdown_connections 2023-12-19T16:18:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f86f4065a60 0x7f86f4067f20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87081598d0 0x7f87080b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8708153020 0x7f87080b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 --2- 172.21.15.119:0/3716339751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87080ce8d0 0x7f870814fd70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 >> 172.21.15.119:0/3716339751 conn(0x7f870806a2a0 msgr2=0x7f870815b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 shutdown_connections 2023-12-19T16:18:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.419+0000 7f870e198640 1 -- 172.21.15.119:0/3716339751 wait complete. 2023-12-19T16:18:01.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:18:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.575+0000 7f744c295640 1 Processor -- start 2023-12-19T16:18:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.575+0000 7f744c295640 1 -- start start 2023-12-19T16:18:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744c295640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 0x7f74440c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744c295640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74440c9460 con 0x7f74441570c0 2023-12-19T16:18:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744c295640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74441574a0 con 0x7f74440c9e30 2023-12-19T16:18:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744c295640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440c8b30 con 0x7f744406c4f0 2023-12-19T16:18:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a031640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f74441570c0 0x7f744406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53524/0 (socket says 172.21.15.119:53524) 2023-12-19T16:18:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a031640 1 -- 172.21.15.119:0/2236182316 learned_addr learned my addr 172.21.15.119:0/2236182316 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f7449830640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 0x7f74440c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537455344 0 0) 0x7f74440c9460 con 0x7f74441570c0 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7430005740 con 0x7f74441570c0 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159115342 0 0) 0x7f74441574a0 con 0x7f74440c9e30 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74440c9460 con 0x7f74440c9e30 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3546828682 0 0) 0x7f7430005740 con 0x7f74441570c0 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 msgr2=0x7f74440c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 0x7f74440c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 >> v1:172.21.15.143:6789/0 conn(0x7f74440c9e30 legacy=0x7f7444070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440c8e10 con 0x7f74441570c0 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f7440001680 con 0x7f74441570c0 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 >> v1:172.21.15.119:6789/0 conn(0x7f74441570c0 legacy=0x7f744406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7430005d50 0x7f7430006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 0x7f74300069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430006f20 0x7f74300073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440c8b30 con 0x7f7430006f20 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743000dca0 con 0x7f7430005d50 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743000de60 con 0x7f744406c4f0 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a832640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430006f20 0x7f74300073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a031640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7430005d50 0x7f7430006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f7449830640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 0x7f74300069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a832640 1 -- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 msgr2=0x7f74300069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a832640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f744406c4f0 0x7f74300069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a832640 1 -- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7430005d50 msgr2=0x7f7430006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a832640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7430005d50 0x7f7430006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.579+0000 7f744a832640 1 -- 172.21.15.119:0/2236182316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430005740 con 0x7f7430006f20 2023-12-19T16:18:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744a832640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430006f20 0x7f74300073a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f743c001fd0 tx=0x7f743c01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c40038eec695f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0a8c70 con 0x7f7430006f20 2023-12-19T16:18:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c0a8df0 con 0x7f7430006f20 2023-12-19T16:18:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744902f640 1 -- 172.21.15.119:0/2236182316 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c003bc0 con 0x7f7430006f20 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744c295640 1 -- 172.21.15.119:0/2236182316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430006f20 msgr2=0x7f74300073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744c295640 1 --2- 172.21.15.119:0/2236182316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430006f20 0x7f74300073a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f743c001fd0 tx=0x7f743c01f050 comp rx=0 tx=0).stop 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744a832640 1 -- 172.21.15.119:0/2236182316 reap_dead start 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744c295640 1 -- 172.21.15.119:0/2236182316 shutdown_connections 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744c295640 1 -- 172.21.15.119:0/2236182316 >> 172.21.15.119:0/2236182316 conn(0x7f744406a3e0 msgr2=0x7f74440afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744c295640 1 -- 172.21.15.119:0/2236182316 shutdown_connections 2023-12-19T16:18:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.583+0000 7f744c295640 1 -- 172.21.15.119:0/2236182316 wait complete. 2023-12-19T16:18:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 Processor -- start 2023-12-19T16:18:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 -- start start 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7430006f20 0x7f744414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 0x7f74440c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74440ccdf0 0x7f74440cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440cd7b0 con 0x7f74441586e0 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744415a230 con 0x7f74440ccdf0 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7444158250 con 0x7f7430006f20 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 0x7f74440c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 0x7f74440c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56592/0 (socket says 172.21.15.119:56592) 2023-12-19T16:18:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 -- 172.21.15.119:0/170841424 learned_addr learned my addr 172.21.15.119:0/170841424 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744a031640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7430006f20 0x7f744414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744a832640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74440ccdf0 0x7f74440cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 -- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7430006f20 msgr2=0x7f744414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7430006f20 0x7f744414a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 -- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74440ccdf0 msgr2=0x7f74440cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74440ccdf0 0x7f74440cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 -- 172.21.15.119:0/170841424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7444157640 con 0x7f74441586e0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744a832640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74440ccdf0 0x7f74440cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f7449830640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 0x7f74440c7e80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f74340119d0 tx=0x7f7434011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400fb50 con 0x7f74441586e0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743400fcb0 con 0x7f74441586e0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434014440 con 0x7f74441586e0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7444157920 con 0x7f74441586e0 2023-12-19T16:18:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.587+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7444157ee0 con 0x7f74441586e0 2023-12-19T16:18:01.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.591+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74440735b0 con 0x7f74441586e0 2023-12-19T16:18:01.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.591+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74340145a0 con 0x7f74441586e0 2023-12-19T16:18:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.591+0000 7f743affd640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7428065a60 0x7f7428067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.591+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7434083af0 con 0x7f74441586e0 2023-12-19T16:18:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.591+0000 7f744a031640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7428065a60 0x7f7428067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.591+0000 7f744a031640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7428065a60 0x7f7428067f20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7440001210 tx=0x7f7440001e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.595+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7434051420 con 0x7f74441586e0 2023-12-19T16:18:01.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74441583c0 con 0x7f74441586e0 2023-12-19T16:18:01.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f743affd640 1 -- 172.21.15.119:0/170841424 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7434022080 con 0x7f74441586e0 2023-12-19T16:18:01.762 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:18:01.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7428065a60 msgr2=0x7f7428067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7428065a60 0x7f7428067f20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7440001210 tx=0x7f7440001e00 comp rx=0 tx=0).stop 2023-12-19T16:18:01.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 msgr2=0x7f74440c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 0x7f74440c7e80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f74340119d0 tx=0x7f7434011e90 comp rx=0 tx=0).stop 2023-12-19T16:18:01.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 shutdown_connections 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7428065a60 0x7f7428067f20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74440ccdf0 0x7f74440cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74441586e0 0x7f74440c7e80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 --2- 172.21.15.119:0/170841424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7430006f20 0x7f744414a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 >> 172.21.15.119:0/170841424 conn(0x7f744406a3e0 msgr2=0x7f74440c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 shutdown_connections 2023-12-19T16:18:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.759+0000 7f744c295640 1 -- 172.21.15.119:0/170841424 wait complete. 2023-12-19T16:18:01.783 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:01.783 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:01.792 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:01.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.963+0000 7ff9c07c0640 1 Processor -- start 2023-12-19T16:18:01.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9c07c0640 1 -- start start 2023-12-19T16:18:01.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9c07c0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff9b8070510 0x7ff9b8158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9c07c0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 0x7ff9b80caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9c07c0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b80cb440 con 0x7ff9b815c800 2023-12-19T16:18:01.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9c07c0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b80709a0 con 0x7ff9b8070510 2023-12-19T16:18:01.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9c07c0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80b0cb0 con 0x7ff9b80caa70 2023-12-19T16:18:01.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 0x7ff9b80caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bdd5b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff9b8070510 0x7ff9b8158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 0x7ff9b80caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:46338/0 (socket says 172.21.15.119:46338) 2023-12-19T16:18:01.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 -- 172.21.15.119:0/3978439233 learned_addr learned my addr 172.21.15.119:0/3978439233 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:01.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 -- 172.21.15.119:0/3978439233 >> v2:172.21.15.143:3300/0 conn(0x7ff9b8070510 msgr2=0x7ff9b8158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:01.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 --2- 172.21.15.119:0/3978439233 >> v2:172.21.15.143:3300/0 conn(0x7ff9b8070510 0x7ff9b8158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 -- 172.21.15.119:0/3978439233 >> v1:172.21.15.143:6789/0 conn(0x7ff9b815c800 legacy=0x7ff9b80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.967+0000 7ff9bed5d640 1 -- 172.21.15.119:0/3978439233 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8070b80 con 0x7ff9b80caa70 2023-12-19T16:18:01.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9bed5d640 1 --2- 172.21.15.119:0/3978439233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 0x7ff9b80caf00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009e50 tx=0x7ff9b001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753706a20a4e914e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9bd55a640 1 -- 172.21.15.119:0/3978439233 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00a58e0 con 0x7ff9b80caa70 2023-12-19T16:18:01.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9bd55a640 1 -- 172.21.15.119:0/3978439233 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b00a5a40 con 0x7ff9b80caa70 2023-12-19T16:18:01.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9bd55a640 1 -- 172.21.15.119:0/3978439233 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00a5dd0 con 0x7ff9b80caa70 2023-12-19T16:18:01.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 -- 172.21.15.119:0/3978439233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 msgr2=0x7ff9b80caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/3978439233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 0x7ff9b80caf00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009e50 tx=0x7ff9b001ca10 comp rx=0 tx=0).stop 2023-12-19T16:18:01.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 -- 172.21.15.119:0/3978439233 shutdown_connections 2023-12-19T16:18:01.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/3978439233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b80caa70 0x7ff9b80caf00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/3978439233 >> v2:172.21.15.143:3300/0 conn(0x7ff9b8070510 0x7ff9b8158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 -- 172.21.15.119:0/3978439233 >> 172.21.15.119:0/3978439233 conn(0x7ff9b806a3e0 msgr2=0x7ff9b80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:01.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 -- 172.21.15.119:0/3978439233 shutdown_connections 2023-12-19T16:18:01.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 -- 172.21.15.119:0/3978439233 wait complete. 2023-12-19T16:18:01.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.971+0000 7ff9c07c0640 1 Processor -- start 2023-12-19T16:18:01.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- start start 2023-12-19T16:18:01.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 0x7ff9b815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b80caa70 0x7ff9b814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b815c800 0x7ff9b815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b815ab30 con 0x7ff9b8070510 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b815ae10 con 0x7ff9b80caa70 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b815b0f0 con 0x7ff9b815c800 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 0x7ff9b815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 0x7ff9b815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56604/0 (socket says 172.21.15.119:56604) 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 -- 172.21.15.119:0/943783182 learned_addr learned my addr 172.21.15.119:0/943783182 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9bdd5b640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b80caa70 0x7ff9b814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9bed5d640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b815c800 0x7ff9b815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 -- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b815c800 msgr2=0x7ff9b815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b815c800 0x7ff9b815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 -- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b80caa70 msgr2=0x7ff9b814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:01.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b80caa70 0x7ff9b814efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:01.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 -- 172.21.15.119:0/943783182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0009b30 con 0x7ff9b8070510 2023-12-19T16:18:01.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9be55c640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 0x7ff9b815a4a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c3c0 tx=0x7ff9b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40052d0 con 0x7ff9b8070510 2023-12-19T16:18:01.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4005430 con 0x7ff9b8070510 2023-12-19T16:18:01.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b815b3d0 con 0x7ff9b8070510 2023-12-19T16:18:01.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4003840 con 0x7ff9b8070510 2023-12-19T16:18:01.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b814fe90 con 0x7ff9b8070510 2023-12-19T16:18:01.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.975+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80735b0 con 0x7ff9b8070510 2023-12-19T16:18:01.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.979+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9b40039a0 con 0x7ff9b8070510 2023-12-19T16:18:01.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.979+0000 7ff9aeffd640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff99c065a60 0x7ff99c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:01.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.979+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff9b4082800 con 0x7ff9b8070510 2023-12-19T16:18:01.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.979+0000 7ff9bdd5b640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff99c065a60 0x7ff99c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:01.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.979+0000 7ff9bdd5b640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff99c065a60 0x7ff99c067f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff9b815a430 tx=0x7ff9a8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:01.986 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:01.983+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9b4050090 con 0x7ff9b8070510 2023-12-19T16:18:02.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.131+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b804e000 con 0x7ff9b8070510 2023-12-19T16:18:02.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9aeffd640 1 -- 172.21.15.119:0/943783182 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7ff9b40536b0 con 0x7ff9b8070510 2023-12-19T16:18:02.138 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:02.139 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:02.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff99c065a60 msgr2=0x7ff99c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff99c065a60 0x7ff99c067f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff9b815a430 tx=0x7ff9a8009190 comp rx=0 tx=0).stop 2023-12-19T16:18:02.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 msgr2=0x7ff9b815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 0x7ff9b815a4a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c3c0 tx=0x7ff9b400c880 comp rx=0 tx=0).stop 2023-12-19T16:18:02.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 shutdown_connections 2023-12-19T16:18:02.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff99c065a60 0x7ff99c067f20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b80caa70 0x7ff9b814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b815c800 0x7ff9b815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 --2- 172.21.15.119:0/943783182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8070510 0x7ff9b815a4a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 >> 172.21.15.119:0/943783182 conn(0x7ff9b806a3e0 msgr2=0x7ff9b81559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 shutdown_connections 2023-12-19T16:18:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.135+0000 7ff9c07c0640 1 -- 172.21.15.119:0/943783182 wait complete. 2023-12-19T16:18:02.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:49.778202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:51.022485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:02.159 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:02.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.295+0000 7f72b1534640 1 Processor -- start 2023-12-19T16:18:02.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.295+0000 7f72b1534640 1 -- start start 2023-12-19T16:18:02.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72b1534640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f72ac158a30 0x7f72ac070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72b1534640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72ac071400 0x7f72ac0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72b1534640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac15d5f0 con 0x7f72ac0c8d20 2023-12-19T16:18:02.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72b1534640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac0c9190 con 0x7f72ac071400 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72b1534640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac15d310 con 0x7f72ac158a30 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72ac071400 0x7f72ac0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72ac071400 0x7f72ac0c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56610/0 (socket says 172.21.15.119:56610) 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 -- 172.21.15.119:0/2122449366 learned_addr learned my addr 172.21.15.119:0/2122449366 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72abfff640 1 --2- 172.21.15.119:0/2122449366 >> v2:172.21.15.143:3300/0 conn(0x7f72ac158a30 0x7f72ac070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 -- 172.21.15.119:0/2122449366 >> v2:172.21.15.143:3300/0 conn(0x7f72ac158a30 msgr2=0x7f72ac070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 --2- 172.21.15.119:0/2122449366 >> v2:172.21.15.143:3300/0 conn(0x7f72ac158a30 0x7f72ac070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 -- 172.21.15.119:0/2122449366 >> v1:172.21.15.143:6789/0 conn(0x7f72ac0c8d20 legacy=0x7f72ac0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72ab7fe640 1 -- 172.21.15.119:0/2122449366 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0703e0 con 0x7f72ac071400 2023-12-19T16:18:02.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.299+0000 7f72abfff640 1 --2- 172.21.15.119:0/2122449366 >> v2:172.21.15.143:3300/0 conn(0x7f72ac158a30 0x7f72ac070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:02.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72ab7fe640 1 --2- 172.21.15.119:0/2122449366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac071400 0x7f72ac0c87e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f72ac06ab00 tx=0x7f72a001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abec2ce78d422ef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72aaffd640 1 -- 172.21.15.119:0/2122449366 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00aa620 con 0x7f72ac071400 2023-12-19T16:18:02.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72aaffd640 1 -- 172.21.15.119:0/2122449366 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a00aa780 con 0x7f72ac071400 2023-12-19T16:18:02.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72aaffd640 1 -- 172.21.15.119:0/2122449366 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00aab10 con 0x7f72ac071400 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 -- 172.21.15.119:0/2122449366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac071400 msgr2=0x7f72ac0c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 --2- 172.21.15.119:0/2122449366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac071400 0x7f72ac0c87e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f72ac06ab00 tx=0x7f72a001c4c0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 -- 172.21.15.119:0/2122449366 shutdown_connections 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 --2- 172.21.15.119:0/2122449366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac071400 0x7f72ac0c87e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 --2- 172.21.15.119:0/2122449366 >> v2:172.21.15.143:3300/0 conn(0x7f72ac158a30 0x7f72ac070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 -- 172.21.15.119:0/2122449366 >> 172.21.15.119:0/2122449366 conn(0x7f72ac06a2a0 msgr2=0x7f72ac0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 -- 172.21.15.119:0/2122449366 shutdown_connections 2023-12-19T16:18:02.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 -- 172.21.15.119:0/2122449366 wait complete. 2023-12-19T16:18:02.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 Processor -- start 2023-12-19T16:18:02.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.303+0000 7f72b1534640 1 -- start start 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 0x7f72ac1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72ac158a30 0x7f72ac14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72ac14a5e0 0x7f72ac1f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac14f7b0 con 0x7f72ac0c8d20 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac14e5b0 con 0x7f72ac158a30 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac14ed80 con 0x7f72ac14a5e0 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 0x7f72ac1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 0x7f72ac1f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56626/0 (socket says 172.21.15.119:56626) 2023-12-19T16:18:02.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 -- 172.21.15.119:0/1037279228 learned_addr learned my addr 172.21.15.119:0/1037279228 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72ab7fe640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72ac158a30 0x7f72ac14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b0d33640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72ac14a5e0 0x7f72ac1f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 -- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72ac14a5e0 msgr2=0x7f72ac1f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72ac14a5e0 0x7f72ac1f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 -- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72ac158a30 msgr2=0x7f72ac14efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72ac158a30 0x7f72ac14efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 -- 172.21.15.119:0/1037279228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a00094d0 con 0x7f72ac0c8d20 2023-12-19T16:18:02.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72abfff640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 0x7f72ac1f59f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f729c00c7c0 tx=0x7f729c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c007a30 con 0x7f72ac0c8d20 2023-12-19T16:18:02.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c007b90 con 0x7f72ac0c8d20 2023-12-19T16:18:02.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00ce70 con 0x7f72ac0c8d20 2023-12-19T16:18:02.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac14f4e0 con 0x7f72ac0c8d20 2023-12-19T16:18:02.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac14eaa0 con 0x7f72ac0c8d20 2023-12-19T16:18:02.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac04e850 con 0x7f72ac0c8d20 2023-12-19T16:18:02.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.307+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f729c0113f0 con 0x7f72ac0c8d20 2023-12-19T16:18:02.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.311+0000 7f72a8ff9640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7298065a60 0x7f7298067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.311+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f729c083700 con 0x7f72ac0c8d20 2023-12-19T16:18:02.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.311+0000 7f72ab7fe640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7298065a60 0x7f7298067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.311+0000 7f72ab7fe640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7298065a60 0x7f7298067f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f72a00ae000 tx=0x7f72a00b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.317 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.315+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f729c051020 con 0x7f72ac0c8d20 2023-12-19T16:18:02.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.463+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72ac0b4110 con 0x7f72ac0c8d20 2023-12-19T16:18:02.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.463+0000 7f72a8ff9640 1 -- 172.21.15.119:0/1037279228 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f729c054640 con 0x7f72ac0c8d20 2023-12-19T16:18:02.467 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:18:02.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7298065a60 msgr2=0x7f7298067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7298065a60 0x7f7298067f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f72a00ae000 tx=0x7f72a00b5040 comp rx=0 tx=0).stop 2023-12-19T16:18:02.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 msgr2=0x7f72ac1f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 0x7f72ac1f59f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f729c00c7c0 tx=0x7f729c00cc80 comp rx=0 tx=0).stop 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 shutdown_connections 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7298065a60 0x7f7298067f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72ac158a30 0x7f72ac14efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72ac14a5e0 0x7f72ac1f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 --2- 172.21.15.119:0/1037279228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72ac0c8d20 0x7f72ac1f59f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 >> 172.21.15.119:0/1037279228 conn(0x7f72ac06a2a0 msgr2=0x7f72ac156030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 shutdown_connections 2023-12-19T16:18:02.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.467+0000 7f72b1534640 1 -- 172.21.15.119:0/1037279228 wait complete. 2023-12-19T16:18:02.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:02.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 Processor -- start 2023-12-19T16:18:02.631 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 -- start start 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8f415cae0 0x7fe8f40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe8f40cf880 0x7fe8f40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f415cec0 con 0x7fe8f40cde90 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40d0530 con 0x7fe8f415cae0 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8fafe9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40d0810 con 0x7fe8f40cf880 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8f415cae0 0x7fe8f40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8f415cae0 0x7fe8f40d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52148/0 (socket says 172.21.15.119:52148) 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8ebfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe8f40cde90 0x7fe8f40cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33042/0 (socket says 172.21.15.119:33042) 2023-12-19T16:18:02.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 -- 172.21.15.119:0/1449879542 learned_addr learned my addr 172.21.15.119:0/1449879542 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:02.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f9586640 1 --2- 172.21.15.119:0/1449879542 >> v2:172.21.15.143:3300/0 conn(0x7fe8f40cf880 0x7fe8f40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 -- 172.21.15.119:0/1449879542 >> v2:172.21.15.143:3300/0 conn(0x7fe8f40cf880 msgr2=0x7fe8f40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:02.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 --2- 172.21.15.119:0/1449879542 >> v2:172.21.15.143:3300/0 conn(0x7fe8f40cf880 0x7fe8f40ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 -- 172.21.15.119:0/1449879542 >> v1:172.21.15.119:6789/0 conn(0x7fe8f40cde90 legacy=0x7fe8f40cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.627+0000 7fe8f8d85640 1 -- 172.21.15.119:0/1449879542 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f40d0af0 con 0x7fe8f415cae0 2023-12-19T16:18:02.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8f8d85640 1 --2- 172.21.15.119:0/1449879542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40d12f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe8f408bf80 tx=0x7fe8f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4263aae6317ac0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8eb7fe640 1 -- 172.21.15.119:0/1449879542 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00ab660 con 0x7fe8f415cae0 2023-12-19T16:18:02.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8eb7fe640 1 -- 172.21.15.119:0/1449879542 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f00ab7c0 con 0x7fe8f415cae0 2023-12-19T16:18:02.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8eb7fe640 1 -- 172.21.15.119:0/1449879542 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00abb50 con 0x7fe8f415cae0 2023-12-19T16:18:02.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 -- 172.21.15.119:0/1449879542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 msgr2=0x7fe8f40d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/1449879542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40d12f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe8f408bf80 tx=0x7fe8f001c4d0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 -- 172.21.15.119:0/1449879542 shutdown_connections 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/1449879542 >> v2:172.21.15.143:3300/0 conn(0x7fe8f40cf880 0x7fe8f40ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/1449879542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40d12f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 -- 172.21.15.119:0/1449879542 >> 172.21.15.119:0/1449879542 conn(0x7fe8f4089fb0 msgr2=0x7fe8f40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 -- 172.21.15.119:0/1449879542 shutdown_connections 2023-12-19T16:18:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.631+0000 7fe8fafe9640 1 -- 172.21.15.119:0/1449879542 wait complete. 2023-12-19T16:18:02.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 Processor -- start 2023-12-19T16:18:02.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 -- start start 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8f40cde90 0x7fe8f40b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8f40cf880 0x7fe8f4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40b74e0 con 0x7fe8f415cae0 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40b68d0 con 0x7fe8f40cde90 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40b6bb0 con 0x7fe8f40cf880 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52152/0 (socket says 172.21.15.119:52152) 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 -- 172.21.15.119:0/2598629697 learned_addr learned my addr 172.21.15.119:0/2598629697 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f8d85640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8f40cde90 0x7fe8f40b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8ebfff640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8f40cf880 0x7fe8f4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 -- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8f40cf880 msgr2=0x7fe8f4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8f40cf880 0x7fe8f4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 -- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8f40cde90 msgr2=0x7fe8f40b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8f40cde90 0x7fe8f40b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 -- 172.21.15.119:0/2598629697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009480 con 0x7fe8f415cae0 2023-12-19T16:18:02.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8ebfff640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8f40cf880 0x7fe8f4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:02.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8f9586640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40c63d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007d40 tx=0x7fe8ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec014420 con 0x7fe8f415cae0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0145a0 con 0x7fe8f415cae0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f40b6e90 con 0x7fe8f415cae0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec014950 con 0x7fe8f415cae0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.635+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f40b7eb0 con 0x7fe8f415cae0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.639+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f40b7650 con 0x7fe8f415cae0 2023-12-19T16:18:02.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.639+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8ec014ab0 con 0x7fe8f415cae0 2023-12-19T16:18:02.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.639+0000 7fe8e97fa640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8e0065a60 0x7fe8e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.639+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe8ec083ae0 con 0x7fe8f415cae0 2023-12-19T16:18:02.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.639+0000 7fe8f8d85640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8e0065a60 0x7fe8e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.639+0000 7fe8f8d85640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8e0065a60 0x7fe8e0067f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00af000 tx=0x7fe8f00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.643+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe8ec051360 con 0x7fe8f415cae0 2023-12-19T16:18:02.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8f404e000 con 0x7fe8f415cae0 2023-12-19T16:18:02.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8e97fa640 1 -- 172.21.15.119:0/2598629697 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8ec054980 con 0x7fe8f415cae0 2023-12-19T16:18:02.798 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:18:02.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8e0065a60 msgr2=0x7fe8e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8e0065a60 0x7fe8e0067f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00af000 tx=0x7fe8f00a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:02.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 msgr2=0x7fe8f40c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40c63d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007d40 tx=0x7fe8ec00e4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 shutdown_connections 2023-12-19T16:18:02.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe8e0065a60 0x7fe8e0067f20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8f415cae0 0x7fe8f40c63d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8f40cf880 0x7fe8f4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 --2- 172.21.15.119:0/2598629697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8f40cde90 0x7fe8f40b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 >> 172.21.15.119:0/2598629697 conn(0x7fe8f4089fb0 msgr2=0x7fe8f40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:02.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 shutdown_connections 2023-12-19T16:18:02.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.795+0000 7fe8fafe9640 1 -- 172.21.15.119:0/2598629697 wait complete. 2023-12-19T16:18:02.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:02.959 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f374acc4640 1 Processor -- start 2023-12-19T16:18:02.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f374acc4640 1 -- start start 2023-12-19T16:18:02.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f374acc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37440cc700 0x7f3744071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.960 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f374acc4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3744070df0 con 0x7f37440ca410 2023-12-19T16:18:02.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f374acc4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374415a4f0 con 0x7f3744071870 2023-12-19T16:18:02.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f374acc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374415aab0 con 0x7f37440cc700 2023-12-19T16:18:02.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f3748a60640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f37440ca410 0x7f3744159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33052/0 (socket says 172.21.15.119:33052) 2023-12-19T16:18:02.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f3748a60640 1 -- 172.21.15.119:0/1459368871 learned_addr learned my addr 172.21.15.119:0/1459368871 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:02.961 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.955+0000 7f3749261640 1 --2- 172.21.15.119:0/1459368871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37440cc700 0x7f3744071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f373b7fe640 1 -- 172.21.15.119:0/1459368871 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668960033 0 0) 0x7f3744070df0 con 0x7f37440ca410 2023-12-19T16:18:02.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f373b7fe640 1 -- 172.21.15.119:0/1459368871 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c003530 con 0x7f37440ca410 2023-12-19T16:18:02.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f373b7fe640 1 -- 172.21.15.119:0/1459368871 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742631542 0 0) 0x7f374415a4f0 con 0x7f3744071870 2023-12-19T16:18:02.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f3749261640 1 -- 172.21.15.119:0/1459368871 >> v1:172.21.15.143:6789/0 conn(0x7f3744071870 legacy=0x7f37440cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f3749261640 1 -- 172.21.15.119:0/1459368871 >> v1:172.21.15.119:6789/0 conn(0x7f37440ca410 legacy=0x7f3744159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f3749261640 1 -- 172.21.15.119:0/1459368871 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374415a7d0 con 0x7f37440cc700 2023-12-19T16:18:02.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f3749261640 1 --2- 172.21.15.119:0/1459368871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37440cc700 0x7f3744071d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f373c009dc0 tx=0x7f373c01c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f94f42eda02cf4aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f373b7fe640 1 -- 172.21.15.119:0/1459368871 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740001680 con 0x7f37440cc700 2023-12-19T16:18:02.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f373b7fe640 1 -- 172.21.15.119:0/1459368871 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c0a5600 con 0x7f37440cc700 2023-12-19T16:18:02.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.959+0000 7f373b7fe640 1 -- 172.21.15.119:0/1459368871 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0a5970 con 0x7f37440cc700 2023-12-19T16:18:02.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- 172.21.15.119:0/1459368871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37440cc700 msgr2=0x7f3744071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 --2- 172.21.15.119:0/1459368871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37440cc700 0x7f3744071d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f373c009dc0 tx=0x7f373c01c780 comp rx=0 tx=0).stop 2023-12-19T16:18:02.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- 172.21.15.119:0/1459368871 shutdown_connections 2023-12-19T16:18:02.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 --2- 172.21.15.119:0/1459368871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37440cc700 0x7f3744071d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- 172.21.15.119:0/1459368871 >> 172.21.15.119:0/1459368871 conn(0x7f374406a2a0 msgr2=0x7f37440aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:02.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- 172.21.15.119:0/1459368871 shutdown_connections 2023-12-19T16:18:02.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- 172.21.15.119:0/1459368871 wait complete. 2023-12-19T16:18:02.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 Processor -- start 2023-12-19T16:18:02.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- start start 2023-12-19T16:18:02.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3744071870 0x7f37440a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 0x7f3744155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3744155e70 0x7f37440c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441562e0 con 0x7f37440ca410 2023-12-19T16:18:02.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374414c390 con 0x7f3744071870 2023-12-19T16:18:02.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f374acc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37441554a0 con 0x7f3744155e70 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f373bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 0x7f3744155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f373bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 0x7f3744155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52162/0 (socket says 172.21.15.119:52162) 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f373bfff640 1 -- 172.21.15.119:0/2615101565 learned_addr learned my addr 172.21.15.119:0/2615101565 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f3749261640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3744155e70 0x7f37440c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.963+0000 7f3748a60640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3744071870 0x7f37440a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f373bfff640 1 -- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3744155e70 msgr2=0x7f37440c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f373bfff640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3744155e70 0x7f37440c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f373bfff640 1 -- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3744071870 msgr2=0x7f37440a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f373bfff640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3744071870 0x7f37440a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f373bfff640 1 -- 172.21.15.119:0/2615101565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c009a70 con 0x7f37440ca410 2023-12-19T16:18:02.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f373bfff640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 0x7f3744155930 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f373400c450 tx=0x7f373400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734005480 con 0x7f37440ca410 2023-12-19T16:18:02.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734003600 con 0x7f37440ca410 2023-12-19T16:18:02.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3744154890 con 0x7f37440ca410 2023-12-19T16:18:02.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340039b0 con 0x7f37440ca410 2023-12-19T16:18:02.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3744154e50 con 0x7f37440ca410 2023-12-19T16:18:02.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744155630 con 0x7f37440ca410 2023-12-19T16:18:02.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3734003b10 con 0x7f37440ca410 2023-12-19T16:18:02.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f37397fa640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3730065a60 0x7f3730067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:02.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3734082820 con 0x7f37440ca410 2023-12-19T16:18:02.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.967+0000 7f3748a60640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3730065a60 0x7f3730067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:02.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.971+0000 7f3748a60640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3730065a60 0x7f3730067f20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f37400016d0 tx=0x7f3740001620 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:02.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:02.971+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f37340500b0 con 0x7f37440ca410 2023-12-19T16:18:03.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f374404e000 con 0x7f37440ca410 2023-12-19T16:18:03.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f37397fa640 1 -- 172.21.15.119:0/2615101565 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37340170a0 con 0x7f37440ca410 2023-12-19T16:18:03.126 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:18:03.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3730065a60 msgr2=0x7f3730067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3730065a60 0x7f3730067f20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f37400016d0 tx=0x7f3740001620 comp rx=0 tx=0).stop 2023-12-19T16:18:03.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 msgr2=0x7f3744155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 0x7f3744155930 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f373400c450 tx=0x7f373400c910 comp rx=0 tx=0).stop 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 shutdown_connections 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3730065a60 0x7f3730067f20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3744155e70 0x7f37440c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37440ca410 0x7f3744155930 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 --2- 172.21.15.119:0/2615101565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3744071870 0x7f37440a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 >> 172.21.15.119:0/2615101565 conn(0x7f374406a2a0 msgr2=0x7f3744156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 shutdown_connections 2023-12-19T16:18:03.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.123+0000 7f374acc4640 1 -- 172.21.15.119:0/2615101565 wait complete. 2023-12-19T16:18:03.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:18:03.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.283+0000 7f3bc2c66640 1 Processor -- start 2023-12-19T16:18:03.288 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.283+0000 7f3bc2c66640 1 -- start start 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.283+0000 7f3bc2c66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15a680 0x7f3bbc15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.283+0000 7f3bc2c66640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3bbc0cac10 0x7f3bbc15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bc2c66640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc15f100 con 0x7f3bbc15afa0 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bc2c66640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0ca7d0 con 0x7f3bbc0cac10 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bc2c66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc15e860 con 0x7f3bbc15a680 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3bbc0cac10 0x7f3bbc15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3bbc0cac10 0x7f3bbc15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52172/0 (socket says 172.21.15.119:52172) 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 -- 172.21.15.119:0/3376720651 learned_addr learned my addr 172.21.15.119:0/3376720651 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bc0a02640 1 --2- 172.21.15.119:0/3376720651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15a680 0x7f3bbc15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 -- 172.21.15.119:0/3376720651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15a680 msgr2=0x7f3bbc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 --2- 172.21.15.119:0/3376720651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15a680 0x7f3bbc15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 -- 172.21.15.119:0/3376720651 >> v1:172.21.15.143:6789/0 conn(0x7f3bbc15afa0 legacy=0x7f3bbc06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:03.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 -- 172.21.15.119:0/3376720651 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc15eb40 con 0x7f3bbc0cac10 2023-12-19T16:18:03.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb3fff640 1 --2- 172.21.15.119:0/3376720651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc15aa60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf34a899d7bff7e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:03.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb37fe640 1 -- 172.21.15.119:0/3376720651 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0a7070 con 0x7f3bbc0cac10 2023-12-19T16:18:03.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.287+0000 7f3bb37fe640 1 -- 172.21.15.119:0/3376720651 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0ab430 con 0x7f3bbc0cac10 2023-12-19T16:18:03.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bb37fe640 1 -- 172.21.15.119:0/3376720651 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0ab7c0 con 0x7f3bbc0cac10 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- 172.21.15.119:0/3376720651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc0cac10 msgr2=0x7f3bbc15aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/3376720651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc15aa60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac01c470 comp rx=0 tx=0).stop 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- 172.21.15.119:0/3376720651 shutdown_connections 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/3376720651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc15aa60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/3376720651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15a680 0x7f3bbc15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- 172.21.15.119:0/3376720651 >> 172.21.15.119:0/3376720651 conn(0x7f3bbc06a3e0 msgr2=0x7f3bbc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- 172.21.15.119:0/3376720651 shutdown_connections 2023-12-19T16:18:03.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- 172.21.15.119:0/3376720651 wait complete. 2023-12-19T16:18:03.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 Processor -- start 2023-12-19T16:18:03.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- start start 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 0x7f3bbc0c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15afa0 0x7f3bbc0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1526b0 con 0x7f3bbc15a680 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c4d20 con 0x7f3bbc0cac10 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.291+0000 7f3bc2c66640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc151a30 con 0x7f3bbc15afa0 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 0x7f3bbc0c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 0x7f3bbc0c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52188/0 (socket says 172.21.15.119:52188) 2023-12-19T16:18:03.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 -- 172.21.15.119:0/35478458 learned_addr learned my addr 172.21.15.119:0/35478458 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:03.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bc0a02640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bc1203640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15afa0 0x7f3bbc0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 -- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15afa0 msgr2=0x7f3bbc0c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15afa0 0x7f3bbc0c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 -- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bbc0cac10 msgr2=0x7f3bbc0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc0c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 -- 172.21.15.119:0/35478458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0094d0 con 0x7f3bbc15a680 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb3fff640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 0x7f3bbc0c2880 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0ad040 tx=0x7f3bac019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0b4830 con 0x7f3bbc15a680 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0b49b0 con 0x7f3bbc15a680 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc151d10 con 0x7f3bbc15a680 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0b4d60 con 0x7f3bbc15a680 2023-12-19T16:18:03.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc1522d0 con 0x7f3bbc15a680 2023-12-19T16:18:03.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc0735b0 con 0x7f3bbc15a680 2023-12-19T16:18:03.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bac0c0460 con 0x7f3bbc15a680 2023-12-19T16:18:03.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.295+0000 7f3bb17fa640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ba8065a60 0x7f3ba8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.299+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3bac11d5d0 con 0x7f3bbc15a680 2023-12-19T16:18:03.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.299+0000 7f3bc0a02640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ba8065a60 0x7f3ba8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.299+0000 7f3bc0a02640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ba8065a60 0x7f3ba8067f20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800aae0 tx=0x7f3bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:03.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.299+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3bac0eb010 con 0x7f3bbc15a680 2023-12-19T16:18:03.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.463+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3bbc04e000 con 0x7f3bbc15a680 2023-12-19T16:18:03.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.463+0000 7f3bb17fa640 1 -- 172.21.15.119:0/35478458 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3bac0ee630 con 0x7f3bbc15a680 2023-12-19T16:18:03.468 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:18:03.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ba8065a60 msgr2=0x7f3ba8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ba8065a60 0x7f3ba8067f20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800aae0 tx=0x7f3bb8008040 comp rx=0 tx=0).stop 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 msgr2=0x7f3bbc0c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 0x7f3bbc0c2880 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0ad040 tx=0x7f3bac019210 comp rx=0 tx=0).stop 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 shutdown_connections 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3ba8065a60 0x7f3ba8067f20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bbc15afa0 0x7f3bbc0c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bbc15a680 0x7f3bbc0c2880 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 --2- 172.21.15.119:0/35478458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bbc0cac10 0x7f3bbc0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 >> 172.21.15.119:0/35478458 conn(0x7f3bbc06a3e0 msgr2=0x7f3bbc1563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 shutdown_connections 2023-12-19T16:18:03.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.467+0000 7f3bc2c66640 1 -- 172.21.15.119:0/35478458 wait complete. 2023-12-19T16:18:03.488 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:18:03.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:03.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:03.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[52324]: fuse finished with error 0 and tester_r 0 2023-12-19T16:18:03.511 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:03.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:18:03.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:03.558 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:18:03.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:18:03.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d710b640 1 Processor -- start 2023-12-19T16:18:03.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d710b640 1 -- start start 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d710b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3d00cea00 0x7fe3d00cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d710b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d015cb10 con 0x7fe3d00cd3a0 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d710b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00cd960 con 0x7fe3d015c730 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d710b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00cdc40 con 0x7fe3d00cea00 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d5908640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3d00cea00 0x7fe3d00cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d690a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe3d00cd3a0 0x7fe3d00b55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33066/0 (socket says 172.21.15.119:33066) 2023-12-19T16:18:03.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d690a640 1 -- 172.21.15.119:0/1470798318 learned_addr learned my addr 172.21.15.119:0/1470798318 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:03.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d5908640 1 -- 172.21.15.119:0/1470798318 >> v1:172.21.15.143:6789/0 conn(0x7fe3d015c730 legacy=0x7fe3d00b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d5908640 1 -- 172.21.15.119:0/1470798318 >> v1:172.21.15.119:6789/0 conn(0x7fe3d00cd3a0 legacy=0x7fe3d00b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d5908640 1 -- 172.21.15.119:0/1470798318 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00cdf20 con 0x7fe3d00cea00 2023-12-19T16:18:03.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.743+0000 7fe3d5107640 1 -- 172.21.15.119:0/1470798318 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129132284 0 0) 0x7fe3d015cb10 con 0x7fe3d00cd3a0 2023-12-19T16:18:03.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d5908640 1 --2- 172.21.15.119:0/1470798318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d00cea00 0x7fe3d00cef60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00097c0 tx=0x7fe3c001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a1d8767a8df42b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:03.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d5107640 1 -- 172.21.15.119:0/1470798318 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00a8970 con 0x7fe3d00cea00 2023-12-19T16:18:03.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d5107640 1 -- 172.21.15.119:0/1470798318 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c00a8ad0 con 0x7fe3d00cea00 2023-12-19T16:18:03.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d5107640 1 -- 172.21.15.119:0/1470798318 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00a8e60 con 0x7fe3d00cea00 2023-12-19T16:18:03.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 -- 172.21.15.119:0/1470798318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d00cea00 msgr2=0x7fe3d00cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 --2- 172.21.15.119:0/1470798318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d00cea00 0x7fe3d00cef60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00097c0 tx=0x7fe3c001ec70 comp rx=0 tx=0).stop 2023-12-19T16:18:03.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 -- 172.21.15.119:0/1470798318 shutdown_connections 2023-12-19T16:18:03.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 --2- 172.21.15.119:0/1470798318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d00cea00 0x7fe3d00cef60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 -- 172.21.15.119:0/1470798318 >> 172.21.15.119:0/1470798318 conn(0x7fe3d006b120 msgr2=0x7fe3d006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:03.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 -- 172.21.15.119:0/1470798318 shutdown_connections 2023-12-19T16:18:03.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.747+0000 7fe3d710b640 1 -- 172.21.15.119:0/1470798318 wait complete. 2023-12-19T16:18:03.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 Processor -- start 2023-12-19T16:18:03.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- start start 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3d00cd3a0 0x7fe3d01f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3d00cea00 0x7fe3d00c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 0x7fe3d015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01f1da0 con 0x7fe3d015c730 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c7510 con 0x7fe3d00cd3a0 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0154370 con 0x7fe3d00cea00 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 0x7fe3d015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 0x7fe3d015b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52206/0 (socket says 172.21.15.119:52206) 2023-12-19T16:18:03.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d6109640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3d00cd3a0 0x7fe3d01f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 -- 172.21.15.119:0/3007013379 learned_addr learned my addr 172.21.15.119:0/3007013379 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d5908640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3d00cea00 0x7fe3d00c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 -- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3d00cea00 msgr2=0x7fe3d00c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3d00cea00 0x7fe3d00c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 -- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3d00cd3a0 msgr2=0x7fe3d01f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3d00cd3a0 0x7fe3d01f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 -- 172.21.15.119:0/3007013379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0009420 con 0x7fe3d015c730 2023-12-19T16:18:03.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d690a640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 0x7fe3d015b250 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001570 tx=0x7fe3c800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800a640 con 0x7fe3d015c730 2023-12-19T16:18:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800a7c0 con 0x7fe3d015c730 2023-12-19T16:18:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d0154650 con 0x7fe3d015c730 2023-12-19T16:18:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800ab70 con 0x7fe3d015c730 2023-12-19T16:18:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d0154c10 con 0x7fe3d015c730 2023-12-19T16:18:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.751+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0066c50 con 0x7fe3d015c730 2023-12-19T16:18:03.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.755+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3c800acd0 con 0x7fe3d015c730 2023-12-19T16:18:03.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.755+0000 7fe3c6ffd640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:03.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.755+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe3c8082b30 con 0x7fe3d015c730 2023-12-19T16:18:03.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.755+0000 7fe3d6109640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:03.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.755+0000 7fe3d6109640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc007fd0 tx=0x7fe3cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:03.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.759+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe3c80503c0 con 0x7fe3d015c730 2023-12-19T16:18:03.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3d004e850 con 0x7fe3d015c730 2023-12-19T16:18:03.946 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3c6ffd640 1 -- 172.21.15.119:0/3007013379 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3c8018070 con 0x7fe3d015c730 2023-12-19T16:18:03.947 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:18:03.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 msgr2=0x7fe3b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc007fd0 tx=0x7fe3cc009040 comp rx=0 tx=0).stop 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 msgr2=0x7fe3d015b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 0x7fe3d015b250 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001570 tx=0x7fe3c800cca0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 shutdown_connections 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe3b4065a60 0x7fe3b4067f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d015c730 0x7fe3d015b250 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe3d00cea00 0x7fe3d00c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 --2- 172.21.15.119:0/3007013379 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe3d00cd3a0 0x7fe3d01f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 >> 172.21.15.119:0/3007013379 conn(0x7fe3d006b120 msgr2=0x7fe3d0157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 shutdown_connections 2023-12-19T16:18:03.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:03.943+0000 7fe3d710b640 1 -- 172.21.15.119:0/3007013379 wait complete. 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:18:03.967 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:18:03.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:03.967 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:18:03.977 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:03.978 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42275sec preferred_lft 42275sec 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.979 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:03.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:03.980 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:18:04.040 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:18:04.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:04.042 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:18:04.096 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:18:04.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:04.097 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:18:04.097 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:18:04.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:18:04.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:18:04.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:18:04.097 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:18:04.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:04.187 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:18:04.197 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:18:04.197 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:18:04.198 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:18:04.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:04.198 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:18:04.262 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:18:04.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:18:04.262 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:04.317 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:18:04.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:18:04.318 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:04.369 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:18:04.434 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:18:04.434 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:18:04.500 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:18:04.501 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:18:04.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:04.502 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:18:04.553 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:18:04.553 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:18:04.600 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:18:04.621 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:18:04.622 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:18:04.684 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:18:04.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:18:04.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:04.687 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:18:04.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:18:04.691+0000 7f9488845580 -1 init, newargv = 0x558342e4ef20 newargc=15 2023-12-19T16:18:04.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[52721]: starting ceph client 2023-12-19T16:18:04.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[52721]: starting fuse 2023-12-19T16:18:04.706 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:18:04.706 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:18:04.707 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:18:04.708 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:18:04.709 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:04.709 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:18:04.709 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:18:04.836 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.52721.asok 2023-12-19T16:18:05.020 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52721.asok 2023-12-19T16:18:05.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:05.021 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52721.asok status 2023-12-19T16:18:05.188 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:18:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "52721", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6420, 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:18:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 6420 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3682634296 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3682634296 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.6420 192.168.0.1:0/3682634296", 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/3682634296", 2023-12-19T16:18:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:18:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 26, 2023-12-19T16:18:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 55, 2023-12-19T16:18:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:18:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:18:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:18:05.191 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:05.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:05.204 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:18:05.204 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:05.214 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:18:05.215 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:05.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:05.215 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> import errno 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> try: 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> if False: 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> ret = os.read(fd, 1024) 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> else: 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> os.write(fd, b'"'"'content'"'"') 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> except OSError as e: 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> if e.errno != errno.EPERM: 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> raise 2023-12-19T16:18:05.278 DEBUG:teuthology.orchestra.run.smithi119:> else: 2023-12-19T16:18:05.279 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("client does not check permission of data pool") 2023-12-19T16:18:05.279 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:18:05.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-12-19T16:18:05.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.755+0000 7fcdce798640 1 Processor -- start 2023-12-19T16:18:05.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.755+0000 7fcdce798640 1 -- start start 2023-12-19T16:18:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdce798640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 0x7fcdc80cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdce798640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc80c9b40 0x7fcdc80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdce798640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc80ca2e0 con 0x7fcdc8158f20 2023-12-19T16:18:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdce798640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80ca000 con 0x7fcdc80ad900 2023-12-19T16:18:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdce798640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8070700 con 0x7fcdc80c9b40 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdc77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 0x7fcdc80cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdccd35640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc80c9b40 0x7fcdc80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdc77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 0x7fcdc80cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:58974/0 (socket says 172.21.15.119:58974) 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdc77fe640 1 -- 172.21.15.119:0/45425328 learned_addr learned my addr 172.21.15.119:0/45425328 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdccd35640 1 -- 172.21.15.119:0/45425328 >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 msgr2=0x7fcdc80cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdccd35640 1 --2- 172.21.15.119:0/45425328 >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 0x7fcdc80cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdccd35640 1 -- 172.21.15.119:0/45425328 >> v1:172.21.15.143:6789/0 conn(0x7fcdc8158f20 legacy=0x7fcdc80714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdccd35640 1 -- 172.21.15.119:0/45425328 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80709e0 con 0x7fcdc80c9b40 2023-12-19T16:18:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.759+0000 7fcdc77fe640 1 --2- 172.21.15.119:0/45425328 >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 0x7fcdc80cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdccd35640 1 --2- 172.21.15.119:0/45425328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc80c9b40 0x7fcdc80cc890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009d90 tx=0x7fcdc001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f29c816bb77b7837 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdc6ffd640 1 -- 172.21.15.119:0/45425328 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00a5960 con 0x7fcdc80c9b40 2023-12-19T16:18:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdc6ffd640 1 -- 172.21.15.119:0/45425328 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00a5ac0 con 0x7fcdc80c9b40 2023-12-19T16:18:05.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdc6ffd640 1 -- 172.21.15.119:0/45425328 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00a5e50 con 0x7fcdc80c9b40 2023-12-19T16:18:05.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 -- 172.21.15.119:0/45425328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc80c9b40 msgr2=0x7fcdc80cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 --2- 172.21.15.119:0/45425328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc80c9b40 0x7fcdc80cc890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009d90 tx=0x7fcdc001c920 comp rx=0 tx=0).stop 2023-12-19T16:18:05.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 -- 172.21.15.119:0/45425328 shutdown_connections 2023-12-19T16:18:05.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 --2- 172.21.15.119:0/45425328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc80c9b40 0x7fcdc80cc890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 --2- 172.21.15.119:0/45425328 >> v2:172.21.15.143:3300/0 conn(0x7fcdc80ad900 0x7fcdc80cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 -- 172.21.15.119:0/45425328 >> 172.21.15.119:0/45425328 conn(0x7fcdc80ce450 msgr2=0x7fcdc80ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:05.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 -- 172.21.15.119:0/45425328 shutdown_connections 2023-12-19T16:18:05.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 -- 172.21.15.119:0/45425328 wait complete. 2023-12-19T16:18:05.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.763+0000 7fcdce798640 1 Processor -- start 2023-12-19T16:18:05.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- start start 2023-12-19T16:18:05.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcdc80ad900 0x7fcdc81f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 0x7fcdc814f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc8158f20 0x7fcdc814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80acf00 con 0x7fcdc80c9b40 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80ac2f0 con 0x7fcdc80ad900 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80ac5d0 con 0x7fcdc8158f20 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 0x7fcdc814f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 0x7fcdc814f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52216/0 (socket says 172.21.15.119:52216) 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 -- 172.21.15.119:0/2336557613 learned_addr learned my addr 172.21.15.119:0/2336557613 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc7fff640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcdc80ad900 0x7fcdc81f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdccd35640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc8158f20 0x7fcdc814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 -- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc8158f20 msgr2=0x7fcdc814fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc8158f20 0x7fcdc814fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 -- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcdc80ad900 msgr2=0x7fcdc81f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcdc80ad900 0x7fcdc81f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 -- 172.21.15.119:0/2336557613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc00b770 con 0x7fcdc80c9b40 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc77fe640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 0x7fcdc814f8c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00ed70 tx=0x7fcdbc00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:05.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc010850 con 0x7fcdc80c9b40 2023-12-19T16:18:05.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc0109b0 con 0x7fcdc80c9b40 2023-12-19T16:18:05.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc0009a70 con 0x7fcdc80c9b40 2023-12-19T16:18:05.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc010d60 con 0x7fcdc80c9b40 2023-12-19T16:18:05.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc80acb90 con 0x7fcdc80c9b40 2023-12-19T16:18:05.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.767+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc80cf1a0 con 0x7fcdc80c9b40 2023-12-19T16:18:05.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.771+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcdbc018400 con 0x7fcdc80c9b40 2023-12-19T16:18:05.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.771+0000 7fcdc4ff9640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcdb4065a60 0x7fcdb4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.771+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcdbc083b20 con 0x7fcdc80c9b40 2023-12-19T16:18:05.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.771+0000 7fcdc7fff640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcdb4065a60 0x7fcdb4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.771+0000 7fcdc7fff640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcdb4065a60 0x7fcdb4067f20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8001810 tx=0x7fcdb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:05.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.775+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcdbc051440 con 0x7fcdc80c9b40 2023-12-19T16:18:05.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.979+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7fcdc80c52a0 con 0x7fcdc80c9b40 2023-12-19T16:18:05.988 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.983+0000 7fcdc4ff9640 1 -- 172.21.15.119:0/2336557613 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+0 (secure 0 0 0) 0x7fcdbc01d0e0 con 0x7fcdc80c9b40 2023-12-19T16:18:05.988 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcdb4065a60 msgr2=0x7fcdb4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcdb4065a60 0x7fcdb4067f20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8001810 tx=0x7fcdb8009040 comp rx=0 tx=0).stop 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 msgr2=0x7fcdc814f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 0x7fcdc814f8c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00ed70 tx=0x7fcdbc00d720 comp rx=0 tx=0).stop 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 shutdown_connections 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fcdb4065a60 0x7fcdb4067f20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcdc8158f20 0x7fcdc814fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdc80c9b40 0x7fcdc814f8c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 --2- 172.21.15.119:0/2336557613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcdc80ad900 0x7fcdc81f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 >> 172.21.15.119:0/2336557613 conn(0x7fcdc80ce450 msgr2=0x7fcdc80cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:05.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 shutdown_connections 2023-12-19T16:18:05.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:05.987+0000 7fcdce798640 1 -- 172.21.15.119:0/2336557613 wait complete. 2023-12-19T16:18:06.009 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:06.009 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:06.018 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:06.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 Processor -- start 2023-12-19T16:18:06.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 -- start start 2023-12-19T16:18:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f74300cdd40 0x7f74300cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f7430070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7430160690 con 0x7f743015c9d0 2023-12-19T16:18:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74301603f0 con 0x7f74300cdd40 2023-12-19T16:18:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7437139640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300b0d80 con 0x7f743006fdb0 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f74356d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f7430070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7434ed5640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f743015c9d0 0x7f7430160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:58684/0 (socket says 172.21.15.119:58684) 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f7434ed5640 1 -- 172.21.15.119:0/1497980315 learned_addr learned my addr 172.21.15.119:0/1497980315 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f742ffff640 1 --2- 172.21.15.119:0/1497980315 >> v2:172.21.15.143:3300/0 conn(0x7f74300cdd40 0x7f74300cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f742f7fe640 1 -- 172.21.15.119:0/1497980315 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432402084 0 0) 0x7f7430160690 con 0x7f743015c9d0 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f74356d6640 1 -- 172.21.15.119:0/1497980315 >> v2:172.21.15.143:3300/0 conn(0x7f74300cdd40 msgr2=0x7f74300cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f74356d6640 1 --2- 172.21.15.119:0/1497980315 >> v2:172.21.15.143:3300/0 conn(0x7f74300cdd40 0x7f74300cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f74356d6640 1 -- 172.21.15.119:0/1497980315 >> v1:172.21.15.143:6789/0 conn(0x7f743015c9d0 legacy=0x7f7430160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.195+0000 7f74356d6640 1 -- 172.21.15.119:0/1497980315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300ccb00 con 0x7f743006fdb0 2023-12-19T16:18:06.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f74356d6640 1 --2- 172.21.15.119:0/1497980315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f7430070240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7428009d90 tx=0x7f742801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f588fffc149bc0d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f742f7fe640 1 -- 172.21.15.119:0/1497980315 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280a5a30 con 0x7f743006fdb0 2023-12-19T16:18:06.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f742f7fe640 1 -- 172.21.15.119:0/1497980315 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74280a5b90 con 0x7f743006fdb0 2023-12-19T16:18:06.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f742f7fe640 1 -- 172.21.15.119:0/1497980315 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280ad440 con 0x7f743006fdb0 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 -- 172.21.15.119:0/1497980315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 msgr2=0x7f7430070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 --2- 172.21.15.119:0/1497980315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f7430070240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7428009d90 tx=0x7f742801c950 comp rx=0 tx=0).stop 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 -- 172.21.15.119:0/1497980315 shutdown_connections 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 --2- 172.21.15.119:0/1497980315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f7430070240 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 --2- 172.21.15.119:0/1497980315 >> v2:172.21.15.143:3300/0 conn(0x7f74300cdd40 0x7f74300cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 -- 172.21.15.119:0/1497980315 >> 172.21.15.119:0/1497980315 conn(0x7f743006a3e0 msgr2=0x7f74300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 -- 172.21.15.119:0/1497980315 shutdown_connections 2023-12-19T16:18:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.199+0000 7f7437139640 1 -- 172.21.15.119:0/1497980315 wait complete. 2023-12-19T16:18:06.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 Processor -- start 2023-12-19T16:18:06.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 -- start start 2023-12-19T16:18:06.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f74300c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74300cdd40 0x7f743015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 0x7f743015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c4510 con 0x7f743015c9d0 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c70a0 con 0x7f74300cdd40 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c7380 con 0x7f743006fdb0 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 0x7f743015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 0x7f743015bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52230/0 (socket says 172.21.15.119:52230) 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 -- 172.21.15.119:0/99174496 learned_addr learned my addr 172.21.15.119:0/99174496 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7434ed5640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f74300c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f742ffff640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74300cdd40 0x7f743015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 -- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 msgr2=0x7f74300c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f74300c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 -- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74300cdd40 msgr2=0x7f743015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74300cdd40 0x7f743015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 -- 172.21.15.119:0/99174496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009a70 con 0x7f743015c9d0 2023-12-19T16:18:06.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f74356d6640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 0x7f743015bc80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f74280b0040 tx=0x7f74280196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280add90 con 0x7f743015c9d0 2023-12-19T16:18:06.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428009450 con 0x7f743015c9d0 2023-12-19T16:18:06.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74301613b0 con 0x7f743015c9d0 2023-12-19T16:18:06.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280b7650 con 0x7f743015c9d0 2023-12-19T16:18:06.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.203+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74300c7940 con 0x7f743015c9d0 2023-12-19T16:18:06.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.207+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74300735b0 con 0x7f743015c9d0 2023-12-19T16:18:06.210 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.207+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74280b4050 con 0x7f743015c9d0 2023-12-19T16:18:06.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.207+0000 7f742d7fa640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7414065a90 0x7f7414067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.207+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f742811e280 con 0x7f743015c9d0 2023-12-19T16:18:06.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.207+0000 7f7434ed5640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7414065a90 0x7f7414067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.207+0000 7f7434ed5640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7414065a90 0x7f7414067f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7424000f70 tx=0x7f7424007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.215 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.211+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f74280ebc40 con 0x7f743015c9d0 2023-12-19T16:18:06.370 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.367+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f743004e000 con 0x7f743015c9d0 2023-12-19T16:18:06.371 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.367+0000 7f742d7fa640 1 -- 172.21.15.119:0/99174496 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f74280ef260 con 0x7f743015c9d0 2023-12-19T16:18:06.371 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:06.372 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7414065a90 msgr2=0x7f7414067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7414065a90 0x7f7414067f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7424000f70 tx=0x7f7424007df0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 msgr2=0x7f743015bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 0x7f743015bc80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f74280b0040 tx=0x7f74280196f0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 shutdown_connections 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7414065a90 0x7f7414067f50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74300cdd40 0x7f743015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743015c9d0 0x7f743015bc80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 --2- 172.21.15.119:0/99174496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f743006fdb0 0x7f74300c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 >> 172.21.15.119:0/99174496 conn(0x7f743006a3e0 msgr2=0x7f7430070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 shutdown_connections 2023-12-19T16:18:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.371+0000 7f7437139640 1 -- 172.21.15.119:0/99174496 wait complete. 2023-12-19T16:18:06.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:49.778202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:51.022485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:06.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:06.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 Processor -- start 2023-12-19T16:18:06.536 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 -- start start 2023-12-19T16:18:06.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb608153020 0x7fb6080c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb608070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080c9730 con 0x7fb6081598d0 2023-12-19T16:18:06.537 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080c8e00 con 0x7fb608153020 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb60e42d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c90e0 con 0x7fb6080ceaa0 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb607fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb608153020 0x7fb6080c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb607fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb608153020 0x7fb6080c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52232/0 (socket says 172.21.15.119:52232) 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.531+0000 7fb607fff640 1 -- 172.21.15.119:0/401883815 learned_addr learned my addr 172.21.15.119:0/401883815 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb60c9ca640 1 --2- 172.21.15.119:0/401883815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb608070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb607fff640 1 -- 172.21.15.119:0/401883815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 msgr2=0x7fb608070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb607fff640 1 --2- 172.21.15.119:0/401883815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb608070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb607fff640 1 -- 172.21.15.119:0/401883815 >> v1:172.21.15.119:6789/0 conn(0x7fb6081598d0 legacy=0x7fb6080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb607fff640 1 -- 172.21.15.119:0/401883815 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080c93c0 con 0x7fb608153020 2023-12-19T16:18:06.538 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb606ffd640 1 -- 172.21.15.119:0/401883815 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352922428 0 0) 0x7fb6080c9730 con 0x7fb6081598d0 2023-12-19T16:18:06.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb607fff640 1 --2- 172.21.15.119:0/401883815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb608153020 0x7fb6080c9bc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009870 tx=0x7fb5f801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26c4c297e4a04b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb606ffd640 1 -- 172.21.15.119:0/401883815 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80ad660 con 0x7fb608153020 2023-12-19T16:18:06.541 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb606ffd640 1 -- 172.21.15.119:0/401883815 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80ad7c0 con 0x7fb608153020 2023-12-19T16:18:06.541 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.535+0000 7fb606ffd640 1 -- 172.21.15.119:0/401883815 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80adb50 con 0x7fb608153020 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- 172.21.15.119:0/401883815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb608153020 msgr2=0x7fb6080c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 --2- 172.21.15.119:0/401883815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb608153020 0x7fb6080c9bc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009870 tx=0x7fb5f801c3c0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- 172.21.15.119:0/401883815 shutdown_connections 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 --2- 172.21.15.119:0/401883815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb608070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 --2- 172.21.15.119:0/401883815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb608153020 0x7fb6080c9bc0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- 172.21.15.119:0/401883815 >> 172.21.15.119:0/401883815 conn(0x7fb60806a2a0 msgr2=0x7fb6080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- 172.21.15.119:0/401883815 shutdown_connections 2023-12-19T16:18:06.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- 172.21.15.119:0/401883815 wait complete. 2023-12-19T16:18:06.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 Processor -- start 2023-12-19T16:18:06.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- start start 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb6081539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb608153020 0x7fb6080cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 0x7fb6080cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081fd4a0 con 0x7fb6081598d0 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081fd930 con 0x7fb608153020 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60e42d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb608154470 con 0x7fb6080ceaa0 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 0x7fb6080cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 0x7fb6080cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52234/0 (socket says 172.21.15.119:52234) 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 -- 172.21.15.119:0/1637324868 learned_addr learned my addr 172.21.15.119:0/1637324868 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb607fff640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb6081539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb6077fe640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb608153020 0x7fb6080cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.545 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 -- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 msgr2=0x7fb6081539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb6081539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 -- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb608153020 msgr2=0x7fb6080cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb608153020 0x7fb6080cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.539+0000 7fb60c9ca640 1 -- 172.21.15.119:0/1637324868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80094d0 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb60c9ca640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 0x7fb6080cb0b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb600007d40 tx=0x7fb60000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600014420 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6000145a0 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6081fcb70 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600014950 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6081fd130 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6081fd650 con 0x7fb6081598d0 2023-12-19T16:18:06.547 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb600014ab0 con 0x7fb6081598d0 2023-12-19T16:18:06.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb604ff9640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5f4065a60 0x7fb5f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb600083b60 con 0x7fb6081598d0 2023-12-19T16:18:06.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.543+0000 7fb607fff640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5f4065a60 0x7fb5f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.547+0000 7fb607fff640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5f4065a60 0x7fb5f4067f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80af000 tx=0x7fb5f80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.547+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb6081fd650 con 0x7fb6081598d0 2023-12-19T16:18:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.699+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb60804e000 con 0x7fb6081598d0 2023-12-19T16:18:06.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.699+0000 7fb604ff9640 1 -- 172.21.15.119:0/1637324868 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb600051340 con 0x7fb6081598d0 2023-12-19T16:18:06.704 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5f4065a60 msgr2=0x7fb5f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5f4065a60 0x7fb5f4067f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80af000 tx=0x7fb5f80a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 msgr2=0x7fb6080cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 0x7fb6080cb0b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb600007d40 tx=0x7fb60000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 shutdown_connections 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fb5f4065a60 0x7fb5f4067f20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb608153020 0x7fb6080cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6081598d0 0x7fb6080cb0b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 --2- 172.21.15.119:0/1637324868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6080ceaa0 0x7fb6081539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 >> 172.21.15.119:0/1637324868 conn(0x7fb60806a2a0 msgr2=0x7fb60815a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 shutdown_connections 2023-12-19T16:18:06.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.703+0000 7fb60e42d640 1 -- 172.21.15.119:0/1637324868 wait complete. 2023-12-19T16:18:06.724 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:06.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.859+0000 7f6c098f2640 1 Processor -- start 2023-12-19T16:18:06.865 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c098f2640 1 -- start start 2023-12-19T16:18:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c098f2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c04071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c098f2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6c040cbff0 0x7f6c040cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c098f2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040cc960 con 0x7f6c040ca410 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c098f2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0415aab0 con 0x7f6c040cbff0 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c098f2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04070df0 con 0x7f6c04071870 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6c040cbff0 0x7f6c040cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6c040cbff0 0x7f6c040cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52238/0 (socket says 172.21.15.119:52238) 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 -- 172.21.15.119:0/3207539 learned_addr learned my addr 172.21.15.119:0/3207539 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:06.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6bfa7fc640 1 --2- 172.21.15.119:0/3207539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c04071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 -- 172.21.15.119:0/3207539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 msgr2=0x7f6c04071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 --2- 172.21.15.119:0/3207539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c04071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 -- 172.21.15.119:0/3207539 >> v1:172.21.15.119:6789/0 conn(0x7f6c040ca410 legacy=0x7f6c04159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c037fe640 1 -- 172.21.15.119:0/3207539 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0415a4f0 con 0x7f6c040cbff0 2023-12-19T16:18:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.863+0000 7f6c027fc640 1 -- 172.21.15.119:0/3207539 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237990631 0 0) 0x7f6c040cc960 con 0x7f6c040ca410 2023-12-19T16:18:06.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c037fe640 1 --2- 172.21.15.119:0/3207539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c040cc420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00d150 tx=0x7f6bfc01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8381e900fdcb2fba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c027fc640 1 -- 172.21.15.119:0/3207539 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00b2d0 con 0x7f6c040cbff0 2023-12-19T16:18:06.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c027fc640 1 -- 172.21.15.119:0/3207539 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc00b430 con 0x7f6c040cbff0 2023-12-19T16:18:06.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c027fc640 1 -- 172.21.15.119:0/3207539 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0a7c40 con 0x7f6c040cbff0 2023-12-19T16:18:06.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 -- 172.21.15.119:0/3207539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 msgr2=0x7f6c040cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 --2- 172.21.15.119:0/3207539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c040cc420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00d150 tx=0x7f6bfc01eb50 comp rx=0 tx=0).stop 2023-12-19T16:18:06.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 -- 172.21.15.119:0/3207539 shutdown_connections 2023-12-19T16:18:06.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 --2- 172.21.15.119:0/3207539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c040cc420 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 --2- 172.21.15.119:0/3207539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c04071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 -- 172.21.15.119:0/3207539 >> 172.21.15.119:0/3207539 conn(0x7f6c0406a2a0 msgr2=0x7f6c040aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 -- 172.21.15.119:0/3207539 shutdown_connections 2023-12-19T16:18:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.867+0000 7f6c098f2640 1 -- 172.21.15.119:0/3207539 wait complete. 2023-12-19T16:18:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 Processor -- start 2023-12-19T16:18:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- start start 2023-12-19T16:18:06.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c040a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040ca410 0x7f6c04154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c04152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040c3040 con 0x7f6c040cbff0 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040c24c0 con 0x7f6c040ca410 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040c27a0 con 0x7f6c04071870 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c04152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c04152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52248/0 (socket says 172.21.15.119:52248) 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 -- 172.21.15.119:0/2208337951 learned_addr learned my addr 172.21.15.119:0/2208337951 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c02ffd640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c040a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6bfa7fc640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040ca410 0x7f6c04154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 -- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 msgr2=0x7f6c040a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c040a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 -- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040ca410 msgr2=0x7f6c04154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040ca410 0x7f6c04154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 -- 172.21.15.119:0/2208337951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc00bd40 con 0x7f6c040cbff0 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c037fe640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c04152ab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0b1040 tx=0x7f6bfc01b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc009800 con 0x7f6c040cbff0 2023-12-19T16:18:06.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0099a0 con 0x7f6c040cbff0 2023-12-19T16:18:06.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c040c2a80 con 0x7f6c040cbff0 2023-12-19T16:18:06.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc009d50 con 0x7f6c040cbff0 2023-12-19T16:18:06.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c040a7cb0 con 0x7f6c040cbff0 2023-12-19T16:18:06.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.871+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0404e000 con 0x7f6c040cbff0 2023-12-19T16:18:06.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.875+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6bfc0c3460 con 0x7f6c040cbff0 2023-12-19T16:18:06.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.875+0000 7f6c00ff9640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6be4065a60 0x7f6be4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:06.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.875+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6bfc11e880 con 0x7f6c040cbff0 2023-12-19T16:18:06.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.875+0000 7f6c02ffd640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6be4065a60 0x7f6be4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:06.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.875+0000 7f6c02ffd640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6be4065a60 0x7f6be4067f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000f70 tx=0x7f6bec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:06.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:06.879+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6bfc0ec190 con 0x7f6c040cbff0 2023-12-19T16:18:07.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.027+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c041564d0 con 0x7f6c040cbff0 2023-12-19T16:18:07.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c00ff9640 1 -- 172.21.15.119:0/2208337951 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bfc0ef7b0 con 0x7f6c040cbff0 2023-12-19T16:18:07.033 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:18:07.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6be4065a60 msgr2=0x7f6be4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6be4065a60 0x7f6be4067f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000f70 tx=0x7f6bec009040 comp rx=0 tx=0).stop 2023-12-19T16:18:07.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 msgr2=0x7f6c04152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.035 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c04152ab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0b1040 tx=0x7f6bfc01b8f0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 shutdown_connections 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6be4065a60 0x7f6be4067f20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c040ca410 0x7f6c04154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c040cbff0 0x7f6c04152ab0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 --2- 172.21.15.119:0/2208337951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c04071870 0x7f6c040a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 >> 172.21.15.119:0/2208337951 conn(0x7f6c0406a2a0 msgr2=0x7f6c04157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 shutdown_connections 2023-12-19T16:18:07.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.031+0000 7f6c098f2640 1 -- 172.21.15.119:0/2208337951 wait complete. 2023-12-19T16:18:07.055 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:07.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.191+0000 7f731c152640 1 Processor -- start 2023-12-19T16:18:07.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.191+0000 7f731c152640 1 -- start start 2023-12-19T16:18:07.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.191+0000 7f731c152640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7314153020 0x7f73140c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.191+0000 7f731c152640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73140c9730 con 0x7f73141598d0 2023-12-19T16:18:07.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.191+0000 7f731c152640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73140c8e00 con 0x7f73140ceaa0 2023-12-19T16:18:07.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.191+0000 7f731c152640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c90e0 con 0x7f7314153020 2023-12-19T16:18:07.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f73196ed640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f73141598d0 0x7f73140ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33108/0 (socket says 172.21.15.119:33108) 2023-12-19T16:18:07.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f73196ed640 1 -- 172.21.15.119:0/2267624457 learned_addr learned my addr 172.21.15.119:0/2267624457 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:07.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7319eee640 1 --2- 172.21.15.119:0/2267624457 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7314153020 0x7f73140c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7318eec640 1 -- 172.21.15.119:0/2267624457 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890882299 0 0) 0x7f73140c9730 con 0x7f73141598d0 2023-12-19T16:18:07.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7318eec640 1 -- 172.21.15.119:0/2267624457 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7300005740 con 0x7f73141598d0 2023-12-19T16:18:07.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7318eec640 1 -- 172.21.15.119:0/2267624457 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312818847 0 0) 0x7f73140c8e00 con 0x7f73140ceaa0 2023-12-19T16:18:07.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7319eee640 1 -- 172.21.15.119:0/2267624457 >> v1:172.21.15.143:6789/0 conn(0x7f73140ceaa0 legacy=0x7f7314070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7319eee640 1 -- 172.21.15.119:0/2267624457 >> v1:172.21.15.119:6789/0 conn(0x7f73141598d0 legacy=0x7f73140ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7319eee640 1 -- 172.21.15.119:0/2267624457 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140c93c0 con 0x7f7314153020 2023-12-19T16:18:07.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7319eee640 1 --2- 172.21.15.119:0/2267624457 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7314153020 0x7f73140c9bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f731000a990 tx=0x7f731001c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea3bec86df5f366d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7318eec640 1 -- 172.21.15.119:0/2267624457 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100a6610 con 0x7f7314153020 2023-12-19T16:18:07.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7318eec640 1 -- 172.21.15.119:0/2267624457 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73100a6770 con 0x7f7314153020 2023-12-19T16:18:07.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.195+0000 7f7318eec640 1 -- 172.21.15.119:0/2267624457 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100a6ae0 con 0x7f7314153020 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- 172.21.15.119:0/2267624457 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7314153020 msgr2=0x7f73140c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 --2- 172.21.15.119:0/2267624457 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7314153020 0x7f73140c9bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f731000a990 tx=0x7f731001c610 comp rx=0 tx=0).stop 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- 172.21.15.119:0/2267624457 shutdown_connections 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 --2- 172.21.15.119:0/2267624457 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7314153020 0x7f73140c9bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- 172.21.15.119:0/2267624457 >> 172.21.15.119:0/2267624457 conn(0x7f731406a2a0 msgr2=0x7f73140aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- 172.21.15.119:0/2267624457 shutdown_connections 2023-12-19T16:18:07.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- 172.21.15.119:0/2267624457 wait complete. 2023-12-19T16:18:07.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 Processor -- start 2023-12-19T16:18:07.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- start start 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73140ceaa0 0x7f73141471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 0x7f73140c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73141598d0 0x7f73140c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c6690 con 0x7f7314153020 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140afd40 con 0x7f73141598d0 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731c152640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140b2bd0 con 0x7f73140ceaa0 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f73196ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 0x7f73140c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f73196ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 0x7f73140c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52256/0 (socket says 172.21.15.119:52256) 2023-12-19T16:18:07.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f73196ed640 1 -- 172.21.15.119:0/4160989295 learned_addr learned my addr 172.21.15.119:0/4160989295 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f7319eee640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73140ceaa0 0x7f73141471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f731a6ef640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73141598d0 0x7f73140c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f73196ed640 1 -- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73140ceaa0 msgr2=0x7f73141471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.199+0000 7f73196ed640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73140ceaa0 0x7f73141471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f73196ed640 1 -- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73141598d0 msgr2=0x7f73140c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f73196ed640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73141598d0 0x7f73140c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f73196ed640 1 -- 172.21.15.119:0/4160989295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731000a5c0 con 0x7f7314153020 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f731a6ef640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73141598d0 0x7f73140c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f73196ed640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 0x7f73140c5eb0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f730400c3c0 tx=0x7f730400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304005cf0 con 0x7f7314153020 2023-12-19T16:18:07.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304005e50 con 0x7f7314153020 2023-12-19T16:18:07.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040072f0 con 0x7f7314153020 2023-12-19T16:18:07.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73140c63f0 con 0x7f7314153020 2023-12-19T16:18:07.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73140b2580 con 0x7f7314153020 2023-12-19T16:18:07.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731404e000 con 0x7f7314153020 2023-12-19T16:18:07.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7304007450 con 0x7f7314153020 2023-12-19T16:18:07.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f730a7fc640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f72f8065a90 0x7f72f8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7304082880 con 0x7f7314153020 2023-12-19T16:18:07.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.203+0000 7f7319eee640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f72f8065a90 0x7f72f8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.209 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.207+0000 7f7319eee640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f72f8065a90 0x7f72f8067f50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f73100af000 tx=0x7f73100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.212 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.207+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7304050110 con 0x7f7314153020 2023-12-19T16:18:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73140cc600 con 0x7f7314153020 2023-12-19T16:18:07.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f730a7fc640 1 -- 172.21.15.119:0/4160989295 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73040170a0 con 0x7f7314153020 2023-12-19T16:18:07.363 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f72f8065a90 msgr2=0x7f72f8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f72f8065a90 0x7f72f8067f50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f73100af000 tx=0x7f73100a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 msgr2=0x7f73140c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 0x7f73140c5eb0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f730400c3c0 tx=0x7f730400c880 comp rx=0 tx=0).stop 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 shutdown_connections 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f72f8065a90 0x7f72f8067f50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73141598d0 0x7f73140c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7314153020 0x7f73140c5eb0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 --2- 172.21.15.119:0/4160989295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73140ceaa0 0x7f73141471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 >> 172.21.15.119:0/4160989295 conn(0x7f731406a2a0 msgr2=0x7f731415b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:07.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 shutdown_connections 2023-12-19T16:18:07.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.359+0000 7f731c152640 1 -- 172.21.15.119:0/4160989295 wait complete. 2023-12-19T16:18:07.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:18:07.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 Processor -- start 2023-12-19T16:18:07.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 -- start start 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b040cac10 0x7f9b0415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b04070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0415f100 con 0x7f9b0415a680 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b04070780 con 0x7f9b040cac10 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b0ab0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040ca7d0 con 0x7f9b0406fdb0 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b040cac10 0x7f9b0415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b040cac10 0x7f9b0415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52268/0 (socket says 172.21.15.119:52268) 2023-12-19T16:18:07.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b088a6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9b0415a680 0x7f9b0415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33118/0 (socket says 172.21.15.119:33118) 2023-12-19T16:18:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 -- 172.21.15.119:0/943955835 learned_addr learned my addr 172.21.15.119:0/943955835 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:07.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9b090a7640 1 --2- 172.21.15.119:0/943955835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b04070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 -- 172.21.15.119:0/943955835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 msgr2=0x7f9b04070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:07.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 --2- 172.21.15.119:0/943955835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b04070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 -- 172.21.15.119:0/943955835 >> v1:172.21.15.119:6789/0 conn(0x7f9b0415a680 legacy=0x7f9b0415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afbfff640 1 -- 172.21.15.119:0/943955835 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0415e860 con 0x7f9b040cac10 2023-12-19T16:18:07.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.519+0000 7f9afb7fe640 1 -- 172.21.15.119:0/943955835 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822660841 0 0) 0x7f9b0415f100 con 0x7f9b0415a680 2023-12-19T16:18:07.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9afbfff640 1 --2- 172.21.15.119:0/943955835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b040cac10 0x7f9b0415e160 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009870 tx=0x7f9af401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13aa4185cef0da1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9afb7fe640 1 -- 172.21.15.119:0/943955835 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40aa610 con 0x7f9b040cac10 2023-12-19T16:18:07.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9afb7fe640 1 -- 172.21.15.119:0/943955835 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af40a6040 con 0x7f9b040cac10 2023-12-19T16:18:07.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9afb7fe640 1 -- 172.21.15.119:0/943955835 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40aa990 con 0x7f9b040cac10 2023-12-19T16:18:07.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/943955835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b040cac10 msgr2=0x7f9b0415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.528 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/943955835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b040cac10 0x7f9b0415e160 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009870 tx=0x7f9af401c4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/943955835 shutdown_connections 2023-12-19T16:18:07.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/943955835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b04070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/943955835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b040cac10 0x7f9b0415e160 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/943955835 >> 172.21.15.119:0/943955835 conn(0x7f9b0406a3e0 msgr2=0x7f9b040afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:07.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/943955835 shutdown_connections 2023-12-19T16:18:07.529 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.523+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/943955835 wait complete. 2023-12-19T16:18:07.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 Processor -- start 2023-12-19T16:18:07.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 -- start start 2023-12-19T16:18:07.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b040c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b040cac10 0x7f9b040c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 0x7f9b040c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.532 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c6e80 con 0x7f9b0415a680 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c58c0 con 0x7f9b040cac10 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c5ba0 con 0x7f9b0406fdb0 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 0x7f9b040c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 0x7f9b040c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52280/0 (socket says 172.21.15.119:52280) 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 -- 172.21.15.119:0/2860117475 learned_addr learned my addr 172.21.15.119:0/2860117475 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b088a6640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b040c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9afbfff640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b040cac10 0x7f9b040c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 -- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 msgr2=0x7f9b040c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b040c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 -- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b040cac10 msgr2=0x7f9b040c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b040cac10 0x7f9b040c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 -- 172.21.15.119:0/2860117475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40094d0 con 0x7f9b0415a680 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b088a6640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b040c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:07.533 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9afbfff640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b040cac10 0x7f9b040c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b090a7640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 0x7f9b040c3190 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007e60 tx=0x7f9afc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc014420 con 0x7f9b0415a680 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc0145a0 con 0x7f9b0415a680 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc014950 con 0x7f9b0415a680 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040c5e80 con 0x7f9b0415a680 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.527+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b040c6440 con 0x7f9b0415a680 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.531+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b040735b0 con 0x7f9b0415a680 2023-12-19T16:18:07.534 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.531+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9afc014ab0 con 0x7f9b0415a680 2023-12-19T16:18:07.535 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.531+0000 7f9af97fa640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9af0065a60 0x7f9af0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.536 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.531+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9afc083ca0 con 0x7f9b0415a680 2023-12-19T16:18:07.536 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.531+0000 7f9b088a6640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9af0065a60 0x7f9af0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.536 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.531+0000 7f9b088a6640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9af0065a60 0x7f9af0067f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b00000f70 tx=0x7f9b00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.539 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.535+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9afc051480 con 0x7f9b0415a680 2023-12-19T16:18:07.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9b0404e000 con 0x7f9b0415a680 2023-12-19T16:18:07.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9af97fa640 1 -- 172.21.15.119:0/2860117475 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9afc054aa0 con 0x7f9b0415a680 2023-12-19T16:18:07.706 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:18:07.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9af0065a60 msgr2=0x7f9af0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9af0065a60 0x7f9af0067f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b00000f70 tx=0x7f9b00009040 comp rx=0 tx=0).stop 2023-12-19T16:18:07.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 msgr2=0x7f9b040c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 0x7f9b040c3190 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007e60 tx=0x7f9afc00e4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 shutdown_connections 2023-12-19T16:18:07.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9af0065a60 0x7f9af0067f20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b040cac10 0x7f9b040c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b0415a680 0x7f9b040c3190 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 --2- 172.21.15.119:0/2860117475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b0406fdb0 0x7f9b040c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 >> 172.21.15.119:0/2860117475 conn(0x7f9b0406a3e0 msgr2=0x7f9b0415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:07.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 shutdown_connections 2023-12-19T16:18:07.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.703+0000 7f9b0ab0a640 1 -- 172.21.15.119:0/2860117475 wait complete. 2023-12-19T16:18:07.727 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:07.727 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:07.736 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:07.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 Processor -- start 2023-12-19T16:18:07.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 -- start start 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fca0c1570c0 0x7fca0c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c06c320 0x7fca0c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fca0c0c9e30 0x7fca0c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c06c7a0 con 0x7fca0c1570c0 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c0c9460 con 0x7fca0c0c9e30 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca12ed8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1574a0 con 0x7fca0c06c320 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fca0c1570c0 0x7fca0c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fca0c1570c0 0x7fca0c06bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52284/0 (socket says 172.21.15.119:52284) 2023-12-19T16:18:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 -- 172.21.15.119:0/45654020 learned_addr learned my addr 172.21.15.119:0/45654020 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca03fff640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c06c320 0x7fca0c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca11475640 1 --2- 172.21.15.119:0/45654020 >> v2:172.21.15.143:3300/0 conn(0x7fca0c0c9e30 0x7fca0c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 -- 172.21.15.119:0/45654020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c06c320 msgr2=0x7fca0c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c06c320 0x7fca0c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 -- 172.21.15.119:0/45654020 >> v2:172.21.15.143:3300/0 conn(0x7fca0c0c9e30 msgr2=0x7fca0c0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 --2- 172.21.15.119:0/45654020 >> v2:172.21.15.143:3300/0 conn(0x7fca0c0c9e30 0x7fca0c0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca10c74640 1 -- 172.21.15.119:0/45654020 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0c8b30 con 0x7fca0c1570c0 2023-12-19T16:18:07.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.911+0000 7fca03fff640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c06c320 0x7fca0c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:07.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca10c74640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c06bde0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0b0f50 tx=0x7fca0801e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556e2b5b12097788 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca037fe640 1 -- 172.21.15.119:0/45654020 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080a86a0 con 0x7fca0c1570c0 2023-12-19T16:18:07.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca037fe640 1 -- 172.21.15.119:0/45654020 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca080a8800 con 0x7fca0c1570c0 2023-12-19T16:18:07.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca037fe640 1 -- 172.21.15.119:0/45654020 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080a8b90 con 0x7fca0c1570c0 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 -- 172.21.15.119:0/45654020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 msgr2=0x7fca0c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c06bde0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0b0f50 tx=0x7fca0801e710 comp rx=0 tx=0).stop 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 -- 172.21.15.119:0/45654020 shutdown_connections 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 --2- 172.21.15.119:0/45654020 >> v2:172.21.15.143:3300/0 conn(0x7fca0c0c9e30 0x7fca0c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c06c320 0x7fca0c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 --2- 172.21.15.119:0/45654020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c06bde0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 -- 172.21.15.119:0/45654020 >> 172.21.15.119:0/45654020 conn(0x7fca0c06a3e0 msgr2=0x7fca0c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 -- 172.21.15.119:0/45654020 shutdown_connections 2023-12-19T16:18:07.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.915+0000 7fca12ed8640 1 -- 172.21.15.119:0/45654020 wait complete. 2023-12-19T16:18:07.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 Processor -- start 2023-12-19T16:18:07.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- start start 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c06c320 0x7fca0c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c0c9e30 0x7fca0c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c14f140 con 0x7fca0c1570c0 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c155a70 con 0x7fca0c06c320 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c155790 con 0x7fca0c0c9e30 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52294/0 (socket says 172.21.15.119:52294) 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 -- 172.21.15.119:0/3728016953 learned_addr learned my addr 172.21.15.119:0/3728016953 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca03fff640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c0c9e30 0x7fca0c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca10c74640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c06c320 0x7fca0c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 -- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c0c9e30 msgr2=0x7fca0c1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c0c9e30 0x7fca0c1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 -- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c06c320 msgr2=0x7fca0c0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c06c320 0x7fca0c0c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 -- 172.21.15.119:0/3728016953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080094d0 con 0x7fca0c1570c0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca10c74640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c06c320 0x7fca0c0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca11475640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c157b20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fca04007e40 tx=0x7fca0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04014620 con 0x7fca0c1570c0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0400ee90 con 0x7fca0c1570c0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c0c2490 con 0x7fca0c1570c0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca040149e0 con 0x7fca0c1570c0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c0c2a50 con 0x7fca0c1570c0 2023-12-19T16:18:07.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.919+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c0735b0 con 0x7fca0c1570c0 2023-12-19T16:18:07.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.923+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca04014b40 con 0x7fca0c1570c0 2023-12-19T16:18:07.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.923+0000 7fca017fa640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc9f8065a60 0x7fc9f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:07.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.923+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca04083b30 con 0x7fca0c1570c0 2023-12-19T16:18:07.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.923+0000 7fca10c74640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc9f8065a60 0x7fc9f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:07.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.923+0000 7fca10c74640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc9f8065a60 0x7fc9f8067f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca080b0000 tx=0x7fca080a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:07.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:07.927+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fca04051420 con 0x7fca0c1570c0 2023-12-19T16:18:08.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.083+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca0c0c22f0 con 0x7fca0c1570c0 2023-12-19T16:18:08.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.083+0000 7fca017fa640 1 -- 172.21.15.119:0/3728016953 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fca0c0c22f0 con 0x7fca0c1570c0 2023-12-19T16:18:08.087 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:08.088 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:08.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc9f8065a60 msgr2=0x7fc9f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc9f8065a60 0x7fc9f8067f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca080b0000 tx=0x7fca080a9000 comp rx=0 tx=0).stop 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 msgr2=0x7fca0c157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c157b20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fca04007e40 tx=0x7fca0400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 shutdown_connections 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc9f8065a60 0x7fc9f8067f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca0c1570c0 0x7fca0c157b20 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c0c9e30 0x7fca0c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 --2- 172.21.15.119:0/3728016953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c06c320 0x7fca0c0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 >> 172.21.15.119:0/3728016953 conn(0x7fca0c06a3e0 msgr2=0x7fca0c15b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:08.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 shutdown_connections 2023-12-19T16:18:08.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.087+0000 7fca12ed8640 1 -- 172.21.15.119:0/3728016953 wait complete. 2023-12-19T16:18:08.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:49.778202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:51.022485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:08.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 Processor -- start 2023-12-19T16:18:08.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 -- start start 2023-12-19T16:18:08.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa13415cb30 0x7fa13406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1340cefe0 0x7fa1340cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13406c140 con 0x7fa13415d2d0 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13415cf10 con 0x7fa1340cefe0 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.247+0000 7fa139d5a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13415e000 con 0x7fa13415cb30 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1340cefe0 0x7fa1340cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1340cefe0 0x7fa1340cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52306/0 (socket says 172.21.15.119:52306) 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 -- 172.21.15.119:0/3813306279 learned_addr learned my addr 172.21.15.119:0/3813306279 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa139559640 1 --1- 172.21.15.119:0/3813306279 >> v1:172.21.15.119:6789/0 conn(0x7fa13415d2d0 0x7fa13415d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33126/0 (socket says 172.21.15.119:33126) 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa138d58640 1 --2- 172.21.15.119:0/3813306279 >> v2:172.21.15.143:3300/0 conn(0x7fa13415cb30 0x7fa13406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 -- 172.21.15.119:0/3813306279 >> v2:172.21.15.143:3300/0 conn(0x7fa13415cb30 msgr2=0x7fa13406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 --2- 172.21.15.119:0/3813306279 >> v2:172.21.15.143:3300/0 conn(0x7fa13415cb30 0x7fa13406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 -- 172.21.15.119:0/3813306279 >> v1:172.21.15.119:6789/0 conn(0x7fa13415d2d0 legacy=0x7fa13415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa1337fe640 1 -- 172.21.15.119:0/3813306279 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813656562 0 0) 0x7fa13406c140 con 0x7fa13415d2d0 2023-12-19T16:18:08.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 -- 172.21.15.119:0/3813306279 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340cf960 con 0x7fa1340cefe0 2023-12-19T16:18:08.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa138d58640 1 --2- 172.21.15.119:0/3813306279 >> v2:172.21.15.143:3300/0 conn(0x7fa13415cb30 0x7fa13406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa133fff640 1 --2- 172.21.15.119:0/3813306279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1340cefe0 0x7fa1340cf420 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa1340d3630 tx=0x7fa12001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314893d3e2a0ed22 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa1337fe640 1 -- 172.21.15.119:0/3813306279 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200ab5f0 con 0x7fa1340cefe0 2023-12-19T16:18:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa1337fe640 1 -- 172.21.15.119:0/3813306279 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1200ab750 con 0x7fa1340cefe0 2023-12-19T16:18:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.251+0000 7fa1337fe640 1 -- 172.21.15.119:0/3813306279 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200abae0 con 0x7fa1340cefe0 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- 172.21.15.119:0/3813306279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1340cefe0 msgr2=0x7fa1340cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 --2- 172.21.15.119:0/3813306279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1340cefe0 0x7fa1340cf420 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa1340d3630 tx=0x7fa12001c500 comp rx=0 tx=0).stop 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- 172.21.15.119:0/3813306279 shutdown_connections 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 --2- 172.21.15.119:0/3813306279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1340cefe0 0x7fa1340cf420 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 --2- 172.21.15.119:0/3813306279 >> v2:172.21.15.143:3300/0 conn(0x7fa13415cb30 0x7fa13406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- 172.21.15.119:0/3813306279 >> 172.21.15.119:0/3813306279 conn(0x7fa134089fb0 msgr2=0x7fa13409b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- 172.21.15.119:0/3813306279 shutdown_connections 2023-12-19T16:18:08.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- 172.21.15.119:0/3813306279 wait complete. 2023-12-19T16:18:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 Processor -- start 2023-12-19T16:18:08.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- start start 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1340cefe0 0x7fa1340cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa13415cb30 0x7fa134154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 0x7fa13415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340cb110 con 0x7fa13415d2d0 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13415a010 con 0x7fa13415cb30 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139d5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340ca070 con 0x7fa1340cefe0 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 0x7fa13415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 0x7fa13415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52320/0 (socket says 172.21.15.119:52320) 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa139559640 1 -- 172.21.15.119:0/152486135 learned_addr learned my addr 172.21.15.119:0/152486135 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa138d58640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1340cefe0 0x7fa1340cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.255+0000 7fa133fff640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa13415cb30 0x7fa134154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139559640 1 -- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1340cefe0 msgr2=0x7fa1340cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139559640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1340cefe0 0x7fa1340cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139559640 1 -- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa13415cb30 msgr2=0x7fa134154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139559640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa13415cb30 0x7fa134154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139559640 1 -- 172.21.15.119:0/152486135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200094d0 con 0x7fa13415d2d0 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139559640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 0x7fa13415a440 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c780 tx=0x7fa12c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00ce90 con 0x7fa13415d2d0 2023-12-19T16:18:08.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c00a640 con 0x7fa13415d2d0 2023-12-19T16:18:08.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00a9d0 con 0x7fa13415d2d0 2023-12-19T16:18:08.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1340ca350 con 0x7fa13415d2d0 2023-12-19T16:18:08.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1340ca910 con 0x7fa13415d2d0 2023-12-19T16:18:08.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13406a7c0 con 0x7fa13415d2d0 2023-12-19T16:18:08.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.259+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa12c00ab30 con 0x7fa13415d2d0 2023-12-19T16:18:08.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.263+0000 7fa1317fa640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa118065a60 0x7fa118067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.263+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa12c082750 con 0x7fa13415d2d0 2023-12-19T16:18:08.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.263+0000 7fa138d58640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa118065a60 0x7fa118067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.263+0000 7fa138d58640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa118065a60 0x7fa118067f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa128006fd0 tx=0x7fa128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.267+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa12c04ffe0 con 0x7fa13415d2d0 2023-12-19T16:18:08.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa13406b3d0 con 0x7fa13415d2d0 2023-12-19T16:18:08.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa1317fa640 1 -- 172.21.15.119:0/152486135 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa12c053600 con 0x7fa13415d2d0 2023-12-19T16:18:08.418 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:18:08.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa118065a60 msgr2=0x7fa118067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa118065a60 0x7fa118067f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa128006fd0 tx=0x7fa128008040 comp rx=0 tx=0).stop 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 msgr2=0x7fa13415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 0x7fa13415a440 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c780 tx=0x7fa12c00cc40 comp rx=0 tx=0).stop 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 shutdown_connections 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa118065a60 0x7fa118067f20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa13415cb30 0x7fa134154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa13415d2d0 0x7fa13415a440 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 --2- 172.21.15.119:0/152486135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1340cefe0 0x7fa1340cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 >> 172.21.15.119:0/152486135 conn(0x7fa134089fb0 msgr2=0x7fa1340b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 shutdown_connections 2023-12-19T16:18:08.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.415+0000 7fa139d5a640 1 -- 172.21.15.119:0/152486135 wait complete. 2023-12-19T16:18:08.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:08.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 Processor -- start 2023-12-19T16:18:08.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 -- start start 2023-12-19T16:18:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab84071870 0x7fab84071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab840cbff0 0x7fab840cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab840cc930 con 0x7fab840ca410 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8415aab0 con 0x7fab840cbff0 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8c78f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab84070df0 con 0x7fab84071870 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab840cbff0 0x7fab840cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab840cbff0 0x7fab840cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52336/0 (socket says 172.21.15.119:52336) 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 -- 172.21.15.119:0/1767873700 learned_addr learned my addr 172.21.15.119:0/1767873700 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8a52b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fab840ca410 0x7fab84159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33128/0 (socket says 172.21.15.119:33128) 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab89d2a640 1 --2- 172.21.15.119:0/1767873700 >> v2:172.21.15.143:3300/0 conn(0x7fab84071870 0x7fab84071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 -- 172.21.15.119:0/1767873700 >> v2:172.21.15.143:3300/0 conn(0x7fab84071870 msgr2=0x7fab84071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 --2- 172.21.15.119:0/1767873700 >> v2:172.21.15.143:3300/0 conn(0x7fab84071870 0x7fab84071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 -- 172.21.15.119:0/1767873700 >> v1:172.21.15.119:6789/0 conn(0x7fab840ca410 legacy=0x7fab84159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab8ad2c640 1 -- 172.21.15.119:0/1767873700 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8415a4f0 con 0x7fab840cbff0 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab89d2a640 1 --2- 172.21.15.119:0/1767873700 >> v2:172.21.15.143:3300/0 conn(0x7fab84071870 0x7fab84071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:08.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.579+0000 7fab89529640 1 -- 172.21.15.119:0/1767873700 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116025772 0 0) 0x7fab840cc930 con 0x7fab840ca410 2023-12-19T16:18:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8ad2c640 1 --2- 172.21.15.119:0/1767873700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab840cc3f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fab840cbeb0 tx=0x7fab7c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b7847c88011b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab89529640 1 -- 172.21.15.119:0/1767873700 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00b2d0 con 0x7fab840cbff0 2023-12-19T16:18:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab89529640 1 -- 172.21.15.119:0/1767873700 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c00b430 con 0x7fab840cbff0 2023-12-19T16:18:08.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab89529640 1 -- 172.21.15.119:0/1767873700 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0a7c90 con 0x7fab840cbff0 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 -- 172.21.15.119:0/1767873700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 msgr2=0x7fab840cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 --2- 172.21.15.119:0/1767873700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab840cc3f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fab840cbeb0 tx=0x7fab7c01eba0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 -- 172.21.15.119:0/1767873700 shutdown_connections 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 --2- 172.21.15.119:0/1767873700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab840cc3f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 --2- 172.21.15.119:0/1767873700 >> v2:172.21.15.143:3300/0 conn(0x7fab84071870 0x7fab84071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 -- 172.21.15.119:0/1767873700 >> 172.21.15.119:0/1767873700 conn(0x7fab8406a2a0 msgr2=0x7fab840aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 -- 172.21.15.119:0/1767873700 shutdown_connections 2023-12-19T16:18:08.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.583+0000 7fab8c78f640 1 -- 172.21.15.119:0/1767873700 wait complete. 2023-12-19T16:18:08.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 Processor -- start 2023-12-19T16:18:08.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- start start 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab84071870 0x7fab84153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab840ca410 0x7fab841519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab8414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab84151f20 con 0x7fab840cbff0 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab84155380 con 0x7fab84071870 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab841f5990 con 0x7fab840ca410 2023-12-19T16:18:08.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab8414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab8414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52346/0 (socket says 172.21.15.119:52346) 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 -- 172.21.15.119:0/4112340243 learned_addr learned my addr 172.21.15.119:0/4112340243 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8a52b640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab84071870 0x7fab84153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab89d2a640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab840ca410 0x7fab841519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 -- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab840ca410 msgr2=0x7fab841519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab840ca410 0x7fab841519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 -- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab84071870 msgr2=0x7fab84153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab84071870 0x7fab84153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 -- 172.21.15.119:0/4112340243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c00bd40 con 0x7fab840cbff0 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8a52b640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab84071870 0x7fab84153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:08.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8ad2c640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab8414db50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fab7c01b7b0 tx=0x7fab7c01b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c009800 con 0x7fab840cbff0 2023-12-19T16:18:08.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c0099a0 con 0x7fab840cbff0 2023-12-19T16:18:08.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c009d50 con 0x7fab840cbff0 2023-12-19T16:18:08.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab84154220 con 0x7fab840cbff0 2023-12-19T16:18:08.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab841f5ec0 con 0x7fab840cbff0 2023-12-19T16:18:08.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.587+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8404e000 con 0x7fab840cbff0 2023-12-19T16:18:08.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.591+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fab7c0c3460 con 0x7fab840cbff0 2023-12-19T16:18:08.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.591+0000 7fab7affd640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fab68065a60 0x7fab68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.591+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fab7c11eb90 con 0x7fab840cbff0 2023-12-19T16:18:08.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.591+0000 7fab8a52b640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fab68065a60 0x7fab68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.591+0000 7fab8a52b640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fab68065a60 0x7fab68067f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fab80000f70 tx=0x7fab80007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.595+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fab7c0ec370 con 0x7fab840cbff0 2023-12-19T16:18:08.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab840c9cc0 con 0x7fab840cbff0 2023-12-19T16:18:08.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab7affd640 1 -- 172.21.15.119:0/4112340243 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab7c0ef990 con 0x7fab840cbff0 2023-12-19T16:18:08.747 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fab68065a60 msgr2=0x7fab68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fab68065a60 0x7fab68067f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fab80000f70 tx=0x7fab80007c60 comp rx=0 tx=0).stop 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 msgr2=0x7fab8414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab8414db50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fab7c01b7b0 tx=0x7fab7c01b940 comp rx=0 tx=0).stop 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 shutdown_connections 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fab68065a60 0x7fab68067f20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab840cbff0 0x7fab8414db50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab840ca410 0x7fab841519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 --2- 172.21.15.119:0/4112340243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab84071870 0x7fab84153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 >> 172.21.15.119:0/4112340243 conn(0x7fab8406a2a0 msgr2=0x7fab8415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:08.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 shutdown_connections 2023-12-19T16:18:08.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.743+0000 7fab8c78f640 1 -- 172.21.15.119:0/4112340243 wait complete. 2023-12-19T16:18:08.768 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:08.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.903+0000 7ff9b42f9640 1 Processor -- start 2023-12-19T16:18:08.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.903+0000 7ff9b42f9640 1 -- start start 2023-12-19T16:18:08.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b42f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 0x7ff9ac160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b42f9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac142cd0 con 0x7ff9ac0c9690 2023-12-19T16:18:08.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b42f9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac1604c0 con 0x7ff9ac0c92b0 2023-12-19T16:18:08.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b42f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac142fb0 con 0x7ff9ac0ceac0 2023-12-19T16:18:08.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b2896640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff9ac0c9690 0x7ff9ac142020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33132/0 (socket says 172.21.15.119:33132) 2023-12-19T16:18:08.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b2896640 1 -- 172.21.15.119:0/4219139802 learned_addr learned my addr 172.21.15.119:0/4219139802 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:08.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 0x7ff9ac160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039527332 0 0) 0x7ff9ac142cd0 con 0x7ff9ac0c9690 2023-12-19T16:18:08.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff998003530 con 0x7ff9ac0c9690 2023-12-19T16:18:08.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448310815 0 0) 0x7ff998003530 con 0x7ff9ac0c9690 2023-12-19T16:18:08.911 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 msgr2=0x7ff9ac160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 0x7ff9ac160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 >> v1:172.21.15.143:6789/0 conn(0x7ff9ac0c92b0 legacy=0x7ff9ac0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac1607a0 con 0x7ff9ac0c9690 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7ff9a4001a00 con 0x7ff9ac0c9690 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 >> v1:172.21.15.119:6789/0 conn(0x7ff9ac0c9690 legacy=0x7ff9ac142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9980039b0 0x7ff998003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff998004360 0x7ff998004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 0x7ff998005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac142fb0 con 0x7ff998004360 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99800ba40 con 0x7ff9980039b0 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99800bc00 con 0x7ff9ac0ceac0 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff998004360 0x7ff998004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b2896640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 0x7ff998005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b2095640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9980039b0 0x7ff998003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 -- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 msgr2=0x7ff998005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:08.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9ac0ceac0 0x7ff998005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 -- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9980039b0 msgr2=0x7ff998003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:08.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9980039b0 0x7ff998003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.907+0000 7ff9b1894640 1 -- 172.21.15.119:0/4219139802 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998003530 con 0x7ff998004360 2023-12-19T16:18:08.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b1894640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff998004360 0x7ff998004830 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009ae0 tx=0x7ff99c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7777f5766b4a5a8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0a5640 con 0x7ff998004360 2023-12-19T16:18:08.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0a57a0 con 0x7ff998004360 2023-12-19T16:18:08.914 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b1093640 1 -- 172.21.15.119:0/4219139802 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0a5b50 con 0x7ff998004360 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 -- 172.21.15.119:0/4219139802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff998004360 msgr2=0x7ff998004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/4219139802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff998004360 0x7ff998004830 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009ae0 tx=0x7ff99c01ca50 comp rx=0 tx=0).stop 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b2896640 1 -- 172.21.15.119:0/4219139802 reap_dead start 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 -- 172.21.15.119:0/4219139802 shutdown_connections 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 -- 172.21.15.119:0/4219139802 >> 172.21.15.119:0/4219139802 conn(0x7ff9ac06a2a0 msgr2=0x7ff9ac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 -- 172.21.15.119:0/4219139802 shutdown_connections 2023-12-19T16:18:08.915 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 -- 172.21.15.119:0/4219139802 wait complete. 2023-12-19T16:18:08.916 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 Processor -- start 2023-12-19T16:18:08.917 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.911+0000 7ff9b42f9640 1 -- start start 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff998004360 0x7ff9ac0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9ac154a50 0x7ff9ac154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 0x7ff9ac1457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac071af0 con 0x7ff9ac145340 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c3b50 con 0x7ff9ac154a50 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0b3f80 con 0x7ff998004360 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 0x7ff9ac1457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 0x7ff9ac1457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52360/0 (socket says 172.21.15.119:52360) 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 -- 172.21.15.119:0/449431244 learned_addr learned my addr 172.21.15.119:0/449431244 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:08.919 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b1894640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9ac154a50 0x7ff9ac154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2095640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff998004360 0x7ff9ac0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 -- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff998004360 msgr2=0x7ff9ac0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff998004360 0x7ff9ac0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 -- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9ac154a50 msgr2=0x7ff9ac154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9ac154a50 0x7ff9ac154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 -- 172.21.15.119:0/449431244 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0b3720 con 0x7ff9ac145340 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b2896640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 0x7ff9ac1457c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b4590 tx=0x7ff9a4007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400aaf0 con 0x7ff9ac145340 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400ac50 con 0x7ff9ac145340 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40133f0 con 0x7ff9ac145340 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0b39c0 con 0x7ff9ac145340 2023-12-19T16:18:08.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac155410 con 0x7ff9ac145340 2023-12-19T16:18:08.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.915+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac04e000 con 0x7ff9ac145340 2023-12-19T16:18:08.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.919+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9a4013550 con 0x7ff9ac145340 2023-12-19T16:18:08.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.919+0000 7ff9a2ffd640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff990065a60 0x7ff990067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:08.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.919+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff9a4083870 con 0x7ff9ac145340 2023-12-19T16:18:08.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.919+0000 7ff9b2095640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff990065a60 0x7ff990067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:08.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.919+0000 7ff9b2095640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff990065a60 0x7ff990067f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8012450 tx=0x7ff9a800a8a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:08.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:08.923+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9a4051050 con 0x7ff9ac145340 2023-12-19T16:18:09.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9ac0c3c90 con 0x7ff9ac145340 2023-12-19T16:18:09.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9a2ffd640 1 -- 172.21.15.119:0/449431244 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9a4054670 con 0x7ff9ac145340 2023-12-19T16:18:09.075 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff990065a60 msgr2=0x7ff990067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff990065a60 0x7ff990067f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8012450 tx=0x7ff9a800a8a0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 msgr2=0x7ff9ac1457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 0x7ff9ac1457c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b4590 tx=0x7ff9a4007b00 comp rx=0 tx=0).stop 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 shutdown_connections 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff990065a60 0x7ff990067f20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9ac154a50 0x7ff9ac154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9ac145340 0x7ff9ac1457c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 --2- 172.21.15.119:0/449431244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff998004360 0x7ff9ac0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 >> 172.21.15.119:0/449431244 conn(0x7ff9ac06a2a0 msgr2=0x7ff9ac0ac120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:09.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 shutdown_connections 2023-12-19T16:18:09.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.071+0000 7ff9b42f9640 1 -- 172.21.15.119:0/449431244 wait complete. 2023-12-19T16:18:09.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:18:09.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f1395820640 1 Processor -- start 2023-12-19T16:18:09.235 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f1395820640 1 -- start start 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f1395820640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13900cf530 0x7f1390168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f1395820640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13900d11c0 con 0x7f139015ca40 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f1395820640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13900d0310 con 0x7f13900cf0d0 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f1395820640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13900d05b0 con 0x7f13900cf530 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f138effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f139015ca40 0x7f13900cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33136/0 (socket says 172.21.15.119:33136) 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f138effd640 1 -- 172.21.15.119:0/1055492515 learned_addr learned my addr 172.21.15.119:0/1055492515 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f138f7fe640 1 --2- 172.21.15.119:0/1055492515 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13900cf530 0x7f1390168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159622955 0 0) 0x7f13900d11c0 con 0x7f139015ca40 2023-12-19T16:18:09.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.231+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1378003530 con 0x7f139015ca40 2023-12-19T16:18:09.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649204988 0 0) 0x7f13900d0310 con 0x7f13900cf0d0 2023-12-19T16:18:09.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13900d11c0 con 0x7f13900cf0d0 2023-12-19T16:18:09.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138f7fe640 1 -- 172.21.15.119:0/1055492515 >> v1:172.21.15.143:6789/0 conn(0x7f13900cf0d0 legacy=0x7f13901648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138f7fe640 1 -- 172.21.15.119:0/1055492515 >> v1:172.21.15.119:6789/0 conn(0x7f139015ca40 legacy=0x7f13900cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138f7fe640 1 -- 172.21.15.119:0/1055492515 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13900d0890 con 0x7f13900cf530 2023-12-19T16:18:09.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138f7fe640 1 --2- 172.21.15.119:0/1055492515 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13900cf530 0x7f1390168000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1388009dc0 tx=0x7f138801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89ceb2279aec0ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:09.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880a5a00 con 0x7f13900cf530 2023-12-19T16:18:09.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13880a5b60 con 0x7f13900cf530 2023-12-19T16:18:09.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f138dffb640 1 -- 172.21.15.119:0/1055492515 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880ad440 con 0x7f13900cf530 2023-12-19T16:18:09.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f1395820640 1 -- 172.21.15.119:0/1055492515 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13900cf530 msgr2=0x7f1390168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f1395820640 1 --2- 172.21.15.119:0/1055492515 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13900cf530 0x7f1390168000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1388009dc0 tx=0x7f138801c940 comp rx=0 tx=0).stop 2023-12-19T16:18:09.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f1395820640 1 -- 172.21.15.119:0/1055492515 shutdown_connections 2023-12-19T16:18:09.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f1395820640 1 --2- 172.21.15.119:0/1055492515 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13900cf530 0x7f1390168000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.235+0000 7f1395820640 1 -- 172.21.15.119:0/1055492515 >> 172.21.15.119:0/1055492515 conn(0x7f1390089fb0 msgr2=0x7f13900d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:09.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 -- 172.21.15.119:0/1055492515 shutdown_connections 2023-12-19T16:18:09.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 -- 172.21.15.119:0/1055492515 wait complete. 2023-12-19T16:18:09.242 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 Processor -- start 2023-12-19T16:18:09.243 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 -- start start 2023-12-19T16:18:09.244 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 0x7f13900c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13900cf530 0x7f139015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139015ca40 0x7f13900b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13900c6790 con 0x7f13900cf0d0 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13900ca860 con 0x7f13900cf530 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f1395820640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13900c6980 con 0x7f139015ca40 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 0x7f13900c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 0x7f13900c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52364/0 (socket says 172.21.15.119:52364) 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 -- 172.21.15.119:0/4290887526 learned_addr learned my addr 172.21.15.119:0/4290887526 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138e7fc640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13900cf530 0x7f139015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138f7fe640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139015ca40 0x7f13900b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 -- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139015ca40 msgr2=0x7f13900b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139015ca40 0x7f13900b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.245 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 -- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13900cf530 msgr2=0x7f139015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13900cf530 0x7f139015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 -- 172.21.15.119:0/4290887526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009a70 con 0x7f13900cf0d0 2023-12-19T16:18:09.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138e7fc640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13900cf530 0x7f139015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:09.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138f7fe640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139015ca40 0x7f13900b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:09.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.239+0000 7f138effd640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 0x7f13900c6250 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f138000c680 tx=0x7f138000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:09.246 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380007270 con 0x7f13900cf0d0 2023-12-19T16:18:09.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13800073d0 con 0x7f13900cf0d0 2023-12-19T16:18:09.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000ce80 con 0x7f13900cf0d0 2023-12-19T16:18:09.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13900caab0 con 0x7f13900cf0d0 2023-12-19T16:18:09.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13900cb070 con 0x7f13900cf0d0 2023-12-19T16:18:09.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139004e000 con 0x7f13900cf0d0 2023-12-19T16:18:09.247 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f13800057b0 con 0x7f13900cf0d0 2023-12-19T16:18:09.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1377fff640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f137c065a60 0x7f137c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f13800826f0 con 0x7f13900cf0d0 2023-12-19T16:18:09.248 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f138e7fc640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f137c065a60 0x7f137c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.243+0000 7f138e7fc640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f137c065a60 0x7f137c067f20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13900b2ce0 tx=0x7f1384009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:09.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.247+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f13800500b0 con 0x7f13900cf0d0 2023-12-19T16:18:09.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f13900cc840 con 0x7f13900cf0d0 2023-12-19T16:18:09.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1377fff640 1 -- 172.21.15.119:0/4290887526 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1380017080 con 0x7f13900cf0d0 2023-12-19T16:18:09.414 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f137c065a60 msgr2=0x7f137c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f137c065a60 0x7f137c067f20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13900b2ce0 tx=0x7f1384009040 comp rx=0 tx=0).stop 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 msgr2=0x7f13900c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 0x7f13900c6250 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f138000c680 tx=0x7f138000cb40 comp rx=0 tx=0).stop 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 shutdown_connections 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f137c065a60 0x7f137c067f20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13900cf530 0x7f139015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139015ca40 0x7f13900b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 --2- 172.21.15.119:0/4290887526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13900cf0d0 0x7f13900c6250 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 >> 172.21.15.119:0/4290887526 conn(0x7f1390089fb0 msgr2=0x7f13900afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:09.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 shutdown_connections 2023-12-19T16:18:09.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.411+0000 7f1395820640 1 -- 172.21.15.119:0/4290887526 wait complete. 2023-12-19T16:18:09.435 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:18:09.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:09.435 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:09.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[52721]: fuse finished with error 0 and tester_r 0 2023-12-19T16:18:09.456 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:09.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:18:09.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:09.483 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:18:09.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:18:09.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 Processor -- start 2023-12-19T16:18:09.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 -- start start 2023-12-19T16:18:09.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa1a815ca40 0x7fa1a80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1a80cf7e0 0x7fa1a81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80d11c0 con 0x7fa1a80ce3f0 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80d0310 con 0x7fa1a80cf7e0 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1aca41640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80d05b0 con 0x7fa1a815ca40 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1a80cf7e0 0x7fa1a81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1a80cf7e0 0x7fa1a81668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52372/0 (socket says 172.21.15.119:52372) 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2847263673 learned_addr learned my addr 172.21.15.119:0/2847263673 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a659c640 1 --2- 172.21.15.119:0/2847263673 >> v2:172.21.15.143:3300/0 conn(0x7fa1a815ca40 0x7fa1a80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2847263673 >> v2:172.21.15.143:3300/0 conn(0x7fa1a815ca40 msgr2=0x7fa1a80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 --2- 172.21.15.119:0/2847263673 >> v2:172.21.15.143:3300/0 conn(0x7fa1a815ca40 0x7fa1a80cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2847263673 >> v1:172.21.15.119:6789/0 conn(0x7fa1a80ce3f0 legacy=0x7fa1a80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2847263673 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80d0890 con 0x7fa1a80cf7e0 2023-12-19T16:18:09.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a559a640 1 -- 172.21.15.119:0/2847263673 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261958813 0 0) 0x7fa1a80d11c0 con 0x7fa1a80ce3f0 2023-12-19T16:18:09.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.715+0000 7fa1a659c640 1 --2- 172.21.15.119:0/2847263673 >> v2:172.21.15.143:3300/0 conn(0x7fa1a815ca40 0x7fa1a80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:09.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1a6d9d640 1 --2- 172.21.15.119:0/2847263673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80cf7e0 0x7fa1a81668e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80736e0 tx=0x7fa1a001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80107e6f75aebd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:09.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1a559a640 1 -- 172.21.15.119:0/2847263673 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00aa660 con 0x7fa1a80cf7e0 2023-12-19T16:18:09.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1a559a640 1 -- 172.21.15.119:0/2847263673 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00aa7c0 con 0x7fa1a80cf7e0 2023-12-19T16:18:09.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1a559a640 1 -- 172.21.15.119:0/2847263673 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00aab50 con 0x7fa1a80cf7e0 2023-12-19T16:18:09.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 -- 172.21.15.119:0/2847263673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80cf7e0 msgr2=0x7fa1a81668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2847263673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80cf7e0 0x7fa1a81668e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80736e0 tx=0x7fa1a001c500 comp rx=0 tx=0).stop 2023-12-19T16:18:09.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 -- 172.21.15.119:0/2847263673 shutdown_connections 2023-12-19T16:18:09.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2847263673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80cf7e0 0x7fa1a81668e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2847263673 >> v2:172.21.15.143:3300/0 conn(0x7fa1a815ca40 0x7fa1a80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 -- 172.21.15.119:0/2847263673 >> 172.21.15.119:0/2847263673 conn(0x7fa1a8089fb0 msgr2=0x7fa1a80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:09.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 -- 172.21.15.119:0/2847263673 shutdown_connections 2023-12-19T16:18:09.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.719+0000 7fa1aca41640 1 -- 172.21.15.119:0/2847263673 wait complete. 2023-12-19T16:18:09.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 Processor -- start 2023-12-19T16:18:09.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 -- start start 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1a80ce3f0 0x7fa1a80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1a80cf7e0 0x7fa1a80b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 0x7fa1a8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80cb7a0 con 0x7fa1a815ca40 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8155a50 con 0x7fa1a80ce3f0 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80cab90 con 0x7fa1a80cf7e0 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 0x7fa1a8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 0x7fa1a8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52378/0 (socket says 172.21.15.119:52378) 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2027471231 learned_addr learned my addr 172.21.15.119:0/2027471231 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a659c640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1a80ce3f0 0x7fa1a80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1a80cf7e0 msgr2=0x7fa1a80b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1a80cf7e0 0x7fa1a80b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1a80ce3f0 msgr2=0x7fa1a80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1a80ce3f0 0x7fa1a80cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 -- 172.21.15.119:0/2027471231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00094d0 con 0x7fa1a815ca40 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1a6d9d640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 0x7fa1a8159900 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00ac040 tx=0x7fa1a001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00aad40 con 0x7fa1a815ca40 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00b7070 con 0x7fa1a815ca40 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a80cae70 con 0x7fa1a815ca40 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00aaea0 con 0x7fa1a815ca40 2023-12-19T16:18:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.723+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a80cb430 con 0x7fa1a815ca40 2023-12-19T16:18:09.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.727+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a80cb950 con 0x7fa1a815ca40 2023-12-19T16:18:09.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.727+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa1a0004230 con 0x7fa1a815ca40 2023-12-19T16:18:09.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.727+0000 7fa196ffd640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa188065a90 0x7fa188067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:09.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.727+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa1a00a6040 con 0x7fa1a815ca40 2023-12-19T16:18:09.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.727+0000 7fa1a659c640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa188065a90 0x7fa188067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:09.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.727+0000 7fa1a659c640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa188065a90 0x7fa188067f50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa198009a30 tx=0x7fa198003a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:09.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.731+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa1a80cb950 con 0x7fa1a815ca40 2023-12-19T16:18:09.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1a80cb950 con 0x7fa1a815ca40 2023-12-19T16:18:09.918 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa196ffd640 1 -- 172.21.15.119:0/2027471231 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa1a80cb950 con 0x7fa1a815ca40 2023-12-19T16:18:09.918 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:18:09.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa188065a90 msgr2=0x7fa188067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa188065a90 0x7fa188067f50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa198009a30 tx=0x7fa198003a00 comp rx=0 tx=0).stop 2023-12-19T16:18:09.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 msgr2=0x7fa1a8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:09.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 0x7fa1a8159900 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00ac040 tx=0x7fa1a001ad40 comp rx=0 tx=0).stop 2023-12-19T16:18:09.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 shutdown_connections 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa188065a90 0x7fa188067f50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a815ca40 0x7fa1a8159900 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1a80cf7e0 0x7fa1a80b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 --2- 172.21.15.119:0/2027471231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1a80ce3f0 0x7fa1a80cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 >> 172.21.15.119:0/2027471231 conn(0x7fa1a8089fb0 msgr2=0x7fa1a80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 shutdown_connections 2023-12-19T16:18:09.921 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:09.915+0000 7fa1aca41640 1 -- 172.21.15.119:0/2027471231 wait complete. 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:18:09.939 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:18:09.940 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:18:09.940 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:18:09.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:09.940 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42269sec preferred_lft 42269sec 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:b3:f9:6b:a2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:18:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.952 INFO:teuthology.orchestra.run.smithi119.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:18:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:18:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:18:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:18:09.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:09.953 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:18:10.011 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-19T16:18:10.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.013 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-19T16:18:10.071 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-19T16:18:10.071 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:18:10.071 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:18:10.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.072 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-19T16:18:10.072 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-19T16:18:10.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:18:10.073 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:18:10.073 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:18:10.073 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-19T16:18:10.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.165 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:18:10.175 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:18:10.175 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:18:10.175 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:18:10.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-19T16:18:10.242 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T16:18:10.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:18:10.242 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:10.297 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:18:10.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:18:10.298 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:10.349 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:18:10.414 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:18:10.414 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:18:10.475 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:18:10.477 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:18:10.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.477 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:18:10.533 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T16:18:10.533 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T16:18:10.580 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-12-19T16:18:10.601 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T16:18:10.602 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T16:18:10.663 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T16:18:10.665 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T16:18:10.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.665 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-12-19T16:18:10.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-12-19T16:18:10.671+0000 7fd606e47580 -1 init, newargv = 0x55ddf2d684a0 newargc=15 2023-12-19T16:18:10.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[53119]: starting ceph client 2023-12-19T16:18:10.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[53119]: starting fuse 2023-12-19T16:18:10.686 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-12-19T16:18:10.686 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-19T16:18:10.686 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-12-19T16:18:10.687 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-12-19T16:18:10.688 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:18:10.807 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.53119.asok 2023-12-19T16:18:10.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53119.asok 2023-12-19T16:18:10.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:10.992 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53119.asok status 2023-12-19T16:18:11.161 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:11.161 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "53119", 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 6510, 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-12-19T16:18:11.162 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 6510 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3817831422 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-12-19T16:18:11.163 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3817831422 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.6510 192.168.0.1:0/3817831422", 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/3817831422", 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 26, 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 55, 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-12-19T16:18:11.164 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:11.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:11.176 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-12-19T16:18:11.176 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:11.186 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-12-19T16:18:11.186 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:11.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:11.187 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> import errno 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> try: 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> if True: 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> ret = os.read(fd, 1024) 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> else: 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> os.write(fd, b'"'"'content'"'"') 2023-12-19T16:18:11.253 DEBUG:teuthology.orchestra.run.smithi119:> except OSError as e: 2023-12-19T16:18:11.254 DEBUG:teuthology.orchestra.run.smithi119:> if e.errno != errno.EPERM: 2023-12-19T16:18:11.254 DEBUG:teuthology.orchestra.run.smithi119:> raise 2023-12-19T16:18:11.254 DEBUG:teuthology.orchestra.run.smithi119:> else: 2023-12-19T16:18:11.254 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("client does not check permission of data pool") 2023-12-19T16:18:11.254 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-12-19T16:18:11.361 INFO:teuthology.orchestra.run.smithi119.stderr:Traceback (most recent call last): 2023-12-19T16:18:11.361 INFO:teuthology.orchestra.run.smithi119.stderr: File "", line 15, in 2023-12-19T16:18:11.361 INFO:teuthology.orchestra.run.smithi119.stderr:RuntimeError: client does not check permission of data pool 2023-12-19T16:18:11.542 INFO:teuthology.orchestra.run.smithi119.stderr:daemon-helper: command failed with exit status 1 2023-12-19T16:18:11.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:18:11.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-12-19T16:18:11.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.731+0000 7f7d89ac3640 1 Processor -- start 2023-12-19T16:18:11.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d89ac3640 1 -- start start 2023-12-19T16:18:11.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d89ac3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 0x7f7d840b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:11.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d89ac3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d840cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:11.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d89ac3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d840b1500 con 0x7f7d840d04b0 2023-12-19T16:18:11.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d89ac3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840ce6b0 con 0x7f7d8415cb20 2023-12-19T16:18:11.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d89ac3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840b0f40 con 0x7f7d840b0710 2023-12-19T16:18:11.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d7bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 0x7f7d840b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:11.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d892c2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d840cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:11.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d88ac1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7d840d04b0 0x7f7d840d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:58712/0 (socket says 172.21.15.119:58712) 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d7bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 0x7f7d840b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:59132/0 (socket says 172.21.15.119:59132) 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d88ac1640 1 -- 172.21.15.119:0/3791318687 learned_addr learned my addr 172.21.15.119:0/3791318687 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d892c2640 1 -- 172.21.15.119:0/3791318687 >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 msgr2=0x7f7d840b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d892c2640 1 --2- 172.21.15.119:0/3791318687 >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 0x7f7d840b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d892c2640 1 -- 172.21.15.119:0/3791318687 >> v1:172.21.15.143:6789/0 conn(0x7f7d840d04b0 legacy=0x7f7d840d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d892c2640 1 -- 172.21.15.119:0/3791318687 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840b1220 con 0x7f7d840b0710 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d7bfff640 1 --2- 172.21.15.119:0/3791318687 >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 0x7f7d840b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:11.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.735+0000 7f7d7b7fe640 1 -- 172.21.15.119:0/3791318687 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148224024 0 0) 0x7f7d840b1500 con 0x7f7d840d04b0 2023-12-19T16:18:11.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d892c2640 1 --2- 172.21.15.119:0/3791318687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d840cf0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ba68b7437bf5a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:11.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d7b7fe640 1 -- 172.21.15.119:0/3791318687 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0a59e0 con 0x7f7d840b0710 2023-12-19T16:18:11.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d7b7fe640 1 -- 172.21.15.119:0/3791318687 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0a5b40 con 0x7f7d840b0710 2023-12-19T16:18:11.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d7b7fe640 1 -- 172.21.15.119:0/3791318687 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0ad440 con 0x7f7d840b0710 2023-12-19T16:18:11.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 -- 172.21.15.119:0/3791318687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 msgr2=0x7f7d840cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:11.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/3791318687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d840cf0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c01c920 comp rx=0 tx=0).stop 2023-12-19T16:18:11.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 -- 172.21.15.119:0/3791318687 shutdown_connections 2023-12-19T16:18:11.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/3791318687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d840cf0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/3791318687 >> v2:172.21.15.143:3300/0 conn(0x7f7d8415cb20 0x7f7d840b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 -- 172.21.15.119:0/3791318687 >> 172.21.15.119:0/3791318687 conn(0x7f7d84089fb0 msgr2=0x7f7d8408a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:11.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 -- 172.21.15.119:0/3791318687 shutdown_connections 2023-12-19T16:18:11.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 -- 172.21.15.119:0/3791318687 wait complete. 2023-12-19T16:18:11.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 Processor -- start 2023-12-19T16:18:11.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.739+0000 7f7d89ac3640 1 -- start start 2023-12-19T16:18:11.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d8414a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:11.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d840d04b0 0x7f7d8415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:11.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 0x7f7d84154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:11.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8414a830 con 0x7f7d8415cb20 2023-12-19T16:18:11.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8415ebe0 con 0x7f7d840d04b0 2023-12-19T16:18:11.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8415eec0 con 0x7f7d840b0710 2023-12-19T16:18:11.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 0x7f7d84154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:11.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d88ac1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d8414a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:11.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 0x7f7d84154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52380/0 (socket says 172.21.15.119:52380) 2023-12-19T16:18:11.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 -- 172.21.15.119:0/1076003984 learned_addr learned my addr 172.21.15.119:0/1076003984 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:11.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d7bfff640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d840d04b0 0x7f7d8415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 -- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 msgr2=0x7f7d8414a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d8414a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 -- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d840d04b0 msgr2=0x7f7d8415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d840d04b0 0x7f7d8415e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 -- 172.21.15.119:0/1076003984 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74009420 con 0x7f7d8415cb20 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d892c2640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 0x7f7d84154e60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c01afd0 tx=0x7f7d7c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0add90 con 0x7f7d8415cb20 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c009450 con 0x7f7d8415cb20 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b9670 con 0x7f7d8415cb20 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c009a70 con 0x7f7d8415cb20 2023-12-19T16:18:11.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d840c4c60 con 0x7f7d8415cb20 2023-12-19T16:18:11.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.743+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8415f3e0 con 0x7f7d8415cb20 2023-12-19T16:18:11.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.747+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d7c0b97d0 con 0x7f7d8415cb20 2023-12-19T16:18:11.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.747+0000 7f7d797fa640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d70065a60 0x7f7d70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:11.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.747+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7d7c11e8b0 con 0x7f7d8415cb20 2023-12-19T16:18:11.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.747+0000 7f7d88ac1640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d70065a60 0x7f7d70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:11.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.747+0000 7f7d88ac1640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d70065a60 0x7f7d70067f20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:11.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.751+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d7c0ec270 con 0x7f7d8415cb20 2023-12-19T16:18:11.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.955+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7d840c4e50 con 0x7f7d8415cb20 2023-12-19T16:18:11.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.959+0000 7f7d797fa640 1 -- 172.21.15.119:0/1076003984 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7d7c0ef890 con 0x7f7d8415cb20 2023-12-19T16:18:11.963 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d70065a60 msgr2=0x7f7d70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d70065a60 0x7f7d70067f20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80007d60 comp rx=0 tx=0).stop 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 msgr2=0x7f7d84154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 0x7f7d84154e60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c01afd0 tx=0x7f7d7c0196c0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 shutdown_connections 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7d70065a60 0x7f7d70067f20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d840d04b0 0x7f7d8415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d8415cb20 0x7f7d84154e60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 --2- 172.21.15.119:0/1076003984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d840b0710 0x7f7d8414a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:11.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 >> 172.21.15.119:0/1076003984 conn(0x7f7d84089fb0 msgr2=0x7f7d84072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:11.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 shutdown_connections 2023-12-19T16:18:11.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:11.963+0000 7f7d89ac3640 1 -- 172.21.15.119:0/1076003984 wait complete. 2023-12-19T16:18:11.984 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:18:11.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:18:12.084 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:18:12.192 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:18:12.193 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:12.193 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:12.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:12.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 Processor -- start 2023-12-19T16:18:12.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 -- start start 2023-12-19T16:18:12.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcec81570c0 0x7fcec806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec806c320 0x7fcec80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80c9460 con 0x7fcec80c9e30 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec806c7a0 con 0x7fcec81570c0 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fced048c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec81574a0 con 0x7fcec806c320 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcece228640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcec81570c0 0x7fcec806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcecea29640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcec80c9e30 0x7fcec815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33152/0 (socket says 172.21.15.119:33152) 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcecea29640 1 -- 172.21.15.119:0/3943338467 learned_addr learned my addr 172.21.15.119:0/3943338467 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcecda27640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec806c320 0x7fcec80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcece228640 1 -- 172.21.15.119:0/3943338467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec806c320 msgr2=0x7fcec80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcecd226640 1 -- 172.21.15.119:0/3943338467 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209412985 0 0) 0x7fcec80c9460 con 0x7fcec80c9e30 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcece228640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec806c320 0x7fcec80c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcece228640 1 -- 172.21.15.119:0/3943338467 >> v1:172.21.15.119:6789/0 conn(0x7fcec80c9e30 legacy=0x7fcec815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcece228640 1 -- 172.21.15.119:0/3943338467 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec80c8b30 con 0x7fcec81570c0 2023-12-19T16:18:12.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.383+0000 7fcecda27640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec806c320 0x7fcec80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:12.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fcece228640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec81570c0 0x7fcec806bde0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcec40097c0 tx=0x7fcec401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd914e0846f209a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:12.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fcecd226640 1 -- 172.21.15.119:0/3943338467 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40ab600 con 0x7fcec81570c0 2023-12-19T16:18:12.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fcecd226640 1 -- 172.21.15.119:0/3943338467 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec40a7050 con 0x7fcec81570c0 2023-12-19T16:18:12.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fcecd226640 1 -- 172.21.15.119:0/3943338467 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40ab980 con 0x7fcec81570c0 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 -- 172.21.15.119:0/3943338467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec81570c0 msgr2=0x7fcec806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec81570c0 0x7fcec806bde0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcec40097c0 tx=0x7fcec401c3c0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 -- 172.21.15.119:0/3943338467 shutdown_connections 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec806c320 0x7fcec80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 --2- 172.21.15.119:0/3943338467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec81570c0 0x7fcec806bde0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 -- 172.21.15.119:0/3943338467 >> 172.21.15.119:0/3943338467 conn(0x7fcec806a3e0 msgr2=0x7fcec80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 -- 172.21.15.119:0/3943338467 shutdown_connections 2023-12-19T16:18:12.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.387+0000 7fced048c640 1 -- 172.21.15.119:0/3943338467 wait complete. 2023-12-19T16:18:12.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 Processor -- start 2023-12-19T16:18:12.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- start start 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 0x7fcec815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcec80c9e30 0x7fcec8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec81570c0 0x7fcec80cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec815f070 con 0x7fcec806c320 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c8020 con 0x7fcec80c9e30 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c7bc0 con 0x7fcec81570c0 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 0x7fcec815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 0x7fcec815eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52386/0 (socket says 172.21.15.119:52386) 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 -- 172.21.15.119:0/1320245972 learned_addr learned my addr 172.21.15.119:0/1320245972 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:12.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 -- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec81570c0 msgr2=0x7fcec80cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcecea29640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec81570c0 0x7fcec80cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcecda27640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcec80c9e30 0x7fcec8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec81570c0 0x7fcec80cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 -- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcec80c9e30 msgr2=0x7fcec8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcec80c9e30 0x7fcec8153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 -- 172.21.15.119:0/1320245972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec4009420 con 0x7fcec806c320 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcecea29640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec81570c0 0x7fcec80cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:12.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcecda27640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcec80c9e30 0x7fcec8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcece228640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 0x7fcec815eb30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcec40ae040 tx=0x7fcec401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40b7650 con 0x7fcec806c320 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec40b77b0 con 0x7fcec806c320 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec80c7600 con 0x7fcec806c320 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40b7b60 con 0x7fcec806c320 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec80c82c0 con 0x7fcec806c320 2023-12-19T16:18:12.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.391+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec80735b0 con 0x7fcec806c320 2023-12-19T16:18:12.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.395+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcec40b7cc0 con 0x7fcec806c320 2023-12-19T16:18:12.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.395+0000 7fcebeffd640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fceac065a60 0x7fceac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.395+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcec411dce0 con 0x7fcec806c320 2023-12-19T16:18:12.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.395+0000 7fcecda27640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fceac065a60 0x7fceac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.395+0000 7fcecda27640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fceac065a60 0x7fceac067f20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcec815e300 tx=0x7fceb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:12.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.399+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcec40eb670 con 0x7fcec806c320 2023-12-19T16:18:12.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.551+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcec804e000 con 0x7fcec806c320 2023-12-19T16:18:12.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.551+0000 7fcebeffd640 1 -- 172.21.15.119:0/1320245972 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fcec40bb090 con 0x7fcec806c320 2023-12-19T16:18:12.556 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:12.556 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:12.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fceac065a60 msgr2=0x7fceac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fceac065a60 0x7fceac067f20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcec815e300 tx=0x7fceb8008040 comp rx=0 tx=0).stop 2023-12-19T16:18:12.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 msgr2=0x7fcec815eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 0x7fcec815eb30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcec40ae040 tx=0x7fcec401ac00 comp rx=0 tx=0).stop 2023-12-19T16:18:12.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 shutdown_connections 2023-12-19T16:18:12.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fceac065a60 0x7fceac067f20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcec80c9e30 0x7fcec8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcec81570c0 0x7fcec80cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 --2- 172.21.15.119:0/1320245972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcec806c320 0x7fcec815eb30 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 >> 172.21.15.119:0/1320245972 conn(0x7fcec806a3e0 msgr2=0x7fcec81557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:12.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 shutdown_connections 2023-12-19T16:18:12.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.555+0000 7fced048c640 1 -- 172.21.15.119:0/1320245972 wait complete. 2023-12-19T16:18:12.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:49.778202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:51.022485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:12.577 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:12.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 Processor -- start 2023-12-19T16:18:12.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 -- start start 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f599c1582d0 0x7f599c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f599c070820 0x7f599c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0c9390 con 0x7f599c0ce3b0 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c15aee0 con 0x7f599c070820 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f59a0b7b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c15b1c0 con 0x7f599c1582d0 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f599c070820 0x7f599c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f599c070820 0x7f599c0ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57044/0 (socket says 172.21.15.119:57044) 2023-12-19T16:18:12.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 -- 172.21.15.119:0/1260945561 learned_addr learned my addr 172.21.15.119:0/1260945561 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f599ad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f599c0ce3b0 0x7f599c0cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54334/0 (socket says 172.21.15.119:54334) 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f599a59c640 1 --2- 172.21.15.119:0/1260945561 >> v2:172.21.15.143:3300/0 conn(0x7f599c1582d0 0x7f599c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 -- 172.21.15.119:0/1260945561 >> v2:172.21.15.143:3300/0 conn(0x7f599c1582d0 msgr2=0x7f599c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 --2- 172.21.15.119:0/1260945561 >> v2:172.21.15.143:3300/0 conn(0x7f599c1582d0 0x7f599c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 -- 172.21.15.119:0/1260945561 >> v1:172.21.15.119:6789/0 conn(0x7f599c0ce3b0 legacy=0x7f599c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5991d9b640 1 -- 172.21.15.119:0/1260945561 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c15b4a0 con 0x7f599c070820 2023-12-19T16:18:12.721 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.715+0000 7f5999d9b640 1 -- 172.21.15.119:0/1260945561 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312355860 0 0) 0x7f599c0c9390 con 0x7f599c0ce3b0 2023-12-19T16:18:12.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f5991d9b640 1 --2- 172.21.15.119:0/1260945561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c0ca5f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f599c0cf000 tx=0x7f598401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb01cd78daae132c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:12.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f5999d9b640 1 -- 172.21.15.119:0/1260945561 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840aa650 con 0x7f599c070820 2023-12-19T16:18:12.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f5999d9b640 1 -- 172.21.15.119:0/1260945561 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59840aa7b0 con 0x7f599c070820 2023-12-19T16:18:12.723 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f5999d9b640 1 -- 172.21.15.119:0/1260945561 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840aab40 con 0x7f599c070820 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 -- 172.21.15.119:0/1260945561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 msgr2=0x7f599c0ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/1260945561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c0ca5f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f599c0cf000 tx=0x7f598401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 -- 172.21.15.119:0/1260945561 shutdown_connections 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/1260945561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c0ca5f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/1260945561 >> v2:172.21.15.143:3300/0 conn(0x7f599c1582d0 0x7f599c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 -- 172.21.15.119:0/1260945561 >> 172.21.15.119:0/1260945561 conn(0x7f599c06a2a0 msgr2=0x7f599c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:12.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 -- 172.21.15.119:0/1260945561 shutdown_connections 2023-12-19T16:18:12.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.719+0000 7f59a0b7b640 1 -- 172.21.15.119:0/1260945561 wait complete. 2023-12-19T16:18:12.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 Processor -- start 2023-12-19T16:18:12.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 -- start start 2023-12-19T16:18:12.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ce3b0 0x7f599c0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c1582d0 0x7f599c1f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c14e250 con 0x7f599c070820 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c14da20 con 0x7f599c1582d0 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c164570 con 0x7f599c0ce3b0 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c14d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57060/0 (socket says 172.21.15.119:57060) 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 -- 172.21.15.119:0/2816054179 learned_addr learned my addr 172.21.15.119:0/2816054179 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599ad9d640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c1582d0 0x7f599c1f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f5991d9b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ce3b0 0x7f599c0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 -- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ce3b0 msgr2=0x7f599c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ce3b0 0x7f599c0cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 -- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c1582d0 msgr2=0x7f599c1f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c1582d0 0x7f599c1f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 -- 172.21.15.119:0/2816054179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840094d0 con 0x7f599c070820 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f599a59c640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c14d4e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d5f0 tx=0x7f598c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:12.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0125f0 con 0x7f599c070820 2023-12-19T16:18:12.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c012750 con 0x7f599c070820 2023-12-19T16:18:12.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c164850 con 0x7f599c070820 2023-12-19T16:18:12.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c012ae0 con 0x7f599c070820 2023-12-19T16:18:12.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.723+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c164e10 con 0x7f599c070820 2023-12-19T16:18:12.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.727+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c04e000 con 0x7f599c070820 2023-12-19T16:18:12.730 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.727+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f598c012c40 con 0x7f599c070820 2023-12-19T16:18:12.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.727+0000 7f59937fe640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f597c065a60 0x7f597c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:12.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.727+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f598c0835b0 con 0x7f599c070820 2023-12-19T16:18:12.731 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.727+0000 7f5991d9b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f597c065a60 0x7f597c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:12.732 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.727+0000 7f5991d9b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f597c065a60 0x7f597c067f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f59840ae000 tx=0x7f59840b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:12.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.731+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f598c050f70 con 0x7f599c070820 2023-12-19T16:18:12.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.879+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f599c15f020 con 0x7f599c070820 2023-12-19T16:18:12.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.879+0000 7f59937fe640 1 -- 172.21.15.119:0/2816054179 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f598c054590 con 0x7f599c070820 2023-12-19T16:18:12.884 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f597c065a60 msgr2=0x7f597c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f597c065a60 0x7f597c067f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f59840ae000 tx=0x7f59840b5040 comp rx=0 tx=0).stop 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 msgr2=0x7f599c14d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c14d4e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d5f0 tx=0x7f598c00dab0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 shutdown_connections 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f597c065a60 0x7f597c067f20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c1582d0 0x7f599c1f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ce3b0 0x7f599c0cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 --2- 172.21.15.119:0/2816054179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f599c070820 0x7f599c14d4e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:12.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 >> 172.21.15.119:0/2816054179 conn(0x7f599c06a2a0 msgr2=0x7f599c0ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:12.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 shutdown_connections 2023-12-19T16:18:12.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:12.883+0000 7f59a0b7b640 1 -- 172.21.15.119:0/2816054179 wait complete. 2023-12-19T16:18:12.905 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:13.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 Processor -- start 2023-12-19T16:18:13.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 -- start start 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61c80cde90 0x7f61c80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f61c80cf170 0x7f61c80cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c815cec0 con 0x7f61c815cae0 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c80cfb40 con 0x7f61c80cde90 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61cd8d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c80d0530 con 0x7f61c80cf170 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61be7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61c80cde90 0x7f61c80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61c6ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f61c815cae0 0x7f61c80d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54338/0 (socket says 172.21.15.119:54338) 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61c6ffd640 1 -- 172.21.15.119:0/124778671 learned_addr learned my addr 172.21.15.119:0/124778671 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61be7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61c80cde90 0x7f61c80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57076/0 (socket says 172.21.15.119:57076) 2023-12-19T16:18:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61c77fe640 1 --2- 172.21.15.119:0/124778671 >> v2:172.21.15.143:3300/0 conn(0x7f61c80cf170 0x7f61c80cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61be7fc640 1 -- 172.21.15.119:0/124778671 >> v2:172.21.15.143:3300/0 conn(0x7f61c80cf170 msgr2=0x7f61c80cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61be7fc640 1 --2- 172.21.15.119:0/124778671 >> v2:172.21.15.143:3300/0 conn(0x7f61c80cf170 0x7f61c80cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61be7fc640 1 -- 172.21.15.119:0/124778671 >> v1:172.21.15.119:6789/0 conn(0x7f61c815cae0 legacy=0x7f61c80d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61c67fc640 1 -- 172.21.15.119:0/124778671 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695985558 0 0) 0x7f61c815cec0 con 0x7f61c815cae0 2023-12-19T16:18:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.043+0000 7f61be7fc640 1 -- 172.21.15.119:0/124778671 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80d0810 con 0x7f61c80cde90 2023-12-19T16:18:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61be7fc640 1 --2- 172.21.15.119:0/124778671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c80cde90 0x7f61c80ce2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f61c80d0310 tx=0x7f61b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bd988565db1d69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61c67fc640 1 -- 172.21.15.119:0/124778671 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b00a7070 con 0x7f61c80cde90 2023-12-19T16:18:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61c67fc640 1 -- 172.21.15.119:0/124778671 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b00ab430 con 0x7f61c80cde90 2023-12-19T16:18:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61c67fc640 1 -- 172.21.15.119:0/124778671 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b00ab7c0 con 0x7f61c80cde90 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 -- 172.21.15.119:0/124778671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c80cde90 msgr2=0x7f61c80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/124778671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c80cde90 0x7f61c80ce2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f61c80d0310 tx=0x7f61b001c430 comp rx=0 tx=0).stop 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 -- 172.21.15.119:0/124778671 shutdown_connections 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/124778671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c80cde90 0x7f61c80ce2f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/124778671 >> v2:172.21.15.143:3300/0 conn(0x7f61c80cf170 0x7f61c80cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 -- 172.21.15.119:0/124778671 >> 172.21.15.119:0/124778671 conn(0x7f61c8089fb0 msgr2=0x7f61c80d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 -- 172.21.15.119:0/124778671 shutdown_connections 2023-12-19T16:18:13.051 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 -- 172.21.15.119:0/124778671 wait complete. 2023-12-19T16:18:13.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 Processor -- start 2023-12-19T16:18:13.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.047+0000 7f61cd8d1640 1 -- start start 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c80cde90 0x7f61c80c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c80cf170 0x7f61c80b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 0x7f61c80b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80b66f0 con 0x7f61c815cae0 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80c8680 con 0x7f61c80cf170 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80c8960 con 0x7f61c80cde90 2023-12-19T16:18:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 0x7f61c80b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 0x7f61c80b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57082/0 (socket says 172.21.15.119:57082) 2023-12-19T16:18:13.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 -- 172.21.15.119:0/2369909596 learned_addr learned my addr 172.21.15.119:0/2369909596 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:13.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c6ffd640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c80cde90 0x7f61c80c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.055 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61be7fc640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c80cf170 0x7f61c80b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 -- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c80cde90 msgr2=0x7f61c80c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c80cde90 0x7f61c80c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 -- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c80cf170 msgr2=0x7f61c80b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c80cf170 0x7f61c80b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 -- 172.21.15.119:0/2369909596 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0009420 con 0x7f61c815cae0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c77fe640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 0x7f61c80b58d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f61c000efc0 tx=0x7f61c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0009b10 con 0x7f61c815cae0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000f040 con 0x7f61c815cae0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c80c8c40 con 0x7f61c815cae0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c00146c0 con 0x7f61c815cae0 2023-12-19T16:18:13.056 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c80c9200 con 0x7f61c815cae0 2023-12-19T16:18:13.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.051+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c804e000 con 0x7f61c815cae0 2023-12-19T16:18:13.057 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.055+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61c0014820 con 0x7f61c815cae0 2023-12-19T16:18:13.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.055+0000 7f61c4ff9640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61a8065a60 0x7f61a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.055+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f61c0083c80 con 0x7f61c815cae0 2023-12-19T16:18:13.058 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.055+0000 7f61c6ffd640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61a8065a60 0x7f61a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.055+0000 7f61c6ffd640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61a8065a60 0x7f61a8067f20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007fd0 tx=0x7f61b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.059+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f61c00515b0 con 0x7f61c815cae0 2023-12-19T16:18:13.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.207+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61c80d2cd0 con 0x7f61c815cae0 2023-12-19T16:18:13.211 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.207+0000 7f61c4ff9640 1 -- 172.21.15.119:0/2369909596 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61c0018020 con 0x7f61c815cae0 2023-12-19T16:18:13.211 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:18:13.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.207+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61a8065a60 msgr2=0x7f61a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61a8065a60 0x7f61a8067f20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007fd0 tx=0x7f61b8009040 comp rx=0 tx=0).stop 2023-12-19T16:18:13.213 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 msgr2=0x7f61c80b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 0x7f61c80b58d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f61c000efc0 tx=0x7f61c000c490 comp rx=0 tx=0).stop 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 shutdown_connections 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f61a8065a60 0x7f61a8067f20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c80cf170 0x7f61c80b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61c815cae0 0x7f61c80b58d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 --2- 172.21.15.119:0/2369909596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c80cde90 0x7f61c80c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 >> 172.21.15.119:0/2369909596 conn(0x7f61c8089fb0 msgr2=0x7f61c81585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 shutdown_connections 2023-12-19T16:18:13.214 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.211+0000 7f61cd8d1640 1 -- 172.21.15.119:0/2369909596 wait complete. 2023-12-19T16:18:13.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:13.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 Processor -- start 2023-12-19T16:18:13.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 -- start start 2023-12-19T16:18:13.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f22cc153020 0x7f22cc0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0c9730 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0ced60 con 0x7f22cc153020 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d3bcc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c8e00 con 0x7f22cc1598d0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d2169640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f22cc0ce8d0 0x7f22cc070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54340/0 (socket says 172.21.15.119:54340) 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d2169640 1 -- 172.21.15.119:0/3474557001 learned_addr learned my addr 172.21.15.119:0/3474557001 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1167640 1 --2- 172.21.15.119:0/3474557001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1968640 1 --2- 172.21.15.119:0/3474557001 >> v2:172.21.15.143:3300/0 conn(0x7f22cc153020 0x7f22cc0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d0966640 1 -- 172.21.15.119:0/3474557001 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943804441 0 0) 0x7f22cc0c9730 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d0966640 1 -- 172.21.15.119:0/3474557001 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b8003530 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1167640 1 -- 172.21.15.119:0/3474557001 >> v2:172.21.15.143:3300/0 conn(0x7f22cc153020 msgr2=0x7f22cc0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1167640 1 --2- 172.21.15.119:0/3474557001 >> v2:172.21.15.143:3300/0 conn(0x7f22cc153020 0x7f22cc0c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1167640 1 -- 172.21.15.119:0/3474557001 >> v1:172.21.15.119:6789/0 conn(0x7f22cc0ce8d0 legacy=0x7f22cc070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1167640 1 -- 172.21.15.119:0/3474557001 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0c90e0 con 0x7f22cc1598d0 2023-12-19T16:18:13.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.371+0000 7f22d1968640 1 --2- 172.21.15.119:0/3474557001 >> v2:172.21.15.143:3300/0 conn(0x7f22cc153020 0x7f22cc0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:13.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d1167640 1 --2- 172.21.15.119:0/3474557001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc0ce390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0097c0 tx=0x7f22bc01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cabd6edf8a9b2ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d0966640 1 -- 172.21.15.119:0/3474557001 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0ab600 con 0x7f22cc1598d0 2023-12-19T16:18:13.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d0966640 1 -- 172.21.15.119:0/3474557001 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc0a7050 con 0x7f22cc1598d0 2023-12-19T16:18:13.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d0966640 1 -- 172.21.15.119:0/3474557001 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0ab960 con 0x7f22cc1598d0 2023-12-19T16:18:13.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 -- 172.21.15.119:0/3474557001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 msgr2=0x7f22cc0ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/3474557001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc0ce390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0097c0 tx=0x7f22bc01c330 comp rx=0 tx=0).stop 2023-12-19T16:18:13.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 -- 172.21.15.119:0/3474557001 shutdown_connections 2023-12-19T16:18:13.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/3474557001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc0ce390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/3474557001 >> v2:172.21.15.143:3300/0 conn(0x7f22cc153020 0x7f22cc0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 -- 172.21.15.119:0/3474557001 >> 172.21.15.119:0/3474557001 conn(0x7f22cc06a2a0 msgr2=0x7f22cc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:13.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 -- 172.21.15.119:0/3474557001 shutdown_connections 2023-12-19T16:18:13.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 -- 172.21.15.119:0/3474557001 wait complete. 2023-12-19T16:18:13.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.375+0000 7f22d3bcc640 1 Processor -- start 2023-12-19T16:18:13.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- start start 2023-12-19T16:18:13.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 0x7f22cc0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22cc153020 0x7f22cc0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0ae4a0 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c6420 con 0x7f22cc153020 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c48f0 con 0x7f22cc1598d0 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 0x7f22cc0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 0x7f22cc0c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57096/0 (socket says 172.21.15.119:57096) 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 -- 172.21.15.119:0/1962703086 learned_addr learned my addr 172.21.15.119:0/1962703086 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1167640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22cc153020 0x7f22cc0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d2169640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 -- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 msgr2=0x7f22cc14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc14ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 -- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22cc153020 msgr2=0x7f22cc0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22cc153020 0x7f22cc0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 -- 172.21.15.119:0/1962703086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009420 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1167640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22cc153020 0x7f22cc0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:13.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d1968640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 0x7f22cc0c43b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f22c800e9b0 tx=0x7f22c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800ca00 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c800cb60 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc009420 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8013470 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc0c6140 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.379+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc04e000 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.383+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f22c80135d0 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.383+0000 7f22c27fc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f22b0065a60 0x7f22b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.383+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f22c8083580 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.383+0000 7f22d1167640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f22b0065a60 0x7f22b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.383+0000 7f22d1167640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f22b0065a60 0x7f22b0067f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0ad000 tx=0x7f22bc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.387+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f22c8050df0 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.535+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22cc0cc600 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.540 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.535+0000 7f22c27fc640 1 -- 172.21.15.119:0/1962703086 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22c8054410 con 0x7f22cc0ce8d0 2023-12-19T16:18:13.540 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:18:13.542 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f22b0065a60 msgr2=0x7f22b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f22b0065a60 0x7f22b0067f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0ad000 tx=0x7f22bc0a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 msgr2=0x7f22cc0c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 0x7f22cc0c43b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f22c800e9b0 tx=0x7f22c800ee70 comp rx=0 tx=0).stop 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 shutdown_connections 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f22b0065a60 0x7f22b0067f20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22cc153020 0x7f22cc0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22cc1598d0 0x7f22cc14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 --2- 172.21.15.119:0/1962703086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc0ce8d0 0x7f22cc0c43b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 >> 172.21.15.119:0/1962703086 conn(0x7f22cc06a2a0 msgr2=0x7f22cc15cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 shutdown_connections 2023-12-19T16:18:13.543 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.539+0000 7f22d3bcc640 1 -- 172.21.15.119:0/1962703086 wait complete. 2023-12-19T16:18:13.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:18:13.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.695+0000 7f9221020640 1 Processor -- start 2023-12-19T16:18:13.700 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.695+0000 7f9221020640 1 -- start start 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f9221020640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f921c1570c0 0x7f921c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f9221020640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f9221020640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c0c9460 con 0x7f921c06c320 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f9221020640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c06c7a0 con 0x7f921c1570c0 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f9221020640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1574a0 con 0x7f921c0ca000 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f921c1570c0 0x7f921c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f921c1570c0 0x7f921c06bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57110/0 (socket says 172.21.15.119:57110) 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 -- 172.21.15.119:0/112904318 learned_addr learned my addr 172.21.15.119:0/112904318 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921259c640 1 --1- 172.21.15.119:0/112904318 >> v1:172.21.15.119:6789/0 conn(0x7f921c06c320 0x7f921c0c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54356/0 (socket says 172.21.15.119:54356) 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 -- 172.21.15.119:0/112904318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 msgr2=0x7f921c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 --2- 172.21.15.119:0/112904318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 -- 172.21.15.119:0/112904318 >> v1:172.21.15.119:6789/0 conn(0x7f921c06c320 legacy=0x7f921c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 -- 172.21.15.119:0/112904318 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0c8b30 con 0x7f921c1570c0 2023-12-19T16:18:13.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.699+0000 7f921ad9d640 1 --2- 172.21.15.119:0/112904318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c1570c0 0x7f921c06bde0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9204009870 tx=0x7f920401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cf4519be496143 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f921a59c640 1 -- 172.21.15.119:0/112904318 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92040ab680 con 0x7f921c1570c0 2023-12-19T16:18:13.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f921a59c640 1 -- 172.21.15.119:0/112904318 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92040ab7e0 con 0x7f921c1570c0 2023-12-19T16:18:13.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f921a59c640 1 -- 172.21.15.119:0/112904318 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92040abb70 con 0x7f921c1570c0 2023-12-19T16:18:13.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- 172.21.15.119:0/112904318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c1570c0 msgr2=0x7f921c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 --2- 172.21.15.119:0/112904318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c1570c0 0x7f921c06bde0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9204009870 tx=0x7f920401c480 comp rx=0 tx=0).stop 2023-12-19T16:18:13.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- 172.21.15.119:0/112904318 shutdown_connections 2023-12-19T16:18:13.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 --2- 172.21.15.119:0/112904318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 --2- 172.21.15.119:0/112904318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c1570c0 0x7f921c06bde0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- 172.21.15.119:0/112904318 >> 172.21.15.119:0/112904318 conn(0x7f921c06a3e0 msgr2=0x7f921c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:13.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- 172.21.15.119:0/112904318 shutdown_connections 2023-12-19T16:18:13.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- 172.21.15.119:0/112904318 wait complete. 2023-12-19T16:18:13.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 Processor -- start 2023-12-19T16:18:13.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- start start 2023-12-19T16:18:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 0x7f921c1368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f921c1570c0 0x7f921c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0cc7b0 con 0x7f921c06c320 2023-12-19T16:18:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0ccd30 con 0x7f921c1570c0 2023-12-19T16:18:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.703+0000 7f9221020640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c14aa30 con 0x7f921c0ca000 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 0x7f921c1368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 0x7f921c1368c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57126/0 (socket says 172.21.15.119:57126) 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 -- 172.21.15.119:0/1769516154 learned_addr learned my addr 172.21.15.119:0/1769516154 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921259c640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921b59e640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f921c1570c0 0x7f921c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 -- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 msgr2=0x7f921c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 -- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f921c1570c0 msgr2=0x7f921c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f921c1570c0 0x7f921c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 -- 172.21.15.119:0/1769516154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040094d0 con 0x7f921c06c320 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921259c640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921b59e640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f921c1570c0 0x7f921c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f921ad9d640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 0x7f921c1368c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f92040ad040 tx=0x7f920401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92040b4800 con 0x7f921c06c320 2023-12-19T16:18:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92040b4980 con 0x7f921c06c320 2023-12-19T16:18:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92040b4d30 con 0x7f921c06c320 2023-12-19T16:18:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c0cb320 con 0x7f921c06c320 2023-12-19T16:18:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c14a750 con 0x7f921c06c320 2023-12-19T16:18:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c0735b0 con 0x7f921c06c320 2023-12-19T16:18:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.707+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f92040be3f0 con 0x7f921c06c320 2023-12-19T16:18:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.711+0000 7f9213fff640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91fc065a60 0x7f91fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.711+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f920411e250 con 0x7f921c06c320 2023-12-19T16:18:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.711+0000 7f921259c640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91fc065a60 0x7f91fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:13.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.711+0000 7f921259c640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91fc065a60 0x7f91fc067f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f921c136e00 tx=0x7f920c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:13.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.715+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f92040ebb60 con 0x7f921c06c320 2023-12-19T16:18:13.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f921c04e000 con 0x7f921c06c320 2023-12-19T16:18:13.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9213fff640 1 -- 172.21.15.119:0/1769516154 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92040ef180 con 0x7f921c06c320 2023-12-19T16:18:13.878 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91fc065a60 msgr2=0x7f91fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91fc065a60 0x7f91fc067f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f921c136e00 tx=0x7f920c009040 comp rx=0 tx=0).stop 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 msgr2=0x7f921c1368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 0x7f921c1368c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f92040ad040 tx=0x7f920401acc0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 shutdown_connections 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f91fc065a60 0x7f91fc067f20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f921c1570c0 0x7f921c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f921c0ca000 0x7f921c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 --2- 172.21.15.119:0/1769516154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c06c320 0x7f921c1368c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:13.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 >> 172.21.15.119:0/1769516154 conn(0x7f921c06a3e0 msgr2=0x7f921c155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:13.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 shutdown_connections 2023-12-19T16:18:13.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:13.875+0000 7f9221020640 1 -- 172.21.15.119:0/1769516154 wait complete. 2023-12-19T16:18:13.899 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-12-19T16:18:13.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:13.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:13.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[53119]: fuse finished with error 0 and tester_r 0 2023-12-19T16:18:13.920 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:18:13.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:13.920 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:18:14.061 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:18:14.061 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:14.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:14.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:18:14.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:14.071 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T16:18:14.122 INFO:teuthology.orchestra.run.smithi143.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T16:18:14.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:18:14.123 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:14.123 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:14.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:18:14.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:18:14.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:14.133 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T16:18:14.180 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T16:18:14.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:18:14.181 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:18:14.182 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:14.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:14.191 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:18:14.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:14.191 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T16:18:14.242 INFO:teuthology.orchestra.run.smithi143.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T16:18:14.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:18:14.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:14.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.375+0000 7fde90c54640 1 Processor -- start 2023-12-19T16:18:14.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.375+0000 7fde90c54640 1 -- start start 2023-12-19T16:18:14.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde90c54640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fde8c15c740 0x7fde8c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde90c54640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde90c54640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde8c160350 0x7fde8c160750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde90c54640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c0cc370 con 0x7fde8c160350 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde90c54640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c0cc580 con 0x7fde8c15c740 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde90c54640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0cc860 con 0x7fde8c0ab8a0 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde8c160350 0x7fde8c160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde8c160350 0x7fde8c160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57136/0 (socket says 172.21.15.119:57136) 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 -- 172.21.15.119:0/2389140038 learned_addr learned my addr 172.21.15.119:0/2389140038 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8b7fe640 1 --2- 172.21.15.119:0/2389140038 >> v2:172.21.15.143:3300/0 conn(0x7fde8c15c740 0x7fde8c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8affd640 1 --2- 172.21.15.119:0/2389140038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 -- 172.21.15.119:0/2389140038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 msgr2=0x7fde8c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 --2- 172.21.15.119:0/2389140038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 -- 172.21.15.119:0/2389140038 >> v2:172.21.15.143:3300/0 conn(0x7fde8c15c740 msgr2=0x7fde8c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:14.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 --2- 172.21.15.119:0/2389140038 >> v2:172.21.15.143:3300/0 conn(0x7fde8c15c740 0x7fde8c06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.379+0000 7fde8bfff640 1 -- 172.21.15.119:0/2389140038 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0ccb40 con 0x7fde8c160350 2023-12-19T16:18:14.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde8bfff640 1 --2- 172.21.15.119:0/2389140038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c160750 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fde8c078e60 tx=0x7fde8401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a9e99fa1ab8305 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:14.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde8a7fc640 1 -- 172.21.15.119:0/2389140038 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840a57c0 con 0x7fde8c160350 2023-12-19T16:18:14.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde8a7fc640 1 -- 172.21.15.119:0/2389140038 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde840a5920 con 0x7fde8c160350 2023-12-19T16:18:14.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde8a7fc640 1 -- 172.21.15.119:0/2389140038 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840a5cb0 con 0x7fde8c160350 2023-12-19T16:18:14.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 -- 172.21.15.119:0/2389140038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 msgr2=0x7fde8c160750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 --2- 172.21.15.119:0/2389140038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c160750 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fde8c078e60 tx=0x7fde8401c940 comp rx=0 tx=0).stop 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 -- 172.21.15.119:0/2389140038 shutdown_connections 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 --2- 172.21.15.119:0/2389140038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c160750 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 --2- 172.21.15.119:0/2389140038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 --2- 172.21.15.119:0/2389140038 >> v2:172.21.15.143:3300/0 conn(0x7fde8c15c740 0x7fde8c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 -- 172.21.15.119:0/2389140038 >> 172.21.15.119:0/2389140038 conn(0x7fde8c0ce590 msgr2=0x7fde8c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 -- 172.21.15.119:0/2389140038 shutdown_connections 2023-12-19T16:18:14.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 -- 172.21.15.119:0/2389140038 wait complete. 2023-12-19T16:18:14.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 Processor -- start 2023-12-19T16:18:14.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.383+0000 7fde90c54640 1 -- start start 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c15c740 0x7fde8c1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0c7200 con 0x7fde8c160350 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0b4080 con 0x7fde8c15c740 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0b3710 con 0x7fde8c0ab8a0 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c0b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:55188/0 (socket says 172.21.15.119:55188) 2023-12-19T16:18:14.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8b7fe640 1 -- 172.21.15.119:0/1965437091 learned_addr learned my addr 172.21.15.119:0/1965437091 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8affd640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c15c740 0x7fde8c1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 -- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 msgr2=0x7fde8c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c0b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 -- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c15c740 msgr2=0x7fde8c1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c15c740 0x7fde8c1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 -- 172.21.15.119:0/1965437091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009b30 con 0x7fde8c160350 2023-12-19T16:18:14.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde8bfff640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c0c5660 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fde840ab000 tx=0x7fde84019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:14.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840be070 con 0x7fde8c160350 2023-12-19T16:18:14.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde840b8440 con 0x7fde8c160350 2023-12-19T16:18:14.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c0c7620 con 0x7fde8c160350 2023-12-19T16:18:14.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840b87f0 con 0x7fde8c160350 2023-12-19T16:18:14.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c0c6b40 con 0x7fde8c160350 2023-12-19T16:18:14.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c0c7340 con 0x7fde8c160350 2023-12-19T16:18:14.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.387+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde840b8950 con 0x7fde8c160350 2023-12-19T16:18:14.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.391+0000 7fde73fff640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde78065a60 0x7fde78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.391+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde8411da20 con 0x7fde8c160350 2023-12-19T16:18:14.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.391+0000 7fde8b7fe640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde78065a60 0x7fde78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.391+0000 7fde8b7fe640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde78065a60 0x7fde78067f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fde7c007b10 tx=0x7fde7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:14.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.395+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fde8c0c7340 con 0x7fde8c160350 2023-12-19T16:18:14.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde8c0c7340 con 0x7fde8c160350 2023-12-19T16:18:14.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde73fff640 1 -- 172.21.15.119:0/1965437091 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fde8c0c7340 con 0x7fde8c160350 2023-12-19T16:18:14.582 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:14.583 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:52.030827+0000","modified":"2023-12-19T16:17:55.053336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/2766727867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2766727867},{"type":"v1","addr":"172.21.15.119:6836","nonce":2766727867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:14.583 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2023-12-19T16:18:14.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde78065a60 msgr2=0x7fde78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde78065a60 0x7fde78067f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fde7c007b10 tx=0x7fde7c008040 comp rx=0 tx=0).stop 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 msgr2=0x7fde8c0c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c0c5660 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fde840ab000 tx=0x7fde84019740 comp rx=0 tx=0).stop 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 shutdown_connections 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fde78065a60 0x7fde78067f20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c15c740 0x7fde8c1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde8c160350 0x7fde8c0c5660 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 --2- 172.21.15.119:0/1965437091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0ab8a0 0x7fde8c0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 >> 172.21.15.119:0/1965437091 conn(0x7fde8c0ce590 msgr2=0x7fde8c15cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 shutdown_connections 2023-12-19T16:18:14.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.579+0000 7fde90c54640 1 -- 172.21.15.119:0/1965437091 wait complete. 2023-12-19T16:18:14.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:14.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.735+0000 7f9244525640 1 Processor -- start 2023-12-19T16:18:14.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.735+0000 7f9244525640 1 -- start start 2023-12-19T16:18:14.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9244525640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f923c15ca40 0x7f923c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9244525640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f923c0ce3f0 0x7f923c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9244525640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c0cf610 0x7f923c1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9244525640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0cfaa0 con 0x7f923c15ca40 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9244525640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0d11c0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9244525640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0d0310 con 0x7f923c0cf610 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f923c15ca40 0x7f923c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f923c15ca40 0x7f923c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57150/0 (socket says 172.21.15.119:57150) 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 -- 172.21.15.119:0/3489799401 learned_addr learned my addr 172.21.15.119:0/3489799401 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9242ac2640 1 --2- 172.21.15.119:0/3489799401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c0cf610 0x7f923c1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9241ac0640 1 --2- 172.21.15.119:0/3489799401 >> v2:172.21.15.143:3300/0 conn(0x7f923c0ce3f0 0x7f923c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 -- 172.21.15.119:0/3489799401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c0cf610 msgr2=0x7f923c1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 --2- 172.21.15.119:0/3489799401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c0cf610 0x7f923c1605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 -- 172.21.15.119:0/3489799401 >> v2:172.21.15.143:3300/0 conn(0x7f923c0ce3f0 msgr2=0x7f923c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:14.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 --2- 172.21.15.119:0/3489799401 >> v2:172.21.15.143:3300/0 conn(0x7f923c0ce3f0 0x7f923c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f92422c1640 1 -- 172.21.15.119:0/3489799401 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0d05b0 con 0x7f923c15ca40 2023-12-19T16:18:14.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.739+0000 7f9241ac0640 1 --2- 172.21.15.119:0/3489799401 >> v2:172.21.15.143:3300/0 conn(0x7f923c0ce3f0 0x7f923c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:14.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f92422c1640 1 --2- 172.21.15.119:0/3489799401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c15ca40 0x7f923c0cdeb0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f923c0d26d0 tx=0x7f923801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340ba3b30022a36d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f92412bf640 1 -- 172.21.15.119:0/3489799401 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380ab600 con 0x7f923c15ca40 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f92412bf640 1 -- 172.21.15.119:0/3489799401 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92380a7050 con 0x7f923c15ca40 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f92412bf640 1 -- 172.21.15.119:0/3489799401 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380ab980 con 0x7f923c15ca40 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 -- 172.21.15.119:0/3489799401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c15ca40 msgr2=0x7f923c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 --2- 172.21.15.119:0/3489799401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c15ca40 0x7f923c0cdeb0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f923c0d26d0 tx=0x7f923801c240 comp rx=0 tx=0).stop 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 -- 172.21.15.119:0/3489799401 shutdown_connections 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 --2- 172.21.15.119:0/3489799401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c0cf610 0x7f923c1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 --2- 172.21.15.119:0/3489799401 >> v2:172.21.15.143:3300/0 conn(0x7f923c0ce3f0 0x7f923c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 --2- 172.21.15.119:0/3489799401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c15ca40 0x7f923c0cdeb0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 -- 172.21.15.119:0/3489799401 >> 172.21.15.119:0/3489799401 conn(0x7f923c089fb0 msgr2=0x7f923c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:14.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 -- 172.21.15.119:0/3489799401 shutdown_connections 2023-12-19T16:18:14.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 -- 172.21.15.119:0/3489799401 wait complete. 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 Processor -- start 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.743+0000 7f9244525640 1 -- start start 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 0x7f923c14cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f923c0cf610 0x7f923c0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c15ca40 0x7f923c0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c14d140 con 0x7f923c0ce3f0 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0c7a40 con 0x7f923c0cf610 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0c7d20 con 0x7f923c15ca40 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 0x7f923c14cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 0x7f923c14cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57154/0 (socket says 172.21.15.119:57154) 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 -- 172.21.15.119:0/3999353271 learned_addr learned my addr 172.21.15.119:0/3999353271 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9241ac0640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f923c0cf610 0x7f923c0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9242ac2640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c15ca40 0x7f923c0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 -- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c15ca40 msgr2=0x7f923c0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c15ca40 0x7f923c0c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 -- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f923c0cf610 msgr2=0x7f923c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f923c0cf610 0x7f923c0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 -- 172.21.15.119:0/3999353271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009480 con 0x7f923c0ce3f0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9242ac2640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c15ca40 0x7f923c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f92422c1640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 0x7f923c14cc00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f923801cae0 tx=0x7f9238018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238005ba0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92380a4e90 con 0x7f923c0ce3f0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380038b0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c0c8000 con 0x7f923c0ce3f0 2023-12-19T16:18:14.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c0c85c0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c04e000 con 0x7f923c0ce3f0 2023-12-19T16:18:14.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.747+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f92380b2070 con 0x7f923c0ce3f0 2023-12-19T16:18:14.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.751+0000 7f9232ffd640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9220065a90 0x7f9220067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:14.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.751+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f923811c2b0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.751+0000 7f9241ac0640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9220065a90 0x7f9220067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:14.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.751+0000 7f9241ac0640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9220065a90 0x7f9220067f50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f923c0b1470 tx=0x7f922c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:14.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.755+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f92380e9bc0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.909 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.903+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f923c0cff10 con 0x7f923c0ce3f0 2023-12-19T16:18:14.910 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9232ffd640 1 -- 172.21.15.119:0/3999353271 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f92380ed1e0 con 0x7f923c0ce3f0 2023-12-19T16:18:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:14.910 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:14.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9220065a90 msgr2=0x7f9220067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9220065a90 0x7f9220067f50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f923c0b1470 tx=0x7f922c008040 comp rx=0 tx=0).stop 2023-12-19T16:18:14.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 msgr2=0x7f923c14cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:14.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 0x7f923c14cc00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f923801cae0 tx=0x7f9238018fe0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.912 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 shutdown_connections 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9220065a90 0x7f9220067f50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f923c0cf610 0x7f923c0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f923c15ca40 0x7f923c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 --2- 172.21.15.119:0/3999353271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923c0ce3f0 0x7f923c14cc00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 >> 172.21.15.119:0/3999353271 conn(0x7f923c089fb0 msgr2=0x7f923c15aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 shutdown_connections 2023-12-19T16:18:14.913 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:14.907+0000 7f9244525640 1 -- 172.21.15.119:0/3999353271 wait complete. 2023-12-19T16:18:14.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:08.508006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:49.778202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:51.022485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:14.932 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:15.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.067+0000 7f1f9fdf3640 1 Processor -- start 2023-12-19T16:18:15.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.067+0000 7f1f9fdf3640 1 -- start start 2023-12-19T16:18:15.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9fdf3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c92b0 0x7f1f98160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9fdf3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1f980c9690 0x7f1f980ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9fdf3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f98142cd0 con 0x7f1f980ce8f0 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9fdf3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f98142fb0 con 0x7f1f980c9690 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9fdf3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ced80 con 0x7f1f980c92b0 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9d38e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1f980c9690 0x7f1f980ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9e390640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1f980ce8f0 0x7f1f98142020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54372/0 (socket says 172.21.15.119:54372) 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9e390640 1 -- 172.21.15.119:0/2690924956 learned_addr learned my addr 172.21.15.119:0/2690924956 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9db8f640 1 --2- 172.21.15.119:0/2690924956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c92b0 0x7f1f98160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9d38e640 1 -- 172.21.15.119:0/2690924956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c92b0 msgr2=0x7f1f98160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:15.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9d38e640 1 --2- 172.21.15.119:0/2690924956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c92b0 0x7f1f98160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9d38e640 1 -- 172.21.15.119:0/2690924956 >> v1:172.21.15.119:6789/0 conn(0x7f1f980ce8f0 legacy=0x7f1f98142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9d38e640 1 -- 172.21.15.119:0/2690924956 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f981604c0 con 0x7f1f980c9690 2023-12-19T16:18:15.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.071+0000 7f1f9d38e640 1 --2- 172.21.15.119:0/2690924956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980c9690 0x7f1f980ce3b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1f880097c0 tx=0x7f1f8801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ea2d90eb031984 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9cb8d640 1 -- 172.21.15.119:0/2690924956 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f880ab5f0 con 0x7f1f980c9690 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9cb8d640 1 -- 172.21.15.119:0/2690924956 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f880ab750 con 0x7f1f980c9690 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9cb8d640 1 -- 172.21.15.119:0/2690924956 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f880abae0 con 0x7f1f980c9690 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2690924956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980c9690 msgr2=0x7f1f980ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2690924956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980c9690 0x7f1f980ce3b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1f880097c0 tx=0x7f1f8801c3f0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2690924956 shutdown_connections 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2690924956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980c9690 0x7f1f980ce3b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2690924956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c92b0 0x7f1f98160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2690924956 >> 172.21.15.119:0/2690924956 conn(0x7f1f9806a2a0 msgr2=0x7f1f980aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2690924956 shutdown_connections 2023-12-19T16:18:15.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2690924956 wait complete. 2023-12-19T16:18:15.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 Processor -- start 2023-12-19T16:18:15.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- start start 2023-12-19T16:18:15.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f980c92b0 0x7f1f9815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c9690 0x7f1f980ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 0x7f1f980c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c5d00 con 0x7f1f980ce8f0 2023-12-19T16:18:15.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ad6d0 con 0x7f1f980c92b0 2023-12-19T16:18:15.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9fdf3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c5f50 con 0x7f1f980c9690 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9e390640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 0x7f1f980c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9e390640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 0x7f1f980c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57162/0 (socket says 172.21.15.119:57162) 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9e390640 1 -- 172.21.15.119:0/2248320417 learned_addr learned my addr 172.21.15.119:0/2248320417 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9d38e640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c9690 0x7f1f980ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.075+0000 7f1f9db8f640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f980c92b0 0x7f1f9815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9e390640 1 -- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c9690 msgr2=0x7f1f980ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9e390640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c9690 0x7f1f980ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9e390640 1 -- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f980c92b0 msgr2=0x7f1f9815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9e390640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f980c92b0 0x7f1f9815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9e390640 1 -- 172.21.15.119:0/2248320417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009420 con 0x7f1f980ce8f0 2023-12-19T16:18:15.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9e390640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 0x7f1f980c34b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000ca80 tx=0x7f1f9000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000ac30 con 0x7f1f980ce8f0 2023-12-19T16:18:15.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9000ad90 con 0x7f1f980ce8f0 2023-12-19T16:18:15.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980c6230 con 0x7f1f980ce8f0 2023-12-19T16:18:15.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012600 con 0x7f1f980ce8f0 2023-12-19T16:18:15.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980c6a30 con 0x7f1f980ce8f0 2023-12-19T16:18:15.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f980ada90 con 0x7f1f980ce8f0 2023-12-19T16:18:15.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f90007070 con 0x7f1f980ce8f0 2023-12-19T16:18:15.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f8e7fc640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f7c065a60 0x7f1f7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.079+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1f900830e0 con 0x7f1f980ce8f0 2023-12-19T16:18:15.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.083+0000 7f1f9db8f640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f7c065a60 0x7f1f7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.085 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.083+0000 7f1f9db8f640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f7c065a60 0x7f1f7c067f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009b60 tx=0x7f1f94009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.083+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f90050a00 con 0x7f1f980ce8f0 2023-12-19T16:18:15.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f9804e000 con 0x7f1f980ce8f0 2023-12-19T16:18:15.239 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f8e7fc640 1 -- 172.21.15.119:0/2248320417 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f900170a0 con 0x7f1f980ce8f0 2023-12-19T16:18:15.239 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2023-12-19T16:18:15.240 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f7c065a60 msgr2=0x7f1f7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f7c065a60 0x7f1f7c067f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009b60 tx=0x7f1f94009190 comp rx=0 tx=0).stop 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 msgr2=0x7f1f980c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 0x7f1f980c34b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000ca80 tx=0x7f1f9000cf40 comp rx=0 tx=0).stop 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 shutdown_connections 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1f7c065a60 0x7f1f7c067f20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f980ce8f0 0x7f1f980c34b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f980c9690 0x7f1f980ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 --2- 172.21.15.119:0/2248320417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f980c92b0 0x7f1f9815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 >> 172.21.15.119:0/2248320417 conn(0x7f1f9806a2a0 msgr2=0x7f1f9806fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 shutdown_connections 2023-12-19T16:18:15.241 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.235+0000 7f1f9fdf3640 1 -- 172.21.15.119:0/2248320417 wait complete. 2023-12-19T16:18:15.261 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:15.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.395+0000 7f4ab4c2d640 1 Processor -- start 2023-12-19T16:18:15.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.395+0000 7f4ab4c2d640 1 -- start start 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4ab4c2d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ab00ca410 0x7f4ab0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4ab4c2d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4ab0159fb0 0x7f4ab0071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4ab4c2d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab0070df0 con 0x7f4ab0071db0 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4ab4c2d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab015aab0 con 0x7f4ab0159fb0 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4ab4c2d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab015a4f0 con 0x7f4ab00ca410 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aadd9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4ab0159fb0 0x7f4ab0071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aaed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4ab0071db0 0x7f4ab00cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54380/0 (socket says 172.21.15.119:54380) 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aadd9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4ab0159fb0 0x7f4ab0071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57174/0 (socket says 172.21.15.119:57174) 2023-12-19T16:18:15.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aaed9d640 1 -- 172.21.15.119:0/4223062193 learned_addr learned my addr 172.21.15.119:0/4223062193 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:15.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aae59c640 1 --2- 172.21.15.119:0/4223062193 >> v2:172.21.15.143:3300/0 conn(0x7f4ab00ca410 0x7f4ab0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aadd9b640 1 -- 172.21.15.119:0/4223062193 >> v2:172.21.15.143:3300/0 conn(0x7f4ab00ca410 msgr2=0x7f4ab0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:15.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aadd9b640 1 --2- 172.21.15.119:0/4223062193 >> v2:172.21.15.143:3300/0 conn(0x7f4ab00ca410 0x7f4ab0159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aadd9b640 1 -- 172.21.15.119:0/4223062193 >> v1:172.21.15.119:6789/0 conn(0x7f4ab0071db0 legacy=0x7f4ab00cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aadd9b640 1 -- 172.21.15.119:0/4223062193 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab015a7d0 con 0x7f4ab0159fb0 2023-12-19T16:18:15.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.399+0000 7f4aad59a640 1 -- 172.21.15.119:0/4223062193 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954406718 0 0) 0x7f4ab0070df0 con 0x7f4ab0071db0 2023-12-19T16:18:15.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4aadd9b640 1 --2- 172.21.15.119:0/4223062193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab0159fb0 0x7f4ab0071870 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00cbfa0 tx=0x7f4aa401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5120625105ad383a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4aad59a640 1 -- 172.21.15.119:0/4223062193 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40ab600 con 0x7f4ab0159fb0 2023-12-19T16:18:15.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4aad59a640 1 -- 172.21.15.119:0/4223062193 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa40a7050 con 0x7f4ab0159fb0 2023-12-19T16:18:15.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4aad59a640 1 -- 172.21.15.119:0/4223062193 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40ab980 con 0x7f4ab0159fb0 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/4223062193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab0159fb0 msgr2=0x7f4ab0071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/4223062193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab0159fb0 0x7f4ab0071870 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00cbfa0 tx=0x7f4aa401c430 comp rx=0 tx=0).stop 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/4223062193 shutdown_connections 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/4223062193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab0159fb0 0x7f4ab0071870 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/4223062193 >> v2:172.21.15.143:3300/0 conn(0x7f4ab00ca410 0x7f4ab0159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/4223062193 >> 172.21.15.119:0/4223062193 conn(0x7f4ab006a2a0 msgr2=0x7f4ab00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/4223062193 shutdown_connections 2023-12-19T16:18:15.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/4223062193 wait complete. 2023-12-19T16:18:15.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 Processor -- start 2023-12-19T16:18:15.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.403+0000 7f4ab4c2d640 1 -- start start 2023-12-19T16:18:15.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ab0071db0 0x7f4ab00c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 0x7f4ab00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ab0159fb0 0x7f4ab00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c28f0 con 0x7f4ab00ca410 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c3ae0 con 0x7f4ab0071db0 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c1fc0 con 0x7f4ab0159fb0 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 0x7f4ab00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 0x7f4ab00c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57190/0 (socket says 172.21.15.119:57190) 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 -- 172.21.15.119:0/2032777997 learned_addr learned my addr 172.21.15.119:0/2032777997 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aae59c640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ab0071db0 0x7f4ab00c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aaed9d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ab0159fb0 0x7f4ab00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 -- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ab0159fb0 msgr2=0x7f4ab00c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ab0159fb0 0x7f4ab00c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 -- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ab0071db0 msgr2=0x7f4ab00c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ab0071db0 0x7f4ab00c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 -- 172.21.15.119:0/2032777997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4009420 con 0x7f4ab00ca410 2023-12-19T16:18:15.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4aadd9b640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 0x7f4ab00c4a40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4aa401c910 tx=0x7f4aa401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40b37d0 con 0x7f4ab00ca410 2023-12-19T16:18:15.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa40b3930 con 0x7f4ab00ca410 2023-12-19T16:18:15.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40b3cc0 con 0x7f4ab00ca410 2023-12-19T16:18:15.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab00c2230 con 0x7f4ab00ca410 2023-12-19T16:18:15.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab00c9280 con 0x7f4ab00ca410 2023-12-19T16:18:15.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.407+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab00c2a30 con 0x7f4ab00ca410 2023-12-19T16:18:15.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.411+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4aa40b2070 con 0x7f4ab00ca410 2023-12-19T16:18:15.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.411+0000 7f4a9effd640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4a90065a60 0x7f4a90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.411+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4aa411d520 con 0x7f4ab00ca410 2023-12-19T16:18:15.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.411+0000 7f4aae59c640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4a90065a60 0x7f4a90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.415 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.411+0000 7f4aae59c640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4a90065a60 0x7f4a90067f20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0007a60 tx=0x7f4aa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.415+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4ab00c2a30 con 0x7f4ab00ca410 2023-12-19T16:18:15.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ab00c2a30 con 0x7f4ab00ca410 2023-12-19T16:18:15.570 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4a9effd640 1 -- 172.21.15.119:0/2032777997 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ab00c2a30 con 0x7f4ab00ca410 2023-12-19T16:18:15.571 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2023-12-19T16:18:15.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4a90065a60 msgr2=0x7f4a90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4a90065a60 0x7f4a90067f20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0007a60 tx=0x7f4aa0008040 comp rx=0 tx=0).stop 2023-12-19T16:18:15.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 msgr2=0x7f4ab00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 0x7f4ab00c4a40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4aa401c910 tx=0x7f4aa401ac70 comp rx=0 tx=0).stop 2023-12-19T16:18:15.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 shutdown_connections 2023-12-19T16:18:15.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4a90065a60 0x7f4a90067f20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ab0159fb0 0x7f4ab00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ab00ca410 0x7f4ab00c4a40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 --2- 172.21.15.119:0/2032777997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ab0071db0 0x7f4ab00c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 >> 172.21.15.119:0/2032777997 conn(0x7f4ab006a2a0 msgr2=0x7f4ab015c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:15.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 shutdown_connections 2023-12-19T16:18:15.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.567+0000 7f4ab4c2d640 1 -- 172.21.15.119:0/2032777997 wait complete. 2023-12-19T16:18:15.592 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:15.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7b51b3640 1 Processor -- start 2023-12-19T16:18:15.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7b51b3640 1 -- start start 2023-12-19T16:18:15.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7b51b3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b0071870 0x7ff7b0071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7b51b3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b0070df0 con 0x7ff7b00cbff0 2023-12-19T16:18:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7b51b3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b015a4f0 con 0x7ff7b00ca410 2023-12-19T16:18:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7b51b3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b015aab0 con 0x7ff7b0071870 2023-12-19T16:18:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7af59e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff7b00cbff0 0x7ff7b00ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54386/0 (socket says 172.21.15.119:54386) 2023-12-19T16:18:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7af59e640 1 -- 172.21.15.119:0/3686245000 learned_addr learned my addr 172.21.15.119:0/3686245000 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7a659c640 1 --2- 172.21.15.119:0/3686245000 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b0071870 0x7ff7b0071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833442028 0 0) 0x7ff7b0070df0 con 0x7ff7b00cbff0 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff79c005740 con 0x7ff7b00cbff0 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289818295 0 0) 0x7ff7b015a4f0 con 0x7ff7b00ca410 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b0070df0 con 0x7ff7b00ca410 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7a659c640 1 -- 172.21.15.119:0/3686245000 >> v1:172.21.15.143:6789/0 conn(0x7ff7b00ca410 legacy=0x7ff7b0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7a659c640 1 -- 172.21.15.119:0/3686245000 >> v1:172.21.15.119:6789/0 conn(0x7ff7b00cbff0 legacy=0x7ff7b00ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.731+0000 7ff7a659c640 1 -- 172.21.15.119:0/3686245000 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b015a7d0 con 0x7ff7b0071870 2023-12-19T16:18:15.739 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7a659c640 1 --2- 172.21.15.119:0/3686245000 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b0071870 0x7ff7b0071cd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097f0 tx=0x7ff79801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e1e9f2ce0605e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980ab600 con 0x7ff7b0071870 2023-12-19T16:18:15.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7980ab760 con 0x7ff7b0071870 2023-12-19T16:18:15.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7ae59c640 1 -- 172.21.15.119:0/3686245000 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980abad0 con 0x7ff7b0071870 2023-12-19T16:18:15.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 -- 172.21.15.119:0/3686245000 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b0071870 msgr2=0x7ff7b0071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/3686245000 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b0071870 0x7ff7b0071cd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097f0 tx=0x7ff79801c400 comp rx=0 tx=0).stop 2023-12-19T16:18:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 -- 172.21.15.119:0/3686245000 shutdown_connections 2023-12-19T16:18:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/3686245000 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b0071870 0x7ff7b0071cd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 -- 172.21.15.119:0/3686245000 >> 172.21.15.119:0/3686245000 conn(0x7ff7b006a2a0 msgr2=0x7ff7b00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 -- 172.21.15.119:0/3686245000 shutdown_connections 2023-12-19T16:18:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.735+0000 7ff7b51b3640 1 -- 172.21.15.119:0/3686245000 wait complete. 2023-12-19T16:18:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 Processor -- start 2023-12-19T16:18:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 -- start start 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 0x7ff7b014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b00ca410 0x7ff7b01f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b00cbff0 0x7ff7b014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c23e0 con 0x7ff7b0071870 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01f4ae0 con 0x7ff7b00ca410 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01f4d80 con 0x7ff7b00cbff0 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 0x7ff7b014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 0x7ff7b014fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57198/0 (socket says 172.21.15.119:57198) 2023-12-19T16:18:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 -- 172.21.15.119:0/2325538332 learned_addr learned my addr 172.21.15.119:0/2325538332 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7a659c640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b00ca410 0x7ff7b01f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7af59e640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b00cbff0 0x7ff7b014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 -- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b00cbff0 msgr2=0x7ff7b014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b00cbff0 0x7ff7b014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 -- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b00ca410 msgr2=0x7ff7b01f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b00ca410 0x7ff7b01f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 -- 172.21.15.119:0/2325538332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009420 con 0x7ff7b0071870 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7af59e640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b00cbff0 0x7ff7b014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7aed9d640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 0x7ff7b014fcf0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000c490 tx=0x7ff7a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00052d0 con 0x7ff7b0071870 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0005430 con 0x7ff7b0071870 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0012870 con 0x7ff7b0071870 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.739+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b01f5060 con 0x7ff7b0071870 2023-12-19T16:18:15.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b00c2070 con 0x7ff7b0071870 2023-12-19T16:18:15.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b004e000 con 0x7ff7b0071870 2023-12-19T16:18:15.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7a00129d0 con 0x7ff7b0071870 2023-12-19T16:18:15.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7a7fff640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff790065a60 0x7ff790067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:15.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7a0082ea0 con 0x7ff7b0071870 2023-12-19T16:18:15.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7a659c640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff790065a60 0x7ff790067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:15.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.743+0000 7ff7a659c640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff790065a60 0x7ff790067f20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff7980af000 tx=0x7ff7980a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:15.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.747+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff7a0050720 con 0x7ff7b0071870 2023-12-19T16:18:15.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.895+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7b0072df0 con 0x7ff7b0071870 2023-12-19T16:18:15.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.895+0000 7ff7a7fff640 1 -- 172.21.15.119:0/2325538332 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7a0053d40 con 0x7ff7b0071870 2023-12-19T16:18:15.900 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff790065a60 msgr2=0x7ff790067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff790065a60 0x7ff790067f20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff7980af000 tx=0x7ff7980a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 msgr2=0x7ff7b014fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 0x7ff7b014fcf0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000c490 tx=0x7ff7a000c950 comp rx=0 tx=0).stop 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 shutdown_connections 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff790065a60 0x7ff790067f20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b00ca410 0x7ff7b01f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b00cbff0 0x7ff7b014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 --2- 172.21.15.119:0/2325538332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7b0071870 0x7ff7b014fcf0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:15.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 >> 172.21.15.119:0/2325538332 conn(0x7ff7b006a2a0 msgr2=0x7ff7b0157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:15.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 shutdown_connections 2023-12-19T16:18:15.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:15.899+0000 7ff7b51b3640 1 -- 172.21.15.119:0/2325538332 wait complete. 2023-12-19T16:18:15.921 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:16.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11359e640 1 Processor -- start 2023-12-19T16:18:16.059 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11359e640 1 -- start start 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11359e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1140cf670 0x7fe114167280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11359e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1140b65c0 con 0x7fe1140cea00 2023-12-19T16:18:16.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11359e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11415cb10 con 0x7fe11415c730 2023-12-19T16:18:16.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11359e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1140cd960 con 0x7fe1140cf670 2023-12-19T16:18:16.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe11415c730 0x7fe1140b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:33484/0 (socket says 172.21.15.119:33484) 2023-12-19T16:18:16.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe11259c640 1 -- 172.21.15.119:0/2820497110 learned_addr learned my addr 172.21.15.119:0/2820497110 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:16.061 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.055+0000 7fe112d9d640 1 --2- 172.21.15.119:0/2820497110 >> v2:172.21.15.143:3300/0 conn(0x7fe1140cf670 0x7fe114167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe11159a640 1 -- 172.21.15.119:0/2820497110 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038409981 0 0) 0x7fe11415cb10 con 0x7fe11415c730 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe11159a640 1 -- 172.21.15.119:0/2820497110 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0fc003530 con 0x7fe11415c730 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe11159a640 1 -- 172.21.15.119:0/2820497110 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701327061 0 0) 0x7fe1140b65c0 con 0x7fe1140cea00 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe112d9d640 1 -- 172.21.15.119:0/2820497110 >> v1:172.21.15.143:6789/0 conn(0x7fe11415c730 legacy=0x7fe1140b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe112d9d640 1 -- 172.21.15.119:0/2820497110 >> v1:172.21.15.119:6789/0 conn(0x7fe1140cea00 legacy=0x7fe1140cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe112d9d640 1 -- 172.21.15.119:0/2820497110 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1140cdc40 con 0x7fe1140cf670 2023-12-19T16:18:16.064 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe112d9d640 1 --2- 172.21.15.119:0/2820497110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1140cf670 0x7fe114167280 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009d90 tx=0x7fe10c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51011e167cb98fb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe11159a640 1 -- 172.21.15.119:0/2820497110 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0af600 con 0x7fe1140cf670 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe11159a640 1 -- 172.21.15.119:0/2820497110 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0ab050 con 0x7fe1140cf670 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.059+0000 7fe11159a640 1 -- 172.21.15.119:0/2820497110 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0af980 con 0x7fe1140cf670 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- 172.21.15.119:0/2820497110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1140cf670 msgr2=0x7fe114167280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 --2- 172.21.15.119:0/2820497110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1140cf670 0x7fe114167280 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009d90 tx=0x7fe10c01f130 comp rx=0 tx=0).stop 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- 172.21.15.119:0/2820497110 shutdown_connections 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 --2- 172.21.15.119:0/2820497110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1140cf670 0x7fe114167280 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- 172.21.15.119:0/2820497110 >> 172.21.15.119:0/2820497110 conn(0x7fe11406b120 msgr2=0x7fe11406b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- 172.21.15.119:0/2820497110 shutdown_connections 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- 172.21.15.119:0/2820497110 wait complete. 2023-12-19T16:18:16.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 Processor -- start 2023-12-19T16:18:16.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- start start 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1140cea00 0x7fe1141499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 0x7fe1141577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11415c730 0x7fe114157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11414fcf0 con 0x7fe1140cf670 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11414ec50 con 0x7fe11415c730 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.063+0000 7fe11359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11414ef30 con 0x7fe1140cea00 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 0x7fe1141577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 0x7fe1141577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57212/0 (socket says 172.21.15.119:57212) 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 -- 172.21.15.119:0/1772544715 learned_addr learned my addr 172.21.15.119:0/1772544715 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe11259c640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1140cea00 0x7fe1141499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe112d9d640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11415c730 0x7fe114157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 -- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1140cea00 msgr2=0x7fe1141499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1140cea00 0x7fe1141499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 -- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11415c730 msgr2=0x7fe114157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11415c730 0x7fe114157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 -- 172.21.15.119:0/1772544715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009a70 con 0x7fe1140cf670 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe111d9b640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 0x7fe1141577c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe10800c520 tx=0x7fe10800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1080052d0 con 0x7fe1140cf670 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe108005430 con 0x7fe1140cf670 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108012870 con 0x7fe1140cf670 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11414f210 con 0x7fe1140cf670 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11414f7d0 con 0x7fe1140cf670 2023-12-19T16:18:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1140ce4c0 con 0x7fe1140cf670 2023-12-19T16:18:16.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.067+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe108003620 con 0x7fe1140cf670 2023-12-19T16:18:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.071+0000 7fe102ffd640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe0f4065a60 0x7fe0f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.071+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe108082870 con 0x7fe1140cf670 2023-12-19T16:18:16.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.071+0000 7fe11259c640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe0f4065a60 0x7fe0f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.074 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.071+0000 7fe11259c640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe0f4065a60 0x7fe0f4067f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe1040011f0 tx=0x7fe104007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.075+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe1140ce4c0 con 0x7fe1140cf670 2023-12-19T16:18:16.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1140ce4c0 con 0x7fe1140cf670 2023-12-19T16:18:16.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe102ffd640 1 -- 172.21.15.119:0/1772544715 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fe1140ce4c0 con 0x7fe1140cf670 2023-12-19T16:18:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:16.263 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:52.030827+0000","modified":"2023-12-19T16:17:55.053336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/2766727867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2766727867},{"type":"v1","addr":"172.21.15.119:6836","nonce":2766727867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:16.263 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe0f4065a60 msgr2=0x7fe0f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe0f4065a60 0x7fe0f4067f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe1040011f0 tx=0x7fe104007d40 comp rx=0 tx=0).stop 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 msgr2=0x7fe1141577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 0x7fe1141577c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe10800c520 tx=0x7fe10800c9e0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 shutdown_connections 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe0f4065a60 0x7fe0f4067f20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe11415c730 0x7fe114157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1140cf670 0x7fe1141577c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 --2- 172.21.15.119:0/1772544715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1140cea00 0x7fe1141499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.259+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 >> 172.21.15.119:0/1772544715 conn(0x7fe11406b120 msgr2=0x7fe11415b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.263+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 shutdown_connections 2023-12-19T16:18:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.263+0000 7fe11359e640 1 -- 172.21.15.119:0/1772544715 wait complete. 2023-12-19T16:18:16.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:16.421 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 Processor -- start 2023-12-19T16:18:16.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 -- start start 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc50815ca40 0x7fc5080cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5080ce3f0 0x7fc5080cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080cfa70 con 0x7fc5080cf610 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5080d11c0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50ced1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080d0310 con 0x7fc50815ca40 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5080ce3f0 0x7fc5080cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5080ce3f0 0x7fc5080cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57214/0 (socket says 172.21.15.119:57214) 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 -- 172.21.15.119:0/3137034714 learned_addr learned my addr 172.21.15.119:0/3137034714 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc506d9d640 1 --1- 172.21.15.119:0/3137034714 >> v1:172.21.15.119:6789/0 conn(0x7fc5080cf610 0x7fc5081605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54400/0 (socket says 172.21.15.119:54400) 2023-12-19T16:18:16.423 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc50659c640 1 --2- 172.21.15.119:0/3137034714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc50815ca40 0x7fc5080cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 -- 172.21.15.119:0/3137034714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc50815ca40 msgr2=0x7fc5080cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:16.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 --2- 172.21.15.119:0/3137034714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc50815ca40 0x7fc5080cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 -- 172.21.15.119:0/3137034714 >> v1:172.21.15.119:6789/0 conn(0x7fc5080cf610 legacy=0x7fc5081605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.419+0000 7fc505d9b640 1 -- 172.21.15.119:0/3137034714 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5080d05b0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc505d9b640 1 --2- 172.21.15.119:0/3137034714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc5080cf0d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006fd0 tx=0x7fc4fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a00086e0855234e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50559a640 1 -- 172.21.15.119:0/3137034714 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0ab640 con 0x7fc5080ce3f0 2023-12-19T16:18:16.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50559a640 1 -- 172.21.15.119:0/3137034714 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0a7070 con 0x7fc5080ce3f0 2023-12-19T16:18:16.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50559a640 1 -- 172.21.15.119:0/3137034714 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0ab9c0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 -- 172.21.15.119:0/3137034714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 msgr2=0x7fc5080cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 --2- 172.21.15.119:0/3137034714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc5080cf0d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006fd0 tx=0x7fc4fc01c520 comp rx=0 tx=0).stop 2023-12-19T16:18:16.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 -- 172.21.15.119:0/3137034714 shutdown_connections 2023-12-19T16:18:16.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 --2- 172.21.15.119:0/3137034714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc5080cf0d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 --2- 172.21.15.119:0/3137034714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc50815ca40 0x7fc5080cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 -- 172.21.15.119:0/3137034714 >> 172.21.15.119:0/3137034714 conn(0x7fc508089fb0 msgr2=0x7fc5080d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 -- 172.21.15.119:0/3137034714 shutdown_connections 2023-12-19T16:18:16.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.423+0000 7fc50ced1640 1 -- 172.21.15.119:0/3137034714 wait complete. 2023-12-19T16:18:16.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 Processor -- start 2023-12-19T16:18:16.429 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- start start 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc508151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080cf610 0x7fc50814ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc50815ca40 0x7fc5081575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508150ab0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50815be50 con 0x7fc50815ca40 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc508150d70 con 0x7fc5080cf610 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc508151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc508151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57222/0 (socket says 172.21.15.119:57222) 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 -- 172.21.15.119:0/2738776051 learned_addr learned my addr 172.21.15.119:0/2738776051 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc505d9b640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080cf610 0x7fc50814ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc506d9d640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc50815ca40 0x7fc5081575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.431 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 -- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080cf610 msgr2=0x7fc50814ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080cf610 0x7fc50814ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 -- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc50815ca40 msgr2=0x7fc5081575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc50815ca40 0x7fc5081575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 -- 172.21.15.119:0/2738776051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc009480 con 0x7fc5080ce3f0 2023-12-19T16:18:16.432 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50659c640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc508151850 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800e9b0 tx=0x7fc4f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8009670 con 0x7fc5080ce3f0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800c9a0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800cd10 con 0x7fc5080ce3f0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc508151050 con 0x7fc5080ce3f0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50814b3b0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.427+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50804e000 con 0x7fc5080ce3f0 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.431+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4f8013470 con 0x7fc5080ce3f0 2023-12-19T16:18:16.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.431+0000 7fc4f6ffd640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4e8065a60 0x7fc4e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.431+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc4f8083960 con 0x7fc5080ce3f0 2023-12-19T16:18:16.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.431+0000 7fc505d9b640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4e8065a60 0x7fc4e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.435 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.431+0000 7fc505d9b640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4e8065a60 0x7fc4e8067f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0af000 tx=0x7fc4fc0b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.435+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc4f80511f0 con 0x7fc5080ce3f0 2023-12-19T16:18:16.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5080cff10 con 0x7fc5080ce3f0 2023-12-19T16:18:16.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc4f6ffd640 1 -- 172.21.15.119:0/2738776051 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fc4f8021090 con 0x7fc5080ce3f0 2023-12-19T16:18:16.591 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:16.591 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:16.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4e8065a60 msgr2=0x7fc4e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4e8065a60 0x7fc4e8067f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0af000 tx=0x7fc4fc0b6040 comp rx=0 tx=0).stop 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 msgr2=0x7fc508151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc508151850 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800e9b0 tx=0x7fc4f800ee70 comp rx=0 tx=0).stop 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 shutdown_connections 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fc4e8065a60 0x7fc4e8067f20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc50815ca40 0x7fc5081575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080cf610 0x7fc50814ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 --2- 172.21.15.119:0/2738776051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5080ce3f0 0x7fc508151850 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 >> 172.21.15.119:0/2738776051 conn(0x7fc508089fb0 msgr2=0x7fc50806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 shutdown_connections 2023-12-19T16:18:16.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.587+0000 7fc50ced1640 1 -- 172.21.15.119:0/2738776051 wait complete. 2023-12-19T16:18:16.612 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:18:16.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:16.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 Processor -- start 2023-12-19T16:18:16.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 -- start start 2023-12-19T16:18:16.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f380cac10 0x7f7f3815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f38070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3815f100 con 0x7f7f3815a680 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f38070780 con 0x7f7f380cac10 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f3e36d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380ca7d0 con 0x7f7f3806fdb0 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f380cac10 0x7f7f3815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f380cac10 0x7f7f3815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57224/0 (socket says 172.21.15.119:57224) 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 -- 172.21.15.119:0/1317008983 learned_addr learned my addr 172.21.15.119:0/1317008983 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 -- 172.21.15.119:0/1317008983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 msgr2=0x7f7f38070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 --2- 172.21.15.119:0/1317008983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f38070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 -- 172.21.15.119:0/1317008983 >> v1:172.21.15.143:6789/0 conn(0x7f7f3815a680 legacy=0x7f7f3815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:16.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.747+0000 7f7f377fe640 1 -- 172.21.15.119:0/1317008983 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3815e860 con 0x7f7f380cac10 2023-12-19T16:18:16.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f377fe640 1 --2- 172.21.15.119:0/1317008983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f3815e160 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009870 tx=0x7f7f2c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f14c1de5b35a9d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f36ffd640 1 -- 172.21.15.119:0/1317008983 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0a7070 con 0x7f7f380cac10 2023-12-19T16:18:16.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f36ffd640 1 -- 172.21.15.119:0/1317008983 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0ab430 con 0x7f7f380cac10 2023-12-19T16:18:16.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f36ffd640 1 -- 172.21.15.119:0/1317008983 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0ab7c0 con 0x7f7f380cac10 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1317008983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 msgr2=0x7f7f3815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1317008983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f3815e160 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009870 tx=0x7f7f2c01c470 comp rx=0 tx=0).stop 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1317008983 shutdown_connections 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1317008983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f38070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1317008983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f3815e160 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1317008983 >> 172.21.15.119:0/1317008983 conn(0x7f7f3806a3e0 msgr2=0x7f7f380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1317008983 shutdown_connections 2023-12-19T16:18:16.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.751+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1317008983 wait complete. 2023-12-19T16:18:16.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 Processor -- start 2023-12-19T16:18:16.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- start start 2023-12-19T16:18:16.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f380c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f380b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f3815a680 0x7f7f38154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3814df80 con 0x7f7f380cac10 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380c4e60 con 0x7f7f3815a680 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380c48a0 con 0x7f7f3806fdb0 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f380b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f380b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57228/0 (socket says 172.21.15.119:57228) 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 -- 172.21.15.119:0/1431624424 learned_addr learned my addr 172.21.15.119:0/1431624424 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f37fff640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f380c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3c90a640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f3815a680 0x7f7f38154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 -- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 msgr2=0x7f7f380c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f380c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 -- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f3815a680 msgr2=0x7f7f38154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f3815a680 0x7f7f38154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 -- 172.21.15.119:0/1431624424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0094d0 con 0x7f7f380cac10 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f37fff640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f380c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f377fe640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f380b0d60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0ad040 tx=0x7f7f2c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0bc070 con 0x7f7f380cac10 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0b4630 con 0x7f7f380cac10 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f380c4b80 con 0x7f7f380cac10 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0b4a00 con 0x7f7f380cac10 2023-12-19T16:18:16.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f380c1b70 con 0x7f7f380cac10 2023-12-19T16:18:16.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.755+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f380735b0 con 0x7f7f380cac10 2023-12-19T16:18:16.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.759+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f2c0b4b60 con 0x7f7f380cac10 2023-12-19T16:18:16.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.759+0000 7f7f34ff9640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7f24065a90 0x7f7f24067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.759+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f2c11cca0 con 0x7f7f380cac10 2023-12-19T16:18:16.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.759+0000 7f7f37fff640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7f24065a90 0x7f7f24067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.759+0000 7f7f37fff640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7f24065a90 0x7f7f24067f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7f38154af0 tx=0x7f7f28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.763+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f2c0ea630 con 0x7f7f380cac10 2023-12-19T16:18:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.943+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f380adb70 con 0x7f7f380cac10 2023-12-19T16:18:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f34ff9640 1 -- 172.21.15.119:0/1431624424 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f7f2c0f2e60 con 0x7f7f380cac10 2023-12-19T16:18:16.949 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:16.949 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:52.030827+0000","modified":"2023-12-19T16:17:55.053336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/2766727867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2766727867},{"type":"v1","addr":"172.21.15.119:6836","nonce":2766727867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7f24065a90 msgr2=0x7f7f24067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7f24065a90 0x7f7f24067f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7f38154af0 tx=0x7f7f28009040 comp rx=0 tx=0).stop 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 msgr2=0x7f7f380b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f380b0d60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0ad040 tx=0x7f7f2c019210 comp rx=0 tx=0).stop 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 shutdown_connections 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7f24065a90 0x7f7f24067f50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f3815a680 0x7f7f38154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f380cac10 0x7f7f380b0d60 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 --2- 172.21.15.119:0/1431624424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f3806fdb0 0x7f7f380c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 >> 172.21.15.119:0/1431624424 conn(0x7f7f3806a3e0 msgr2=0x7f7f380af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 shutdown_connections 2023-12-19T16:18:16.952 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:16.947+0000 7f7f3e36d640 1 -- 172.21.15.119:0/1431624424 wait complete. 2023-12-19T16:18:16.970 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:17.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 Processor -- start 2023-12-19T16:18:17.108 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 -- start start 2023-12-19T16:18:17.109 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdbe406fdb0 0x7fdbe4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe4160690 con 0x7fdbe415c9d0 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe41603f0 con 0x7fdbe406fdb0 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.103+0000 7fdbebc95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40b0d80 con 0x7fdbe40cdd40 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdbe406fdb0 0x7fdbe4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdbe406fdb0 0x7fdbe4070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57236/0 (socket says 172.21.15.119:57236) 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 -- 172.21.15.119:0/237618886 learned_addr learned my addr 172.21.15.119:0/237618886 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbe9230640 1 --2- 172.21.15.119:0/237618886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 -- 172.21.15.119:0/237618886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 msgr2=0x7fdbe40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 --2- 172.21.15.119:0/237618886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe40cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.110 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 -- 172.21.15.119:0/237618886 >> v1:172.21.15.143:6789/0 conn(0x7fdbe415c9d0 legacy=0x7fdbe4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.111 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 -- 172.21.15.119:0/237618886 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40ccb00 con 0x7fdbe406fdb0 2023-12-19T16:18:17.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbea232640 1 --2- 172.21.15.119:0/237618886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe406fdb0 0x7fdbe4070240 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009e50 tx=0x7fdbdc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd92be61e3db0491 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.112 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbe8a2f640 1 -- 172.21.15.119:0/237618886 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0a5900 con 0x7fdbe406fdb0 2023-12-19T16:18:17.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbe8a2f640 1 -- 172.21.15.119:0/237618886 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0a5a60 con 0x7fdbe406fdb0 2023-12-19T16:18:17.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.107+0000 7fdbe8a2f640 1 -- 172.21.15.119:0/237618886 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0a5df0 con 0x7fdbe406fdb0 2023-12-19T16:18:17.113 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- 172.21.15.119:0/237618886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe406fdb0 msgr2=0x7fdbe4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 --2- 172.21.15.119:0/237618886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe406fdb0 0x7fdbe4070240 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009e50 tx=0x7fdbdc01ca10 comp rx=0 tx=0).stop 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- 172.21.15.119:0/237618886 shutdown_connections 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 --2- 172.21.15.119:0/237618886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe406fdb0 0x7fdbe4070240 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 --2- 172.21.15.119:0/237618886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- 172.21.15.119:0/237618886 >> 172.21.15.119:0/237618886 conn(0x7fdbe406a3e0 msgr2=0x7fdbe40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- 172.21.15.119:0/237618886 shutdown_connections 2023-12-19T16:18:17.114 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- 172.21.15.119:0/237618886 wait complete. 2023-12-19T16:18:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 Processor -- start 2023-12-19T16:18:17.115 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- start start 2023-12-19T16:18:17.117 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbe406fdb0 0x7fdbe40c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 0x7fdbe40c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40c7060 con 0x7fdbe415c9d0 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe415be70 con 0x7fdbe406fdb0 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbebc95640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40c6a10 con 0x7fdbe40cdd40 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 0x7fdbe40c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 0x7fdbe40c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57246/0 (socket says 172.21.15.119:57246) 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 -- 172.21.15.119:0/199255747 learned_addr learned my addr 172.21.15.119:0/199255747 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbe9a31640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbe406fdb0 0x7fdbe40c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbe9230640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.118 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 -- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 msgr2=0x7fdbe41543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe41543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 -- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbe406fdb0 msgr2=0x7fdbe40c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbe406fdb0 0x7fdbe40c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbea232640 1 -- 172.21.15.119:0/199255747 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc009b30 con 0x7fdbe415c9d0 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbe9a31640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbe406fdb0 0x7fdbe40c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.111+0000 7fdbe9230640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe41543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbea232640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 0x7fdbe40c74f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0af040 tx=0x7fdbdc0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0b8670 con 0x7fdbe415c9d0 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0b87f0 con 0x7fdbe415c9d0 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe41613b0 con 0x7fdbe415c9d0 2023-12-19T16:18:17.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0b8ba0 con 0x7fdbe415c9d0 2023-12-19T16:18:17.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe40c5160 con 0x7fdbe415c9d0 2023-12-19T16:18:17.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe40735b0 con 0x7fdbe415c9d0 2023-12-19T16:18:17.120 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdbdc0b8d00 con 0x7fdbe415c9d0 2023-12-19T16:18:17.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbda7fc640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdbc8065a90 0x7fdbc8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.115+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdbdc11e330 con 0x7fdbe415c9d0 2023-12-19T16:18:17.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.119+0000 7fdbe9a31640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdbc8065a90 0x7fdbc8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.119+0000 7fdbe9a31640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdbc8065a90 0x7fdbc8067f50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0000f70 tx=0x7fdbe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.119+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdbdc0ebcd0 con 0x7fdbe415c9d0 2023-12-19T16:18:17.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbe40c6870 con 0x7fdbe415c9d0 2023-12-19T16:18:17.310 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbda7fc640 1 -- 172.21.15.119:0/199255747 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fdbe40c6870 con 0x7fdbe415c9d0 2023-12-19T16:18:17.310 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:17.311 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:52.030827+0000","modified":"2023-12-19T16:17:55.053336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/2766727867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2766727867},{"type":"v1","addr":"172.21.15.119:6836","nonce":2766727867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:17.311 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2023-12-19T16:18:17.312 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdbc8065a90 msgr2=0x7fdbc8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdbc8065a90 0x7fdbc8067f50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0000f70 tx=0x7fdbe0009040 comp rx=0 tx=0).stop 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 msgr2=0x7fdbe40c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 0x7fdbe40c74f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0af040 tx=0x7fdbdc0197b0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 shutdown_connections 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fdbc8065a90 0x7fdbc8067f50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbe415c9d0 0x7fdbe40c74f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbe40cdd40 0x7fdbe41543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 --2- 172.21.15.119:0/199255747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbe406fdb0 0x7fdbe40c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 >> 172.21.15.119:0/199255747 conn(0x7fdbe406a3e0 msgr2=0x7fdbe40c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 shutdown_connections 2023-12-19T16:18:17.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.307+0000 7fdbebc95640 1 -- 172.21.15.119:0/199255747 wait complete. 2023-12-19T16:18:17.331 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:17.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.463+0000 7fccf2517640 1 Processor -- start 2023-12-19T16:18:17.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.463+0000 7fccf2517640 1 -- start start 2023-12-19T16:18:17.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccf2517640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fccec1570c0 0x7fccec06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccf2517640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0c9460 con 0x7fccec0ca000 2023-12-19T16:18:17.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccf2517640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec1574a0 con 0x7fccec06c320 2023-12-19T16:18:17.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccf2517640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec06c7a0 con 0x7fccec1570c0 2023-12-19T16:18:17.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccebfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fccec1570c0 0x7fccec06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccf0ab4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fccec0ca000 0x7fccec070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54416/0 (socket says 172.21.15.119:54416) 2023-12-19T16:18:17.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccebfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fccec1570c0 0x7fccec06bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57250/0 (socket says 172.21.15.119:57250) 2023-12-19T16:18:17.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccf0ab4640 1 -- 172.21.15.119:0/611768393 learned_addr learned my addr 172.21.15.119:0/611768393 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:17.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccebfff640 1 -- 172.21.15.119:0/611768393 >> v1:172.21.15.143:6789/0 conn(0x7fccec06c320 legacy=0x7fccec0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccebfff640 1 -- 172.21.15.119:0/611768393 >> v1:172.21.15.119:6789/0 conn(0x7fccec0ca000 legacy=0x7fccec070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fccebfff640 1 -- 172.21.15.119:0/611768393 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0c8b30 con 0x7fccec1570c0 2023-12-19T16:18:17.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.467+0000 7fcceaffd640 1 -- 172.21.15.119:0/611768393 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123885759 0 0) 0x7fccec0c9460 con 0x7fccec0ca000 2023-12-19T16:18:17.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccebfff640 1 --2- 172.21.15.119:0/611768393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec1570c0 0x7fccec06bde0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0097c0 tx=0x7fccdc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d6c49180adacd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fcceaffd640 1 -- 172.21.15.119:0/611768393 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0ac620 con 0x7fccec1570c0 2023-12-19T16:18:17.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fcceaffd640 1 -- 172.21.15.119:0/611768393 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0ac780 con 0x7fccec1570c0 2023-12-19T16:18:17.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fcceaffd640 1 -- 172.21.15.119:0/611768393 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0acb10 con 0x7fccec1570c0 2023-12-19T16:18:17.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 -- 172.21.15.119:0/611768393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec1570c0 msgr2=0x7fccec06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 --2- 172.21.15.119:0/611768393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec1570c0 0x7fccec06bde0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0097c0 tx=0x7fccdc01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 -- 172.21.15.119:0/611768393 shutdown_connections 2023-12-19T16:18:17.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 --2- 172.21.15.119:0/611768393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec1570c0 0x7fccec06bde0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 -- 172.21.15.119:0/611768393 >> 172.21.15.119:0/611768393 conn(0x7fccec06a3e0 msgr2=0x7fccec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:17.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 -- 172.21.15.119:0/611768393 shutdown_connections 2023-12-19T16:18:17.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 -- 172.21.15.119:0/611768393 wait complete. 2023-12-19T16:18:17.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 Processor -- start 2023-12-19T16:18:17.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.471+0000 7fccf2517640 1 -- start start 2023-12-19T16:18:17.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 0x7fccec0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccec0ca000 0x7fccec149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccec1570c0 0x7fccec155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c7bd0 con 0x7fccec06c320 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec149b90 con 0x7fccec0ca000 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c5430 con 0x7fccec1570c0 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 0x7fccec0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 0x7fccec0c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57256/0 (socket says 172.21.15.119:57256) 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 -- 172.21.15.119:0/2984667620 learned_addr learned my addr 172.21.15.119:0/2984667620 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fcceb7fe640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccec0ca000 0x7fccec149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf0ab4640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccec1570c0 0x7fccec155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 -- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccec1570c0 msgr2=0x7fccec155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccec1570c0 0x7fccec155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 -- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccec0ca000 msgr2=0x7fccec149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccec0ca000 0x7fccec149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 -- 172.21.15.119:0/2984667620 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009420 con 0x7fccec06c320 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf0ab4640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccec1570c0 0x7fccec155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccebfff640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 0x7fccec0c7690 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fccdc018fd0 tx=0x7fccdc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0b8650 con 0x7fccec06c320 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0b87d0 con 0x7fccec06c320 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0c59f0 con 0x7fccec06c320 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0b8b80 con 0x7fccec06c320 2023-12-19T16:18:17.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec15a570 con 0x7fccec06c320 2023-12-19T16:18:17.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec0735b0 con 0x7fccec06c320 2023-12-19T16:18:17.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.475+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fccdc0aa070 con 0x7fccec06c320 2023-12-19T16:18:17.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.479+0000 7fcce8ff9640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fccd8065a60 0x7fccd8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.479+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fccdc11da20 con 0x7fccec06c320 2023-12-19T16:18:17.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.479+0000 7fcceb7fe640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fccd8065a60 0x7fccd8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.479+0000 7fcceb7fe640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fccd8065a60 0x7fccd8067f20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fccec150b10 tx=0x7fcce0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.483+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fccdc0eb330 con 0x7fccec06c320 2023-12-19T16:18:17.637 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.631+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccec0b0980 con 0x7fccec06c320 2023-12-19T16:18:17.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fcce8ff9640 1 -- 172.21.15.119:0/2984667620 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fccdc0ee950 con 0x7fccec06c320 2023-12-19T16:18:17.638 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:17.638 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":55,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:17:53.034043+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:49.778202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:51.022485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:17.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fccd8065a60 msgr2=0x7fccd8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fccd8065a60 0x7fccd8067f20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fccec150b10 tx=0x7fcce0009040 comp rx=0 tx=0).stop 2023-12-19T16:18:17.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 msgr2=0x7fccec0c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 0x7fccec0c7690 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fccdc018fd0 tx=0x7fccdc01ac00 comp rx=0 tx=0).stop 2023-12-19T16:18:17.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 shutdown_connections 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fccd8065a60 0x7fccd8067f20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccec0ca000 0x7fccec149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccec1570c0 0x7fccec155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 --2- 172.21.15.119:0/2984667620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec06c320 0x7fccec0c7690 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 >> 172.21.15.119:0/2984667620 conn(0x7fccec06a3e0 msgr2=0x7fccec0c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 shutdown_connections 2023-12-19T16:18:17.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.635+0000 7fccf2517640 1 -- 172.21.15.119:0/2984667620 wait complete. 2023-12-19T16:18:17.659 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:18:17.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.791+0000 7fca35466640 1 Processor -- start 2023-12-19T16:18:17.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.791+0000 7fca35466640 1 -- start start 2023-12-19T16:18:17.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca35466640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301570c0 0x7fca3006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca35466640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fca3006c320 0x7fca300c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca35466640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300c9460 con 0x7fca300c9e30 2023-12-19T16:18:17.798 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca35466640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3006c7a0 con 0x7fca3006c320 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca35466640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca301574a0 con 0x7fca301570c0 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301570c0 0x7fca3006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca267fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fca3006c320 0x7fca300c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fca300c9e30 0x7fca3015d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:33528/0 (socket says 172.21.15.119:33528) 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2f7fe640 1 -- 172.21.15.119:0/872710942 learned_addr learned my addr 172.21.15.119:0/872710942 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2effd640 1 -- 172.21.15.119:0/872710942 >> v2:172.21.15.143:3300/0 conn(0x7fca3006c320 msgr2=0x7fca300c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2effd640 1 --2- 172.21.15.119:0/872710942 >> v2:172.21.15.143:3300/0 conn(0x7fca3006c320 0x7fca300c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.799 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2effd640 1 -- 172.21.15.119:0/872710942 >> v1:172.21.15.143:6789/0 conn(0x7fca300c9e30 legacy=0x7fca3015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca2effd640 1 -- 172.21.15.119:0/872710942 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300c8b30 con 0x7fca301570c0 2023-12-19T16:18:17.800 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.795+0000 7fca267fc640 1 --2- 172.21.15.119:0/872710942 >> v2:172.21.15.143:3300/0 conn(0x7fca3006c320 0x7fca300c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca2effd640 1 --2- 172.21.15.119:0/872710942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301570c0 0x7fca3006bde0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca180097c0 tx=0x7fca1801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6ea8106bff7453 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca2e7fc640 1 -- 172.21.15.119:0/872710942 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab600 con 0x7fca301570c0 2023-12-19T16:18:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca2e7fc640 1 -- 172.21.15.119:0/872710942 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca180a7050 con 0x7fca301570c0 2023-12-19T16:18:17.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca2e7fc640 1 -- 172.21.15.119:0/872710942 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab980 con 0x7fca301570c0 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 -- 172.21.15.119:0/872710942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301570c0 msgr2=0x7fca3006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 --2- 172.21.15.119:0/872710942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301570c0 0x7fca3006bde0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca180097c0 tx=0x7fca1801c3c0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 -- 172.21.15.119:0/872710942 shutdown_connections 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 --2- 172.21.15.119:0/872710942 >> v2:172.21.15.143:3300/0 conn(0x7fca3006c320 0x7fca300c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 --2- 172.21.15.119:0/872710942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301570c0 0x7fca3006bde0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 -- 172.21.15.119:0/872710942 >> 172.21.15.119:0/872710942 conn(0x7fca3006a3e0 msgr2=0x7fca300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 -- 172.21.15.119:0/872710942 shutdown_connections 2023-12-19T16:18:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 -- 172.21.15.119:0/872710942 wait complete. 2023-12-19T16:18:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 Processor -- start 2023-12-19T16:18:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.799+0000 7fca35466640 1 -- start start 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 0x7fca30163000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca300c9e30 0x7fca3014f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 0x7fca30165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca30157680 con 0x7fca301570c0 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301635e0 con 0x7fca300c9e30 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca301638c0 con 0x7fca3006c320 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 0x7fca30165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 0x7fca30163000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 0x7fca30163000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:55334/0 (socket says 172.21.15.119:55334) 2023-12-19T16:18:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2effd640 1 -- 172.21.15.119:0/3075429424 learned_addr learned my addr 172.21.15.119:0/3075429424 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 0x7fca30165d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57270/0 (socket says 172.21.15.119:57270) 2023-12-19T16:18:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca267fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca300c9e30 0x7fca3014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 -- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 msgr2=0x7fca30163000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 0x7fca30163000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 -- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca300c9e30 msgr2=0x7fca3014f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca300c9e30 0x7fca3014f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 -- 172.21.15.119:0/3075429424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009420 con 0x7fca301570c0 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2effd640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 0x7fca30163000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca2f7fe640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 0x7fca30165d70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fca2800caa0 tx=0x7fca2800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800ab40 con 0x7fca301570c0 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800aca0 con 0x7fca301570c0 2023-12-19T16:18:17.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28012600 con 0x7fca301570c0 2023-12-19T16:18:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca18009420 con 0x7fca301570c0 2023-12-19T16:18:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3014fd70 con 0x7fca301570c0 2023-12-19T16:18:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.803+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca300735b0 con 0x7fca301570c0 2023-12-19T16:18:17.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.807+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca28012760 con 0x7fca301570c0 2023-12-19T16:18:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.807+0000 7fca27fff640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fca10065a60 0x7fca10067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.807+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca28082f20 con 0x7fca301570c0 2023-12-19T16:18:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.807+0000 7fca2effd640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fca10065a60 0x7fca10067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:17.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.807+0000 7fca2effd640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fca10065a60 0x7fca10067f20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca180097c0 tx=0x7fca180a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:17.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.811+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fca280508e0 con 0x7fca301570c0 2023-12-19T16:18:17.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:17.995+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fca3004e000 con 0x7fca301570c0 2023-12-19T16:18:17.998 INFO:tasks.ceph.mon.a.smithi119.stderr:2023-12-19T16:18:17.995+0000 7f5651957640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:18:18.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca27fff640 1 -- 172.21.15.119:0/3075429424 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fca28017090 con 0x7fca301570c0 2023-12-19T16:18:18.011 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fca10065a60 msgr2=0x7fca10067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fca10065a60 0x7fca10067f20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca180097c0 tx=0x7fca180a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 msgr2=0x7fca30165d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 0x7fca30165d70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fca2800caa0 tx=0x7fca2800cf60 comp rx=0 tx=0).stop 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 shutdown_connections 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fca10065a60 0x7fca10067f20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca300c9e30 0x7fca3014f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca301570c0 0x7fca30165d70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 --2- 172.21.15.119:0/3075429424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca3006c320 0x7fca30163000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 >> 172.21.15.119:0/3075429424 conn(0x7fca3006a3e0 msgr2=0x7fca3015ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 shutdown_connections 2023-12-19T16:18:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.007+0000 7fca35466640 1 -- 172.21.15.119:0/3075429424 wait complete. 2023-12-19T16:18:18.017 INFO:tasks.ceph.mds.c.smithi119.stderr: -2449> 2023-12-19T16:17:57.623+0000 7f4f2a75e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:18:18.033 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:18:18.063 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2023-12-19T16:18:18.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.171+0000 7f1081fc0640 1 Processor -- start 2023-12-19T16:18:18.177 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1081fc0640 1 -- start start 2023-12-19T16:18:18.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1081fc0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:18.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1081fc0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:18.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1081fc0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c0c9390 con 0x7f107c0ce3b0 2023-12-19T16:18:18.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1081fc0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c15aee0 con 0x7f107c070820 2023-12-19T16:18:18.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1081fc0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c15b1c0 con 0x7f107c1582d0 2023-12-19T16:18:18.178 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f107c0ce3b0 0x7f107c0cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54428/0 (socket says 172.21.15.119:54428) 2023-12-19T16:18:18.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107bfff640 1 -- 172.21.15.119:0/89108731 learned_addr learned my addr 172.21.15.119:0/89108731 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:18.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1073fff640 1 --2- 172.21.15.119:0/89108731 >> v2:172.21.15.143:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:18.179 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107b7fe640 1 --2- 172.21.15.119:0/89108731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107affd640 1 -- 172.21.15.119:0/89108731 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265340668 0 0) 0x7f107c0c9390 con 0x7f107c0ce3b0 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107affd640 1 -- 172.21.15.119:0/89108731 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1068003530 con 0x7f107c0ce3b0 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107affd640 1 -- 172.21.15.119:0/89108731 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7876998 0 0) 0x7f1068003530 con 0x7f107c0ce3b0 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107b7fe640 1 -- 172.21.15.119:0/89108731 >> v2:172.21.15.143:3300/0 conn(0x7f107c070820 msgr2=0x7f107c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107b7fe640 1 --2- 172.21.15.119:0/89108731 >> v2:172.21.15.143:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107b7fe640 1 -- 172.21.15.119:0/89108731 >> v1:172.21.15.119:6789/0 conn(0x7f107c0ce3b0 legacy=0x7f107c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f107b7fe640 1 -- 172.21.15.119:0/89108731 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c15b4a0 con 0x7f107c1582d0 2023-12-19T16:18:18.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.175+0000 7f1073fff640 1 --2- 172.21.15.119:0/89108731 >> v2:172.21.15.143:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:18.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f107b7fe640 1 --2- 172.21.15.119:0/89108731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f106c0097c0 tx=0x7f106c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51fe062830959a43 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:18.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f107affd640 1 -- 172.21.15.119:0/89108731 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074001a00 con 0x7f107c1582d0 2023-12-19T16:18:18.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f107affd640 1 -- 172.21.15.119:0/89108731 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c0a7050 con 0x7f107c1582d0 2023-12-19T16:18:18.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f107affd640 1 -- 172.21.15.119:0/89108731 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0ab620 con 0x7f107c1582d0 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 -- 172.21.15.119:0/89108731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c1582d0 msgr2=0x7f107c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 --2- 172.21.15.119:0/89108731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f106c0097c0 tx=0x7f106c01c370 comp rx=0 tx=0).stop 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 -- 172.21.15.119:0/89108731 shutdown_connections 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 --2- 172.21.15.119:0/89108731 >> v2:172.21.15.143:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 --2- 172.21.15.119:0/89108731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 -- 172.21.15.119:0/89108731 >> 172.21.15.119:0/89108731 conn(0x7f107c06a2a0 msgr2=0x7f107c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 -- 172.21.15.119:0/89108731 shutdown_connections 2023-12-19T16:18:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.179+0000 7f1081fc0640 1 -- 172.21.15.119:0/89108731 wait complete. 2023-12-19T16:18:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 Processor -- start 2023-12-19T16:18:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- start start 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c070820 0x7f107c0c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 0x7f107c0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f107c1582d0 0x7f107c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c1532e0 con 0x7f107c0ce3b0 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c155320 con 0x7f107c1582d0 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c155600 con 0x7f107c070820 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 0x7f107c0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 0x7f107c0c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57288/0 (socket says 172.21.15.119:57288) 2023-12-19T16:18:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 -- 172.21.15.119:0/4051088109 learned_addr learned my addr 172.21.15.119:0/4051088109 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f107b7fe640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c070820 0x7f107c0c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f107bfff640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f107c1582d0 0x7f107c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 -- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c070820 msgr2=0x7f107c0c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c070820 0x7f107c0c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 -- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f107c1582d0 msgr2=0x7f107c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f107c1582d0 0x7f107c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 -- 172.21.15.119:0/4051088109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009420 con 0x7f107c0ce3b0 2023-12-19T16:18:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1073fff640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 0x7f107c0c48a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f106400ebe0 tx=0x7f106400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106400eee0 con 0x7f107c0ce3b0 2023-12-19T16:18:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106400cc30 con 0x7f107c0ce3b0 2023-12-19T16:18:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064013470 con 0x7f107c0ce3b0 2023-12-19T16:18:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c009420 con 0x7f107c0ce3b0 2023-12-19T16:18:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c155bc0 con 0x7f107c0ce3b0 2023-12-19T16:18:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.183+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c04e000 con 0x7f107c0ce3b0 2023-12-19T16:18:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.187+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f10640135d0 con 0x7f107c0ce3b0 2023-12-19T16:18:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.187+0000 7f1078ff9640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f105c065a60 0x7f105c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.187+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f1064083590 con 0x7f107c0ce3b0 2023-12-19T16:18:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.187+0000 7f107b7fe640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f105c065a60 0x7f105c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.187+0000 7f107b7fe640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f105c065a60 0x7f105c067f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f106c0ad000 tx=0x7f106c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.191+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1064050e40 con 0x7f107c0ce3b0 2023-12-19T16:18:18.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:18.371+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f107c0c1930 con 0x7f107c0ce3b0 2023-12-19T16:18:18.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:18.726 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1078ff9640 1 -- 172.21.15.119:0/4051088109 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1064054460 con 0x7f107c0ce3b0 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f105c065a60 msgr2=0x7f105c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f105c065a60 0x7f105c067f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f106c0ad000 tx=0x7f106c0a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 msgr2=0x7f107c0c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 0x7f107c0c48a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f106400ebe0 tx=0x7f106400c520 comp rx=0 tx=0).stop 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 shutdown_connections 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f105c065a60 0x7f105c067f20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f107c1582d0 0x7f107c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f107c0ce3b0 0x7f107c0c48a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 --2- 172.21.15.119:0/4051088109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f107c070820 0x7f107c0c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 >> 172.21.15.119:0/4051088109 conn(0x7f107c06a2a0 msgr2=0x7f107c0ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 shutdown_connections 2023-12-19T16:18:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.011+0000 7f1081fc0640 1 -- 172.21.15.119:0/4051088109 wait complete. 2023-12-19T16:18:19.037 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:18:19.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.175+0000 7f6088441640 1 Processor -- start 2023-12-19T16:18:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.175+0000 7f6088441640 1 -- start start 2023-12-19T16:18:19.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f6088441640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60800ce6a0 0x7f60800ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:19.182 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f6088441640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ca200 0x7f60800cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f6088441640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60800c9a00 con 0x7f608015d180 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f6088441640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6080159b20 con 0x7f60800ce6a0 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f6088441640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60800cefc0 con 0x7f60800ca200 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60869de640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f608015d180 0x7f608015d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54442/0 (socket says 172.21.15.119:54442) 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60869de640 1 -- 172.21.15.119:0/2738159762 learned_addr learned my addr 172.21.15.119:0/2738159762 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60859dc640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ca200 0x7f60800cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60861dd640 1 --2- 172.21.15.119:0/2738159762 >> v2:172.21.15.143:3300/0 conn(0x7f60800ce6a0 0x7f60800ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60851db640 1 -- 172.21.15.119:0/2738159762 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297182957 0 0) 0x7f60800c9a00 con 0x7f608015d180 2023-12-19T16:18:19.183 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60851db640 1 -- 172.21.15.119:0/2738159762 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f606c003530 con 0x7f608015d180 2023-12-19T16:18:19.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60861dd640 1 -- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ca200 msgr2=0x7f60800cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:19.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60861dd640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ca200 0x7f60800cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60861dd640 1 -- 172.21.15.119:0/2738159762 >> v1:172.21.15.119:6789/0 conn(0x7f608015d180 legacy=0x7f608015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:19.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60861dd640 1 -- 172.21.15.119:0/2738159762 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60800ad6e0 con 0x7f60800ce6a0 2023-12-19T16:18:19.184 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.179+0000 7f60859dc640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ca200 0x7f60800cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:19.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f60861dd640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60800ce6a0 0x7f60800ca730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f607c0097c0 tx=0x7f607c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf6630df9e8f9245 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:19.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f60851db640 1 -- 172.21.15.119:0/2738159762 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0ab670 con 0x7f60800ce6a0 2023-12-19T16:18:19.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f60851db640 1 -- 172.21.15.119:0/2738159762 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c0ab7d0 con 0x7f60800ce6a0 2023-12-19T16:18:19.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f60851db640 1 -- 172.21.15.119:0/2738159762 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0abb60 con 0x7f60800ce6a0 2023-12-19T16:18:19.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 -- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60800ce6a0 msgr2=0x7f60800ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:19.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60800ce6a0 0x7f60800ca730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f607c0097c0 tx=0x7f607c01c450 comp rx=0 tx=0).stop 2023-12-19T16:18:19.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 -- 172.21.15.119:0/2738159762 shutdown_connections 2023-12-19T16:18:19.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ca200 0x7f60800cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 --2- 172.21.15.119:0/2738159762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60800ce6a0 0x7f60800ca730 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 -- 172.21.15.119:0/2738159762 >> 172.21.15.119:0/2738159762 conn(0x7f6080069e70 msgr2=0x7f608006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:19.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 -- 172.21.15.119:0/2738159762 shutdown_connections 2023-12-19T16:18:19.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 -- 172.21.15.119:0/2738159762 wait complete. 2023-12-19T16:18:19.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 Processor -- start 2023-12-19T16:18:19.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.183+0000 7f6088441640 1 -- start start 2023-12-19T16:18:19.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 0x7f60800978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:19.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ce6a0 0x7f608015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:19.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f608015d180 0x7f60800cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:19.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6080162630 con 0x7f60800ca200 2023-12-19T16:18:19.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800b0330 con 0x7f608015d180 2023-12-19T16:18:19.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60800b0610 con 0x7f60800ce6a0 2023-12-19T16:18:19.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 0x7f60800978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:19.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 0x7f60800978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57298/0 (socket says 172.21.15.119:57298) 2023-12-19T16:18:19.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 -- 172.21.15.119:0/3599772852 learned_addr learned my addr 172.21.15.119:0/3599772852 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:19.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60869de640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f608015d180 0x7f60800cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:19.192 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60859dc640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ce6a0 0x7f608015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 -- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ce6a0 msgr2=0x7f608015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ce6a0 0x7f608015c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 -- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f608015d180 msgr2=0x7f60800cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f608015d180 0x7f60800cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 -- 172.21.15.119:0/3599772852 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009420 con 0x7f60800ca200 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60869de640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f608015d180 0x7f60800cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f60861dd640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 0x7f60800978d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f607c0ad040 tx=0x7f607c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0bf610 con 0x7f60800ca200 2023-12-19T16:18:19.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c0bf770 con 0x7f60800ca200 2023-12-19T16:18:19.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0bfb20 con 0x7f60800ca200 2023-12-19T16:18:19.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c009420 con 0x7f60800ca200 2023-12-19T16:18:19.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60800b0bd0 con 0x7f60800ca200 2023-12-19T16:18:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608004e070 con 0x7f60800ca200 2023-12-19T16:18:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.187+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f607c0bfc80 con 0x7f60800ca200 2023-12-19T16:18:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.191+0000 7f6076ffd640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6064065a60 0x7f6064067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.191+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f607c11dca0 con 0x7f60800ca200 2023-12-19T16:18:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.191+0000 7f60859dc640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6064065a60 0x7f6064067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.191+0000 7f60859dc640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6064065a60 0x7f6064067f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f608009c4e0 tx=0x7f6070008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:19.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.195+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f607c0eb430 con 0x7f60800ca200 2023-12-19T16:18:19.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:19.347+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60800c9bb0 con 0x7f60800ca200 2023-12-19T16:18:20.289 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.287+0000 7f6076ffd640 1 -- 172.21.15.119:0/3599772852 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f607c0eea50 con 0x7f60800ca200 2023-12-19T16:18:20.290 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:18:20.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6064065a60 msgr2=0x7f6064067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6064065a60 0x7f6064067f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f608009c4e0 tx=0x7f6070008040 comp rx=0 tx=0).stop 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 msgr2=0x7f60800978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 0x7f60800978d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f607c0ad040 tx=0x7f607c01ac90 comp rx=0 tx=0).stop 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 shutdown_connections 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6064065a60 0x7f6064067f20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f608015d180 0x7f60800cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60800ce6a0 0x7f608015c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 --2- 172.21.15.119:0/3599772852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800ca200 0x7f60800978d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 >> 172.21.15.119:0/3599772852 conn(0x7f6080069e70 msgr2=0x7f6080071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 shutdown_connections 2023-12-19T16:18:20.294 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.291+0000 7f6088441640 1 -- 172.21.15.119:0/3599772852 wait complete. 2023-12-19T16:18:20.317 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:18:20.462 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f141608c640 1 Processor -- start 2023-12-19T16:18:20.463 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f141608c640 1 -- start start 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f141608c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14100ce5d0 0x7f14100ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f141608c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100b28a0 con 0x7f141006d440 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f141608c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100ac1a0 con 0x7f141006d8a0 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f141608c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141006dcd0 con 0x7f14100ce5d0 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f141006d440 0x7f141015e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54458/0 (socket says 172.21.15.119:54458) 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140effd640 1 -- 172.21.15.119:0/2976960708 learned_addr learned my addr 172.21.15.119:0/2976960708 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140f7fe640 1 --2- 172.21.15.119:0/2976960708 >> v2:172.21.15.143:3300/0 conn(0x7f14100ce5d0 0x7f14100ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584248581 0 0) 0x7f14100b28a0 con 0x7f141006d440 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f8003530 con 0x7f141006d440 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469314401 0 0) 0x7f14100ac1a0 con 0x7f141006d8a0 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14100b28a0 con 0x7f141006d8a0 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140f7fe640 1 -- 172.21.15.119:0/2976960708 >> v1:172.21.15.143:6789/0 conn(0x7f141006d8a0 legacy=0x7f141015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140f7fe640 1 -- 172.21.15.119:0/2976960708 >> v1:172.21.15.119:6789/0 conn(0x7f141006d440 legacy=0x7f141015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.459+0000 7f140f7fe640 1 -- 172.21.15.119:0/2976960708 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141015f0f0 con 0x7f14100ce5d0 2023-12-19T16:18:20.467 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f140f7fe640 1 --2- 172.21.15.119:0/2976960708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100ce9b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14000097c0 tx=0x7f140001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48bba88f0dc77c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000a6040 con 0x7f14100ce5d0 2023-12-19T16:18:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14000aa600 con 0x7f14100ce5d0 2023-12-19T16:18:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f140e7fc640 1 -- 172.21.15.119:0/2976960708 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000aa970 con 0x7f14100ce5d0 2023-12-19T16:18:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 -- 172.21.15.119:0/2976960708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 msgr2=0x7f14100ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 --2- 172.21.15.119:0/2976960708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100ce9b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14000097c0 tx=0x7f140001c480 comp rx=0 tx=0).stop 2023-12-19T16:18:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 -- 172.21.15.119:0/2976960708 shutdown_connections 2023-12-19T16:18:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 --2- 172.21.15.119:0/2976960708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100ce9b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 -- 172.21.15.119:0/2976960708 >> 172.21.15.119:0/2976960708 conn(0x7f1410069e70 msgr2=0x7f141006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 -- 172.21.15.119:0/2976960708 shutdown_connections 2023-12-19T16:18:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.463+0000 7f141608c640 1 -- 172.21.15.119:0/2976960708 wait complete. 2023-12-19T16:18:20.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 Processor -- start 2023-12-19T16:18:20.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 -- start start 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141006d440 0x7f14100c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 0x7f14100c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100c1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14100ade20 con 0x7f141006d8a0 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14100cc110 con 0x7f14100ce5d0 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1410152e80 con 0x7f141006d440 2023-12-19T16:18:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 0x7f14100c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 0x7f14100c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57308/0 (socket says 172.21.15.119:57308) 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 -- 172.21.15.119:0/2479627260 learned_addr learned my addr 172.21.15.119:0/2479627260 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140f7fe640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141006d440 0x7f14100c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140ffff640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 -- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141006d440 msgr2=0x7f14100c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141006d440 0x7f14100c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 -- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 msgr2=0x7f14100c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 -- 172.21.15.119:0/2479627260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009420 con 0x7f141006d8a0 2023-12-19T16:18:20.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f140effd640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 0x7f14100c1330 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f140400c4f0 tx=0x7f140400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404005cf0 con 0x7f141006d8a0 2023-12-19T16:18:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404005e50 con 0x7f141006d8a0 2023-12-19T16:18:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404007270 con 0x7f141006d8a0 2023-12-19T16:18:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.467+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1410153160 con 0x7f141006d8a0 2023-12-19T16:18:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1410153720 con 0x7f141006d8a0 2023-12-19T16:18:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141004e070 con 0x7f141006d8a0 2023-12-19T16:18:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14040073d0 con 0x7f141006d8a0 2023-12-19T16:18:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f13f7fff640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f13fc065a60 0x7f13fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f1404082670 con 0x7f141006d8a0 2023-12-19T16:18:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f140f7fe640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f13fc065a60 0x7f13fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.471+0000 7f140f7fe640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f13fc065a60 0x7f13fc067f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f14000ae000 tx=0x7f1400008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:20.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.475+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1404053b90 con 0x7f141006d8a0 2023-12-19T16:18:20.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:20.627+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f141006c630 con 0x7f141006d8a0 2023-12-19T16:18:21.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f13f7fff640 1 -- 172.21.15.119:0/2479627260 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1404053720 con 0x7f141006d8a0 2023-12-19T16:18:21.297 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2023-12-19T16:18:21.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f13fc065a60 msgr2=0x7f13fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f13fc065a60 0x7f13fc067f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f14000ae000 tx=0x7f1400008040 comp rx=0 tx=0).stop 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 msgr2=0x7f14100c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 0x7f14100c1330 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f140400c4f0 tx=0x7f140400c9b0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 shutdown_connections 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f13fc065a60 0x7f13fc067f20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14100ce5d0 0x7f14100c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141006d8a0 0x7f14100c1330 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 --2- 172.21.15.119:0/2479627260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141006d440 0x7f14100c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.295+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 >> 172.21.15.119:0/2479627260 conn(0x7f1410069e70 msgr2=0x7f14100c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.299+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 shutdown_connections 2023-12-19T16:18:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.299+0000 7f141608c640 1 -- 172.21.15.119:0/2479627260 wait complete. 2023-12-19T16:18:21.323 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T16:18:21.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa003d8f640 1 Processor -- start 2023-12-19T16:18:21.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa003d8f640 1 -- start start 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa003d8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ffc070820 0x7f9ffc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa003d8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc0c9390 con 0x7f9ffc1582d0 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa003d8f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc15aee0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa003d8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc15b1c0 con 0x7f9ffc070820 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa00132a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ffc070820 0x7f9ffc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa00132a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ffc070820 0x7f9ffc0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57316/0 (socket says 172.21.15.119:57316) 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa00132a640 1 -- 172.21.15.119:0/4233869721 learned_addr learned my addr 172.21.15.119:0/4233869721 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:21.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa001b2b640 1 --1- 172.21.15.119:0/4233869721 >> v1:172.21.15.119:6789/0 conn(0x7f9ffc1582d0 0x7f9ffc0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54470/0 (socket says 172.21.15.119:54470) 2023-12-19T16:18:21.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa00132a640 1 -- 172.21.15.119:0/4233869721 >> v1:172.21.15.143:6789/0 conn(0x7f9ffc0ce3b0 legacy=0x7f9ffc0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa00132a640 1 -- 172.21.15.119:0/4233869721 >> v1:172.21.15.119:6789/0 conn(0x7f9ffc1582d0 legacy=0x7f9ffc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa00132a640 1 -- 172.21.15.119:0/4233869721 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc15b4a0 con 0x7f9ffc070820 2023-12-19T16:18:21.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.475+0000 7fa000b29640 1 -- 172.21.15.119:0/4233869721 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428860526 0 0) 0x7f9ffc0c9390 con 0x7f9ffc1582d0 2023-12-19T16:18:21.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa00132a640 1 --2- 172.21.15.119:0/4233869721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc070820 0x7f9ffc0c8e50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009870 tx=0x7f9fec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e146634a232b4a9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa000b29640 1 -- 172.21.15.119:0/4233869721 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0a95f0 con 0x7f9ffc070820 2023-12-19T16:18:21.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa000b29640 1 -- 172.21.15.119:0/4233869721 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec0a9750 con 0x7f9ffc070820 2023-12-19T16:18:21.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa000b29640 1 -- 172.21.15.119:0/4233869721 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0a9ae0 con 0x7f9ffc070820 2023-12-19T16:18:21.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 -- 172.21.15.119:0/4233869721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc070820 msgr2=0x7f9ffc0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 --2- 172.21.15.119:0/4233869721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc070820 0x7f9ffc0c8e50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009870 tx=0x7f9fec01c510 comp rx=0 tx=0).stop 2023-12-19T16:18:21.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 -- 172.21.15.119:0/4233869721 shutdown_connections 2023-12-19T16:18:21.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 --2- 172.21.15.119:0/4233869721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc070820 0x7f9ffc0c8e50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 -- 172.21.15.119:0/4233869721 >> 172.21.15.119:0/4233869721 conn(0x7f9ffc06a2a0 msgr2=0x7f9ffc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:21.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 -- 172.21.15.119:0/4233869721 shutdown_connections 2023-12-19T16:18:21.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.479+0000 7fa003d8f640 1 -- 172.21.15.119:0/4233869721 wait complete. 2023-12-19T16:18:21.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 Processor -- start 2023-12-19T16:18:21.486 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 -- start start 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc070820 0x7f9ffc157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 0x7f9ffc0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc1582d0 0x7f9ffc0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0c4da0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0c43d0 con 0x7f9ffc070820 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0c2ea0 con 0x7f9ffc1582d0 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 0x7f9ffc0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 0x7f9ffc0c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57330/0 (socket says 172.21.15.119:57330) 2023-12-19T16:18:21.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 -- 172.21.15.119:0/1620635453 learned_addr learned my addr 172.21.15.119:0/1620635453 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 -- 172.21.15.119:0/1620635453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc1582d0 msgr2=0x7f9ffc0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc1582d0 0x7f9ffc0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 -- 172.21.15.119:0/1620635453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc070820 msgr2=0x7f9ffc157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc070820 0x7f9ffc157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 -- 172.21.15.119:0/1620635453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0094d0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa00132a640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 0x7f9ffc0c4860 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9fec019120 tx=0x7f9fec01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0b1800 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec0b1960 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc0c37c0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0b1d10 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.483+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc0c3d80 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.487+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc04e000 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.487+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9fec0bc450 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.487+0000 7f9ff27fc640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe0065a90 0x7f9fe0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.487+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9fec11dee0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.487+0000 7fa001b2b640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe0065a90 0x7f9fe0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.487+0000 7fa001b2b640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe0065a90 0x7f9fe0067f50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c10 tx=0x7f9ff80079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.491+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9fec0eb9c0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.643+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9ffc0c4540 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.650 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7f9ff27fc640 1 -- 172.21.15.119:0/1620635453 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9fec0eefe0 con 0x7f9ffc0ce3b0 2023-12-19T16:18:21.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe0065a90 msgr2=0x7f9fe0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.652 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe0065a90 0x7f9fe0067f50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c10 tx=0x7f9ff80079d0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 msgr2=0x7f9ffc0c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 0x7f9ffc0c4860 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9fec019120 tx=0x7f9fec01ad50 comp rx=0 tx=0).stop 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 shutdown_connections 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f9fe0065a90 0x7f9fe0067f50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc1582d0 0x7f9ffc0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc0ce3b0 0x7f9ffc0c4860 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 --2- 172.21.15.119:0/1620635453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc070820 0x7f9ffc157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 >> 172.21.15.119:0/1620635453 conn(0x7f9ffc06a2a0 msgr2=0x7f9ffc06be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 shutdown_connections 2023-12-19T16:18:21.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.647+0000 7fa003d8f640 1 -- 172.21.15.119:0/1620635453 wait complete. 2023-12-19T16:18:21.671 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-12-19T16:18:21.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.803+0000 7f0621420640 1 Processor -- start 2023-12-19T16:18:21.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.803+0000 7f0621420640 1 -- start start 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f0621420640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f061c0cac10 0x7f061c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f0621420640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f061c06fdb0 0x7f061c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f0621420640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c15f100 con 0x7f061c15a680 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f0621420640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c070780 con 0x7f061c06fdb0 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f0621420640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0ca7d0 con 0x7f061c0cac10 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f061c06fdb0 0x7f061c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f061c06fdb0 0x7f061c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57344/0 (socket says 172.21.15.119:57344) 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 -- 172.21.15.119:0/3943339990 learned_addr learned my addr 172.21.15.119:0/3943339990 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f06127fc640 1 --2- 172.21.15.119:0/3943339990 >> v2:172.21.15.143:3300/0 conn(0x7f061c0cac10 0x7f061c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 -- 172.21.15.119:0/3943339990 >> v2:172.21.15.143:3300/0 conn(0x7f061c0cac10 msgr2=0x7f061c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 --2- 172.21.15.119:0/3943339990 >> v2:172.21.15.143:3300/0 conn(0x7f061c0cac10 0x7f061c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 -- 172.21.15.119:0/3943339990 >> v1:172.21.15.143:6789/0 conn(0x7f061c15a680 legacy=0x7f061c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:21.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.807+0000 7f061b7fe640 1 -- 172.21.15.119:0/3943339990 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c15e860 con 0x7f061c06fdb0 2023-12-19T16:18:21.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f061b7fe640 1 --2- 172.21.15.119:0/3943339990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c070240 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f061c06cdf0 tx=0x7f061401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb352df8341b79e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f061a7fc640 1 -- 172.21.15.119:0/3943339990 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a57c0 con 0x7f061c06fdb0 2023-12-19T16:18:21.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f061a7fc640 1 -- 172.21.15.119:0/3943339990 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140a5920 con 0x7f061c06fdb0 2023-12-19T16:18:21.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f061a7fc640 1 -- 172.21.15.119:0/3943339990 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a5cb0 con 0x7f061c06fdb0 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 -- 172.21.15.119:0/3943339990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 msgr2=0x7f061c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 --2- 172.21.15.119:0/3943339990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c070240 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f061c06cdf0 tx=0x7f061401c900 comp rx=0 tx=0).stop 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 -- 172.21.15.119:0/3943339990 shutdown_connections 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 --2- 172.21.15.119:0/3943339990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c070240 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 --2- 172.21.15.119:0/3943339990 >> v2:172.21.15.143:3300/0 conn(0x7f061c0cac10 0x7f061c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 -- 172.21.15.119:0/3943339990 >> 172.21.15.119:0/3943339990 conn(0x7f061c06a3e0 msgr2=0x7f061c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 -- 172.21.15.119:0/3943339990 shutdown_connections 2023-12-19T16:18:21.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 -- 172.21.15.119:0/3943339990 wait complete. 2023-12-19T16:18:21.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 Processor -- start 2023-12-19T16:18:21.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.811+0000 7f0621420640 1 -- start start 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f061c0cac10 0x7f061c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f061c15a680 0x7f061c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b1670 con 0x7f061c06fdb0 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c1520e0 con 0x7f061c15a680 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b0d60 con 0x7f061c0cac10 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c1578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57352/0 (socket says 172.21.15.119:57352) 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 -- 172.21.15.119:0/1291164331 learned_addr learned my addr 172.21.15.119:0/1291164331 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061b7fe640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f061c15a680 0x7f061c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f06127fc640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f061c0cac10 0x7f061c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 -- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f061c0cac10 msgr2=0x7f061c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f061c0cac10 0x7f061c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 -- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f061c15a680 msgr2=0x7f061c0c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f061c15a680 0x7f061c0c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 -- 172.21.15.119:0/1291164331 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614009b30 con 0x7f061c06fdb0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f06127fc640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f061c0cac10 0x7f061c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f061affd640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c1578b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f060c00c4c0 tx=0x7f060c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c005480 con 0x7f061c06fdb0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c003600 con 0x7f061c06fdb0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c0c5b30 con 0x7f061c06fdb0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c003990 con 0x7f061c06fdb0 2023-12-19T16:18:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0b1300 con 0x7f061c06fdb0 2023-12-19T16:18:21.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c0735b0 con 0x7f061c06fdb0 2023-12-19T16:18:21.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.815+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f060c003af0 con 0x7f061c06fdb0 2023-12-19T16:18:21.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.819+0000 7f0613fff640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05fc065a60 0x7f05fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.819+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f060c0825d0 con 0x7f061c06fdb0 2023-12-19T16:18:21.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.819+0000 7f06127fc640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05fc065a60 0x7f05fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.819+0000 7f06127fc640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05fc065a60 0x7f05fc067f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f061c1654c0 tx=0x7f0604008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.825 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:21.823+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f060c0500b0 con 0x7f061c06fdb0 2023-12-19T16:18:22.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.023+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f061c04e000 con 0x7f061c06fdb0 2023-12-19T16:18:22.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.295+0000 7f0613fff640 1 -- 172.21.15.119:0/1291164331 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v183) v1 ==== 134+0+0 (secure 0 0 0) 0x7f060c017020 con 0x7f061c06fdb0 2023-12-19T16:18:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05fc065a60 msgr2=0x7f05fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05fc065a60 0x7f05fc067f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f061c1654c0 tx=0x7f0604008040 comp rx=0 tx=0).stop 2023-12-19T16:18:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 msgr2=0x7f061c1578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c1578b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f060c00c4c0 tx=0x7f060c001e80 comp rx=0 tx=0).stop 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 shutdown_connections 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f05fc065a60 0x7f05fc067f20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f061c15a680 0x7f061c0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f061c0cac10 0x7f061c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 --2- 172.21.15.119:0/1291164331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f061c06fdb0 0x7f061c1578b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 >> 172.21.15.119:0/1291164331 conn(0x7f061c06a3e0 msgr2=0x7f061c153200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 shutdown_connections 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:22.299+0000 7f0621420640 1 -- 172.21.15.119:0/1291164331 wait complete. 2023-12-19T16:18:22.323 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/mount.py", line 777, in run_python 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: p.wait() 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-19T16:18:22.324 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:Ran 2 tests in 132.163s 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/mount.py", line 777, in run_python 2023-12-19T16:18:22.325 INFO:tasks.cephfs_test_runner: p.wait() 2023-12-19T16:18:22.326 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-19T16:18:22.326 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-19T16:18:22.328 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-19T16:18:22.329 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-19T16:18:22.329 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-12-19T16:18:22.329 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:22.329 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-19T16:18:22.401 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=460e5fa0834c4f26b457d58e2af65d0e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-19T16:18:22.402 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T16:18:22.412 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-19T16:18:22.434 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-19T16:18:22.435 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:22.435 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:22.449 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:18:22.449 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-19T16:18:22.449 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:22.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2859 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:18:22.502 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:18:22.502 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:22.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:22.512 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-19T16:18:22.513 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:22.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9404 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:22.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:22.563 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-19T16:18:22.615 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T16:18:22.615 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T16:18:22.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:22.616 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T16:18:22.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:22.681 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T16:18:22.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:22.750 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-12-19T16:18:22.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:22.925 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-19T16:18:22.935 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:18:22.935 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:18:22.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:22.935 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:18:23.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:23.000 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:18:23.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:23.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-12-19T16:18:23.251 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T16:18:23.262 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T16:18:23.262 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:23.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.399+0000 7f7b7f725640 1 Processor -- start 2023-12-19T16:18:23.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7f725640 1 -- start start 2023-12-19T16:18:23.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7f725640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7b780704c0 0x7f7b7815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7f725640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7815f100 con 0x7f7b780cac10 2023-12-19T16:18:23.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7f725640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780ca7d0 con 0x7f7b7815a680 2023-12-19T16:18:23.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7f725640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7815e860 con 0x7f7b780704c0 2023-12-19T16:18:23.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7ccc0640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7b780cac10 0x7f7b7806fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38222/0 (socket says 172.21.15.119:38222) 2023-12-19T16:18:23.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7ccc0640 1 -- 172.21.15.119:0/1208821353 learned_addr learned my addr 172.21.15.119:0/1208821353 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 --2- 172.21.15.119:0/1208821353 >> v2:172.21.15.143:3300/0 conn(0x7f7b780704c0 0x7f7b7815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012339040 0 0) 0x7f7b7815f100 con 0x7f7b780cac10 2023-12-19T16:18:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b64003530 con 0x7f7b780cac10 2023-12-19T16:18:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3592868340 0 0) 0x7f7b64003530 con 0x7f7b780cac10 2023-12-19T16:18:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 >> v2:172.21.15.143:3300/0 conn(0x7f7b780704c0 msgr2=0x7f7b7815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 --2- 172.21.15.119:0/1208821353 >> v2:172.21.15.143:3300/0 conn(0x7f7b780704c0 0x7f7b7815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 >> v1:172.21.15.143:6789/0 conn(0x7f7b7815a680 legacy=0x7f7b7815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7815eb40 con 0x7f7b780cac10 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f7b68001680 con 0x7f7b780cac10 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 >> v1:172.21.15.119:6789/0 conn(0x7f7b780cac10 legacy=0x7f7b7806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b64003980 0x7f7b64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640047d0 0x7f7b64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b640052b0 0x7f7b6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7815e860 con 0x7f7b640052b0 2023-12-19T16:18:23.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6400c180 con 0x7f7b64003980 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6400c340 con 0x7f7b640047d0 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b640052b0 0x7f7b6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7d4c1640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b64003980 0x7f7b64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7ccc0640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640047d0 0x7f7b64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 -- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640047d0 msgr2=0x7f7b64004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640047d0 0x7f7b64004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 -- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b64003980 msgr2=0x7f7b64003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b64003980 0x7f7b64003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.411 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.403+0000 7f7b7dcc2640 1 -- 172.21.15.119:0/1208821353 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64003530 con 0x7f7b640052b0 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7dcc2640 1 -- 172.21.15.119:0/1208821353 reap_dead start 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7dcc2640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b640052b0 0x7f7b6400b990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007330 tx=0x7f7b7001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e43d52b55b3804 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700a5c40 con 0x7f7b640052b0 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b700a5da0 con 0x7f7b640052b0 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b6ffff640 1 -- 172.21.15.119:0/1208821353 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70003be0 con 0x7f7b640052b0 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 -- 172.21.15.119:0/1208821353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b640052b0 msgr2=0x7f7b6400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b640052b0 0x7f7b6400b990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007330 tx=0x7f7b7001ce40 comp rx=0 tx=0).stop 2023-12-19T16:18:23.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 -- 172.21.15.119:0/1208821353 shutdown_connections 2023-12-19T16:18:23.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 --2- 172.21.15.119:0/1208821353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b640052b0 0x7f7b6400b990 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 -- 172.21.15.119:0/1208821353 >> 172.21.15.119:0/1208821353 conn(0x7f7b7806a3e0 msgr2=0x7f7b780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 -- 172.21.15.119:0/1208821353 shutdown_connections 2023-12-19T16:18:23.414 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.407+0000 7f7b7f725640 1 -- 172.21.15.119:0/1208821353 wait complete. 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 Processor -- start 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 -- start start 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640052b0 0x7f7b780c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 0x7f7b780c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b78158c90 0x7f7b780708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780c7420 con 0x7f7b780c49d0 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780c5bb0 con 0x7f7b78158c90 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780c7140 con 0x7f7b640052b0 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 0x7f7b780c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7d4c1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640052b0 0x7f7b780c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 0x7f7b780c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50048/0 (socket says 172.21.15.119:50048) 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 -- 172.21.15.119:0/2907151217 learned_addr learned my addr 172.21.15.119:0/2907151217 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7dcc2640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b78158c90 0x7f7b780708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 -- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640052b0 msgr2=0x7f7b780c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640052b0 0x7f7b780c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 -- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b78158c90 msgr2=0x7f7b780708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b78158c90 0x7f7b780708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 -- 172.21.15.119:0/2907151217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780c5560 con 0x7f7b780c49d0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7ccc0640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 0x7f7b780c6910 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7b680122e0 tx=0x7f7b680127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68014750 con 0x7f7b780c49d0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b680148d0 con 0x7f7b780c49d0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b780c5840 con 0x7f7b780c49d0 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68014cc0 con 0x7f7b780c49d0 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.411+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78159110 con 0x7f7b780c49d0 2023-12-19T16:18:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.415+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b780735b0 con 0x7f7b780c49d0 2023-12-19T16:18:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.415+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7b680153e0 con 0x7f7b780c49d0 2023-12-19T16:18:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.415+0000 7f7b6dffb640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7b5c065a60 0x7f7b5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.415+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7b68085aa0 con 0x7f7b780c49d0 2023-12-19T16:18:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.415+0000 7f7b7d4c1640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7b5c065a60 0x7f7b5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.420 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.415+0000 7f7b7d4c1640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7b5c065a60 0x7f7b5c067f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b78151b20 tx=0x7f7b74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.419+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7b680536c0 con 0x7f7b780c49d0 2023-12-19T16:18:23.572 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.567+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b780c8e10 con 0x7f7b5c065a60 2023-12-19T16:18:23.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b6dffb640 1 -- 172.21.15.119:0/2907151217 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50402 (secure 0 0 0) 0x7f7b74001550 con 0x7f7b5c065a60 2023-12-19T16:18:23.576 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:23.577 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:18:23.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7b5c065a60 msgr2=0x7f7b5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7b5c065a60 0x7f7b5c067f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b78151b20 tx=0x7f7b74009040 comp rx=0 tx=0).stop 2023-12-19T16:18:23.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 msgr2=0x7f7b780c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 0x7f7b780c6910 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7b680122e0 tx=0x7f7b680127a0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 shutdown_connections 2023-12-19T16:18:23.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7b5c065a60 0x7f7b5c067f20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b78158c90 0x7f7b780708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b780c49d0 0x7f7b780c6910 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 --2- 172.21.15.119:0/2907151217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b640052b0 0x7f7b780c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 >> 172.21.15.119:0/2907151217 conn(0x7f7b7806a3e0 msgr2=0x7f7b780af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 shutdown_connections 2023-12-19T16:18:23.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.571+0000 7f7b7f725640 1 -- 172.21.15.119:0/2907151217 wait complete. 2023-12-19T16:18:23.595 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-19T16:18:22.486891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222040,"kb_used_data":6424,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752680,"statfs":{"total":773094113280,"available":772866744320,"internally_reserved":0,"allocated":6578176,"data_stored":3588288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14747,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001185"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T16:17:52.046262+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:17:52.046262+0000","last_peered":"2023-12-19T16:17:52.046262+0000","last_clean":"2023-12-19T16:17:52.046262+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:17:52.046262+0000","last_undegraded":"2023-12-19T16:17:52.046262+0000","last_fullsized":"2023-12-19T16:17:52.046262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1261568,"data_stored":885609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.88400000000000001,"5min":1.05,"15min":1.05},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72099999999999997}]},{"osd":3,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.56799999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.87,"5min":1.006,"15min":1.006},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93999999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98299999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90000000000000002,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96399999999999997,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.79100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71499999999999997,"15min":0.76200000000000001},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81999999999999995,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90100000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.78900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.874,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0469999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.753}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.81399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":679936,"data_stored":302134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.125,"15min":1.125},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1.641,"15min":1.641},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.75900000000000001,"15min":0.80800000000000005},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93700000000000006,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.92700000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.81399999999999995,"15min":0.91800000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66700000000000004,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80000000000000004,"5min":1.135,"15min":1.135},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90200000000000002,"5min":1.74,"15min":1.74},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":696320,"data_stored":317735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81999999999999995,"5min":1.115,"15min":1.115},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":0.997,"15min":0.997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94499999999999995,"5min":1.179,"15min":1.179},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0109999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85899999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.56000000000000005,"15min":0.63200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77400000000000002,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.318},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.78900000000000003,"15min":0.95199999999999996},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.51400000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51400000000000001,"5min":2.577,"15min":2.577},"last":0.443},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.78700000000000003,"15min":0.92700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.59499999999999997,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.85999999999999999,"15min":1.018},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.57899999999999996,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68200000000000005,"5min":2.907,"15min":2.907},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85699999999999998,"15min":0.90300000000000002},"min":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95599999999999996,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.752}]},{"osd":5,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.88500000000000001},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97699999999999998,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95499999999999996,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99299999999999999,"5min":1.708,"15min":1.708},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82799999999999996,"15min":0.872},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95499999999999996,"5min":2.742,"15min":2.742},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49199999999999999,"15min":0.53100000000000003},"min":{"1min":0.255,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71799999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.56399999999999995,"15min":0.61899999999999999},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.34000000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.55200000000000005,"15min":0.60399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57399999999999995,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.497},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60999999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44}]},{"osd":3,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50700000000000001,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63200000000000001,"5min":1.962,"15min":1.962},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":1.974,"15min":1.974},"last":0.46000000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.105,"5min":1.877,"15min":1.877},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.81599999999999995,"15min":0.873},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.82699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0660000000000001,"5min":1.655,"15min":1.655},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81599999999999995,"15min":0.85799999999999998},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0860000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1299999999999999,"5min":2.032,"15min":2.032},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.159,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.872,"15min":0.93600000000000005},"min":{"1min":0.56200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.091,"5min":2.706,"15min":2.706},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.22,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":663552,"data_stored":295171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.434,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.379}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.53900000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48599999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65000000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95899999999999996,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.55300000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.012,"5min":1.502,"15min":1.502},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1479999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":902284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.44500000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81999999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.439},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.46,"15min":1.46},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":1.093,"15min":1.093},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":1.506,"15min":1.506},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.133,"15min":1.133},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.749,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:23.597 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:23.734 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4531241640 1 Processor -- start 2023-12-19T16:18:23.735 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4531241640 1 -- start start 2023-12-19T16:18:23.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4531241640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4531241640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c0c9460 con 0x7f452c0ca000 2023-12-19T16:18:23.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4531241640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c1574a0 con 0x7f452c06c320 2023-12-19T16:18:23.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4531241640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c06c7a0 con 0x7f452c1570c0 2023-12-19T16:18:23.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f452b59e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f452c0ca000 0x7f452c070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38224/0 (socket says 172.21.15.119:38224) 2023-12-19T16:18:23.736 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f452b59e640 1 -- 172.21.15.119:0/290193229 learned_addr learned my addr 172.21.15.119:0/290193229 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:23.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f452ad9d640 1 --2- 172.21.15.119:0/290193229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099255319 0 0) 0x7f452c0c9460 con 0x7f452c0ca000 2023-12-19T16:18:23.737 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4514003530 con 0x7f452c0ca000 2023-12-19T16:18:23.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325404377 0 0) 0x7f452c1574a0 con 0x7f452c06c320 2023-12-19T16:18:23.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f452c0c9460 con 0x7f452c06c320 2023-12-19T16:18:23.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f452ad9d640 1 -- 172.21.15.119:0/290193229 >> v1:172.21.15.143:6789/0 conn(0x7f452c06c320 legacy=0x7f452c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f452ad9d640 1 -- 172.21.15.119:0/290193229 >> v1:172.21.15.119:6789/0 conn(0x7f452c0ca000 legacy=0x7f452c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.738 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.731+0000 7f452ad9d640 1 -- 172.21.15.119:0/290193229 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0c8b30 con 0x7f452c1570c0 2023-12-19T16:18:23.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f452ad9d640 1 --2- 172.21.15.119:0/290193229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c06bde0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f451c0097f0 tx=0x7f451c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a26c9df088425ff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0ab600 con 0x7f452c1570c0 2023-12-19T16:18:23.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c0ab760 con 0x7f452c1570c0 2023-12-19T16:18:23.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4529d9b640 1 -- 172.21.15.119:0/290193229 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0abaf0 con 0x7f452c1570c0 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 -- 172.21.15.119:0/290193229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 msgr2=0x7f452c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 --2- 172.21.15.119:0/290193229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c06bde0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f451c0097f0 tx=0x7f451c01c400 comp rx=0 tx=0).stop 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 -- 172.21.15.119:0/290193229 shutdown_connections 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 --2- 172.21.15.119:0/290193229 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c06bde0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 -- 172.21.15.119:0/290193229 >> 172.21.15.119:0/290193229 conn(0x7f452c06a3e0 msgr2=0x7f452c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 -- 172.21.15.119:0/290193229 shutdown_connections 2023-12-19T16:18:23.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.735+0000 7f4531241640 1 -- 172.21.15.119:0/290193229 wait complete. 2023-12-19T16:18:23.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 Processor -- start 2023-12-19T16:18:23.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 -- start start 2023-12-19T16:18:23.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f452c06c320 0x7f452c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 0x7f452c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0c6e70 con 0x7f452c0ca000 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0c6280 con 0x7f452c06c320 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f4531241640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0cdee0 con 0x7f452c1570c0 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 0x7f452c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 0x7f452c0cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50060/0 (socket says 172.21.15.119:50060) 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 -- 172.21.15.119:0/2719167008 learned_addr learned my addr 172.21.15.119:0/2719167008 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452ad9d640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f452c06c320 0x7f452c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452b59e640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 -- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 msgr2=0x7f452c0cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c0cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 -- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f452c06c320 msgr2=0x7f452c152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f452c06c320 0x7f452c152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.739+0000 7f452a59c640 1 -- 172.21.15.119:0/2719167008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009420 con 0x7f452c0ca000 2023-12-19T16:18:23.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f452a59c640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 0x7f452c0cd460 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f452000c460 tx=0x7f452000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45200052d0 con 0x7f452c0ca000 2023-12-19T16:18:23.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4520005450 con 0x7f452c0ca000 2023-12-19T16:18:23.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520012870 con 0x7f452c0ca000 2023-12-19T16:18:23.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c152eb0 con 0x7f452c0ca000 2023-12-19T16:18:23.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c0c67b0 con 0x7f452c0ca000 2023-12-19T16:18:23.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c0735b0 con 0x7f452c0ca000 2023-12-19T16:18:23.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45200129d0 con 0x7f452c0ca000 2023-12-19T16:18:23.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f45137fe640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4518065a60 0x7f4518067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4520082990 con 0x7f452c0ca000 2023-12-19T16:18:23.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f452ad9d640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4518065a60 0x7f4518067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.743+0000 7f452ad9d640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4518065a60 0x7f4518067f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f451c0af000 tx=0x7f451c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.747+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45200505b0 con 0x7f452c0ca000 2023-12-19T16:18:23.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.899+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f452c0c6fb0 con 0x7f4518065a60 2023-12-19T16:18:23.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.899+0000 7f45137fe640 1 -- 172.21.15.119:0/2719167008 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50402 (secure 0 0 0) 0x7f452c0c6fb0 con 0x7f4518065a60 2023-12-19T16:18:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:23.904 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:18:23.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4518065a60 msgr2=0x7f4518067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4518065a60 0x7f4518067f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f451c0af000 tx=0x7f451c0a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 msgr2=0x7f452c0cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 0x7f452c0cd460 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f452000c460 tx=0x7f452000c920 comp rx=0 tx=0).stop 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 shutdown_connections 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4518065a60 0x7f4518067f20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c1570c0 0x7f452c0cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.906 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f452c0ca000 0x7f452c0cd460 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 --2- 172.21.15.119:0/2719167008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f452c06c320 0x7f452c152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 >> 172.21.15.119:0/2719167008 conn(0x7f452c06a3e0 msgr2=0x7f452c163f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 shutdown_connections 2023-12-19T16:18:23.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:23.903+0000 7f4531241640 1 -- 172.21.15.119:0/2719167008 wait complete. 2023-12-19T16:18:23.925 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-19T16:18:22.486891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222040,"kb_used_data":6424,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752680,"statfs":{"total":773094113280,"available":772866744320,"internally_reserved":0,"allocated":6578176,"data_stored":3588288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14747,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001185"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T16:17:52.046262+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:17:52.046262+0000","last_peered":"2023-12-19T16:17:52.046262+0000","last_clean":"2023-12-19T16:17:52.046262+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:17:52.046262+0000","last_undegraded":"2023-12-19T16:17:52.046262+0000","last_fullsized":"2023-12-19T16:17:52.046262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1261568,"data_stored":885609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.88400000000000001,"5min":1.05,"15min":1.05},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72099999999999997}]},{"osd":3,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.56799999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.87,"5min":1.006,"15min":1.006},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93999999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98299999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90000000000000002,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96399999999999997,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.79100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71499999999999997,"15min":0.76200000000000001},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81999999999999995,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90100000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.78900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.874,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0469999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.753}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.81399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":679936,"data_stored":302134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.125,"15min":1.125},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1.641,"15min":1.641},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.75900000000000001,"15min":0.80800000000000005},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93700000000000006,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.92700000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.81399999999999995,"15min":0.91800000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66700000000000004,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80000000000000004,"5min":1.135,"15min":1.135},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90200000000000002,"5min":1.74,"15min":1.74},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":696320,"data_stored":317735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81999999999999995,"5min":1.115,"15min":1.115},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":0.997,"15min":0.997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94499999999999995,"5min":1.179,"15min":1.179},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0109999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85899999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.56000000000000005,"15min":0.63200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77400000000000002,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.318},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.78900000000000003,"15min":0.95199999999999996},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.51400000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51400000000000001,"5min":2.577,"15min":2.577},"last":0.443},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.78700000000000003,"15min":0.92700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.59499999999999997,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.85999999999999999,"15min":1.018},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.57899999999999996,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68200000000000005,"5min":2.907,"15min":2.907},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85699999999999998,"15min":0.90300000000000002},"min":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95599999999999996,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.752}]},{"osd":5,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.88500000000000001},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97699999999999998,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95499999999999996,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99299999999999999,"5min":1.708,"15min":1.708},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82799999999999996,"15min":0.872},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95499999999999996,"5min":2.742,"15min":2.742},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49199999999999999,"15min":0.53100000000000003},"min":{"1min":0.255,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71799999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.56399999999999995,"15min":0.61899999999999999},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.34000000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.55200000000000005,"15min":0.60399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57399999999999995,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.497},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60999999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44}]},{"osd":3,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50700000000000001,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63200000000000001,"5min":1.962,"15min":1.962},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":1.974,"15min":1.974},"last":0.46000000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.105,"5min":1.877,"15min":1.877},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.81599999999999995,"15min":0.873},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.82699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0660000000000001,"5min":1.655,"15min":1.655},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81599999999999995,"15min":0.85799999999999998},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0860000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1299999999999999,"5min":2.032,"15min":2.032},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.159,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.872,"15min":0.93600000000000005},"min":{"1min":0.56200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.091,"5min":2.706,"15min":2.706},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.22,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":663552,"data_stored":295171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.434,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.379}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.53900000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48599999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65000000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95899999999999996,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.55300000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.012,"5min":1.502,"15min":1.502},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1479999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":902284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.44500000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81999999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.439},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.46,"15min":1.46},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":1.093,"15min":1.093},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":1.506,"15min":1.506},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.133,"15min":1.133},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.749,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:23.927 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T16:18:23.927 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:24.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.059+0000 7fa82282a640 1 Processor -- start 2023-12-19T16:18:24.065 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa82282a640 1 -- start start 2023-12-19T16:18:24.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa82282a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa81c0cea00 0x7fa81c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa82282a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa82282a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c15cb10 con 0x7fa81c15c730 2023-12-19T16:18:24.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa82282a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0b65c0 con 0x7fa81c0cea00 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa82282a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0cd960 con 0x7fa81c0cd3a0 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821828640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa81c15c730 0x7fa81c0b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38228/0 (socket says 172.21.15.119:38228) 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821027640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa81c0cea00 0x7fa81c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821828640 1 -- 172.21.15.119:0/2309053452 learned_addr learned my addr 172.21.15.119:0/2309053452 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa822029640 1 --2- 172.21.15.119:0/2309053452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821027640 1 -- 172.21.15.119:0/2309053452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 msgr2=0x7fa81c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821027640 1 --2- 172.21.15.119:0/2309053452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821027640 1 -- 172.21.15.119:0/2309053452 >> v1:172.21.15.119:6789/0 conn(0x7fa81c15c730 legacy=0x7fa81c0b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa820826640 1 -- 172.21.15.119:0/2309053452 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735285930 0 0) 0x7fa81c15cb10 con 0x7fa81c15c730 2023-12-19T16:18:24.068 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.063+0000 7fa821027640 1 -- 172.21.15.119:0/2309053452 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0cdc40 con 0x7fa81c0cea00 2023-12-19T16:18:24.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa821027640 1 --2- 172.21.15.119:0/2309053452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c0cea00 0x7fa81c0cef60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0097c0 tx=0x7fa80c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4621823d6b82ca0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa820826640 1 -- 172.21.15.119:0/2309053452 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0a8970 con 0x7fa81c0cea00 2023-12-19T16:18:24.070 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa820826640 1 -- 172.21.15.119:0/2309053452 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c0a8ad0 con 0x7fa81c0cea00 2023-12-19T16:18:24.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa820826640 1 -- 172.21.15.119:0/2309053452 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0a8e60 con 0x7fa81c0cea00 2023-12-19T16:18:24.071 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 -- 172.21.15.119:0/2309053452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c0cea00 msgr2=0x7fa81c0cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 --2- 172.21.15.119:0/2309053452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c0cea00 0x7fa81c0cef60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0097c0 tx=0x7fa80c01ec70 comp rx=0 tx=0).stop 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 -- 172.21.15.119:0/2309053452 shutdown_connections 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 --2- 172.21.15.119:0/2309053452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 --2- 172.21.15.119:0/2309053452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c0cea00 0x7fa81c0cef60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 -- 172.21.15.119:0/2309053452 >> 172.21.15.119:0/2309053452 conn(0x7fa81c06b120 msgr2=0x7fa81c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 -- 172.21.15.119:0/2309053452 shutdown_connections 2023-12-19T16:18:24.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 -- 172.21.15.119:0/2309053452 wait complete. 2023-12-19T16:18:24.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.067+0000 7fa82282a640 1 Processor -- start 2023-12-19T16:18:24.073 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- start start 2023-12-19T16:18:24.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa81c0cea00 0x7fa81c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.075 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 0x7fa81c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c6000 con 0x7fa81c15c730 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c62e0 con 0x7fa81c0cea00 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c65c0 con 0x7fa81c0cd3a0 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 0x7fa81c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 0x7fa81c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50078/0 (socket says 172.21.15.119:50078) 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 -- 172.21.15.119:0/2641262856 learned_addr learned my addr 172.21.15.119:0/2641262856 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa821828640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa821027640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa81c0cea00 0x7fa81c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.076 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 -- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 msgr2=0x7fa81c14be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c14be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 -- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa81c0cea00 msgr2=0x7fa81c152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa81c0cea00 0x7fa81c152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 -- 172.21.15.119:0/2641262856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009420 con 0x7fa81c15c730 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa821027640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa81c0cea00 0x7fa81c152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa822029640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 0x7fa81c152560 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa814007e40 tx=0x7fa81400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814014620 con 0x7fa81c15c730 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400ee90 con 0x7fa81c15c730 2023-12-19T16:18:24.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140149e0 con 0x7fa81c15c730 2023-12-19T16:18:24.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c0c68a0 con 0x7fa81c15c730 2023-12-19T16:18:24.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0c70a0 con 0x7fa81c15c730 2023-12-19T16:18:24.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.071+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c0c72c0 con 0x7fa81c15c730 2023-12-19T16:18:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.075+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa814014b40 con 0x7fa81c15c730 2023-12-19T16:18:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.075+0000 7fa8127fc640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa800065a60 0x7fa800067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.075+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa814083960 con 0x7fa81c15c730 2023-12-19T16:18:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.075+0000 7fa821828640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa800065a60 0x7fa800067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.075+0000 7fa821828640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa800065a60 0x7fa800067f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa818007fd0 tx=0x7fa818009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.079+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa8140514d0 con 0x7fa81c15c730 2023-12-19T16:18:24.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.227+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa81c0ce200 con 0x7fa800065a60 2023-12-19T16:18:24.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa8127fc640 1 -- 172.21.15.119:0/2641262856 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50402 (secure 0 0 0) 0x7fa818001cb0 con 0x7fa800065a60 2023-12-19T16:18:24.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:24.235 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:18:24.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa800065a60 msgr2=0x7fa800067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa800065a60 0x7fa800067f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa818007fd0 tx=0x7fa818009040 comp rx=0 tx=0).stop 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 msgr2=0x7fa81c152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 0x7fa81c152560 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa814007e40 tx=0x7fa81400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 shutdown_connections 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa800065a60 0x7fa800067f20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa81c0cea00 0x7fa81c152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81c15c730 0x7fa81c152560 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.237 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 --2- 172.21.15.119:0/2641262856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa81c0cd3a0 0x7fa81c14be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 >> 172.21.15.119:0/2641262856 conn(0x7fa81c06b120 msgr2=0x7fa81c0b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 shutdown_connections 2023-12-19T16:18:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.231+0000 7fa82282a640 1 -- 172.21.15.119:0/2641262856 wait complete. 2023-12-19T16:18:24.255 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-19T16:18:22.486891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222040,"kb_used_data":6424,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752680,"statfs":{"total":773094113280,"available":772866744320,"internally_reserved":0,"allocated":6578176,"data_stored":3588288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14747,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001185"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T16:17:52.046262+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:17:52.046262+0000","last_peered":"2023-12-19T16:17:52.046262+0000","last_clean":"2023-12-19T16:17:52.046262+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:17:52.046262+0000","last_undegraded":"2023-12-19T16:17:52.046262+0000","last_fullsized":"2023-12-19T16:17:52.046262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1261568,"data_stored":885609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.88400000000000001,"5min":1.05,"15min":1.05},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72099999999999997}]},{"osd":3,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.56799999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.87,"5min":1.006,"15min":1.006},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93999999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98299999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90000000000000002,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96399999999999997,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.79100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71499999999999997,"15min":0.76200000000000001},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81999999999999995,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90100000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.78900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.874,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0469999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.753}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.81399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":679936,"data_stored":302134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.125,"15min":1.125},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1.641,"15min":1.641},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.75900000000000001,"15min":0.80800000000000005},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93700000000000006,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.92700000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.81399999999999995,"15min":0.91800000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66700000000000004,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80000000000000004,"5min":1.135,"15min":1.135},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90200000000000002,"5min":1.74,"15min":1.74},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":696320,"data_stored":317735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81999999999999995,"5min":1.115,"15min":1.115},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":0.997,"15min":0.997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94499999999999995,"5min":1.179,"15min":1.179},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0109999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85899999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.56000000000000005,"15min":0.63200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77400000000000002,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.318},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.78900000000000003,"15min":0.95199999999999996},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.51400000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51400000000000001,"5min":2.577,"15min":2.577},"last":0.443},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.78700000000000003,"15min":0.92700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.59499999999999997,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.85999999999999999,"15min":1.018},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.57899999999999996,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68200000000000005,"5min":2.907,"15min":2.907},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85699999999999998,"15min":0.90300000000000002},"min":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95599999999999996,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.752}]},{"osd":5,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.88500000000000001},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97699999999999998,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95499999999999996,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99299999999999999,"5min":1.708,"15min":1.708},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82799999999999996,"15min":0.872},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95499999999999996,"5min":2.742,"15min":2.742},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":667648,"data_stored":295137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49199999999999999,"15min":0.53100000000000003},"min":{"1min":0.255,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71799999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.56399999999999995,"15min":0.61899999999999999},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.34000000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.55200000000000005,"15min":0.60399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57399999999999995,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.497},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60999999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44}]},{"osd":3,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50700000000000001,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63200000000000001,"5min":1.962,"15min":1.962},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":1.974,"15min":1.974},"last":0.46000000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.105,"5min":1.877,"15min":1.877},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.81599999999999995,"15min":0.873},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.82699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0660000000000001,"5min":1.655,"15min":1.655},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81599999999999995,"15min":0.85799999999999998},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0860000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1299999999999999,"5min":2.032,"15min":2.032},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.159,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.872,"15min":0.93600000000000005},"min":{"1min":0.56200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.091,"5min":2.706,"15min":2.706},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.22,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":663552,"data_stored":295171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.434,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.379}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.53900000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48599999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65000000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42699999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95899999999999996,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.55300000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.012,"5min":1.502,"15min":1.502},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1479999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":902284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.44500000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81999999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.439},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.46,"15min":1.46},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":1.093,"15min":1.093},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":1.506,"15min":1.506},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.133,"15min":1.133},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.749,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:24.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:24.395 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 Processor -- start 2023-12-19T16:18:24.396 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 -- start start 2023-12-19T16:18:24.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa44c06bdd0 0x7fa44c0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c0cc970 0x7fa44c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c0ccf90 con 0x7fa44c06c1b0 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c0caa70 con 0x7fa44c06bdd0 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0cd550 con 0x7fa44c0cc970 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.391+0000 7fa44a59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa44c06bdd0 0x7fa44c0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa44c06bdd0 0x7fa44c0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50092/0 (socket says 172.21.15.119:50092) 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 -- 172.21.15.119:0/2242566690 learned_addr learned my addr 172.21.15.119:0/2242566690 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 -- 172.21.15.119:0/2242566690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c0cc970 msgr2=0x7fa44c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:24.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 --2- 172.21.15.119:0/2242566690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c0cc970 0x7fa44c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 -- 172.21.15.119:0/2242566690 >> v1:172.21.15.143:6789/0 conn(0x7fa44c06c1b0 legacy=0x7fa44c0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:24.399 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 -- 172.21.15.119:0/2242566690 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c0cd270 con 0x7fa44c06bdd0 2023-12-19T16:18:24.400 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa44a59c640 1 --2- 172.21.15.119:0/2242566690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06bdd0 0x7fa44c0c45d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009870 tx=0x7fa43c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5856a87be1937f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa449d9b640 1 -- 172.21.15.119:0/2242566690 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0ab600 con 0x7fa44c06bdd0 2023-12-19T16:18:24.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa449d9b640 1 -- 172.21.15.119:0/2242566690 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c0a7050 con 0x7fa44c06bdd0 2023-12-19T16:18:24.401 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.395+0000 7fa449d9b640 1 -- 172.21.15.119:0/2242566690 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0ab980 con 0x7fa44c06bdd0 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- 172.21.15.119:0/2242566690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06bdd0 msgr2=0x7fa44c0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 --2- 172.21.15.119:0/2242566690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06bdd0 0x7fa44c0c45d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009870 tx=0x7fa43c01c500 comp rx=0 tx=0).stop 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- 172.21.15.119:0/2242566690 shutdown_connections 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 --2- 172.21.15.119:0/2242566690 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c0cc970 0x7fa44c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 --2- 172.21.15.119:0/2242566690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06bdd0 0x7fa44c0c45d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- 172.21.15.119:0/2242566690 >> 172.21.15.119:0/2242566690 conn(0x7fa44c0ce130 msgr2=0x7fa44c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- 172.21.15.119:0/2242566690 shutdown_connections 2023-12-19T16:18:24.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- 172.21.15.119:0/2242566690 wait complete. 2023-12-19T16:18:24.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 Processor -- start 2023-12-19T16:18:24.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- start start 2023-12-19T16:18:24.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c06bdd0 0x7fa44c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.404 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 0x7fa44c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa44c0cc970 0x7fa44c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0717d0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c070780 con 0x7fa44c0cc970 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c070a10 con 0x7fa44c06bdd0 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa443fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 0x7fa44c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa443fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 0x7fa44c0c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50104/0 (socket says 172.21.15.119:50104) 2023-12-19T16:18:24.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa443fff640 1 -- 172.21.15.119:0/1471265039 learned_addr learned my addr 172.21.15.119:0/1471265039 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44a59c640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c06bdd0 0x7fa44c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.399+0000 7fa44ad9d640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa44c0cc970 0x7fa44c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa443fff640 1 -- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c06bdd0 msgr2=0x7fa44c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa443fff640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c06bdd0 0x7fa44c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa443fff640 1 -- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa44c0cc970 msgr2=0x7fa44c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa443fff640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa44c0cc970 0x7fa44c0c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa443fff640 1 -- 172.21.15.119:0/1471265039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0094d0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa44ad9d640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa44c0cc970 0x7fa44c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa443fff640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 0x7fa44c0c6290 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c490 tx=0x7fa434001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434003600 con 0x7fa44c06c1b0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434003780 con 0x7fa44c06c1b0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c070cf0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434003b70 con 0x7fa44c06c1b0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c0712b0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c0714d0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa434003cd0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa442ffd640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa42c065a90 0x7fa42c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa4340824e0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.403+0000 7fa44a59c640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa42c065a90 0x7fa42c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.410 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.407+0000 7fa44a59c640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa42c065a90 0x7fa42c067f50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0ad000 tx=0x7fa43c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.412 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.407+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa4340501a0 con 0x7fa44c06c1b0 2023-12-19T16:18:24.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.559+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44c04e850 con 0x7fa44c06c1b0 2023-12-19T16:18:24.565 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa442ffd640 1 -- 172.21.15.119:0/1471265039 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+12773 (secure 0 0 0) 0x7fa434017020 con 0x7fa44c06c1b0 2023-12-19T16:18:24.566 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:24.566 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":58,"fsid":"95401411-8d68-4720-80be-89deeb6bcc32","created":"2023-12-19T16:14:55.361708+0000","modified":"2023-12-19T16:18:21.286965+0000","last_up_change":"2023-12-19T16:15:07.706429+0000","last_in_change":"2023-12-19T16:14:57.930518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:08.508006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d87e8a81-ed71-4e9d-9a48-80b04bc91626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":38164},{"type":"v1","addr":"172.21.15.119:6801","nonce":38164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":38164},{"type":"v1","addr":"172.21.15.119:6803","nonce":38164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":38164},{"type":"v1","addr":"172.21.15.119:6807","nonce":38164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":38164},{"type":"v1","addr":"172.21.15.119:6805","nonce":38164}]},"public_addr":"172.21.15.119:6801/38164","cluster_addr":"172.21.15.119:6803/38164","heartbeat_back_addr":"172.21.15.119:6807/38164","heartbeat_front_addr":"172.21.15.119:6805/38164","state":["exists","up"]},{"osd":1,"uuid":"b5382e82-bcce-4f4c-8fdb-ff6ba0680ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":38165},{"type":"v1","addr":"172.21.15.119:6809","nonce":38165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":38165},{"type":"v1","addr":"172.21.15.119:6811","nonce":38165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":38165},{"type":"v1","addr":"172.21.15.119:6815","nonce":38165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":38165},{"type":"v1","addr":"172.21.15.119:6813","nonce":38165}]},"public_addr":"172.21.15.119:6809/38165","cluster_addr":"172.21.15.119:6811/38165","heartbeat_back_addr":"172.21.15.119:6815/38165","heartbeat_front_addr":"172.21.15.119:6813/38165","state":["exists","up"]},{"osd":2,"uuid":"d56244f0-e0cb-4f13-bad9-e390d0b1c1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":38166},{"type":"v1","addr":"172.21.15.119:6817","nonce":38166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":38166},{"type":"v1","addr":"172.21.15.119:6819","nonce":38166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":38166},{"type":"v1","addr":"172.21.15.119:6823","nonce":38166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":38166},{"type":"v1","addr":"172.21.15.119:6821","nonce":38166}]},"public_addr":"172.21.15.119:6817/38166","cluster_addr":"172.21.15.119:6819/38166","heartbeat_back_addr":"172.21.15.119:6823/38166","heartbeat_front_addr":"172.21.15.119:6821/38166","state":["exists","up"]},{"osd":3,"uuid":"913f0775-152d-4ba8-99f8-b70d1f1a517f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":38170},{"type":"v1","addr":"172.21.15.119:6825","nonce":38170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":38170},{"type":"v1","addr":"172.21.15.119:6827","nonce":38170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":38170},{"type":"v1","addr":"172.21.15.119:6831","nonce":38170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":38170},{"type":"v1","addr":"172.21.15.119:6829","nonce":38170}]},"public_addr":"172.21.15.119:6825/38170","cluster_addr":"172.21.15.119:6827/38170","heartbeat_back_addr":"172.21.15.119:6831/38170","heartbeat_front_addr":"172.21.15.119:6829/38170","state":["exists","up"]},{"osd":4,"uuid":"5430a9b1-c7ec-494b-9cb3-0fc27d85db07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":38338},{"type":"v1","addr":"172.21.15.143:6809","nonce":38338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":38338},{"type":"v1","addr":"172.21.15.143:6814","nonce":38338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":38338},{"type":"v1","addr":"172.21.15.143:6827","nonce":38338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6817","nonce":38338},{"type":"v1","addr":"172.21.15.143:6821","nonce":38338}]},"public_addr":"172.21.15.143:6809/38338","cluster_addr":"172.21.15.143:6814/38338","heartbeat_back_addr":"172.21.15.143:6827/38338","heartbeat_front_addr":"172.21.15.143:6821/38338","state":["exists","up"]},{"osd":5,"uuid":"9556f02e-3b66-4f13-8a57-053dcd7dda7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":38339},{"type":"v1","addr":"172.21.15.143:6806","nonce":38339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":38339},{"type":"v1","addr":"172.21.15.143:6813","nonce":38339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":38339},{"type":"v1","addr":"172.21.15.143:6823","nonce":38339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":38339},{"type":"v1","addr":"172.21.15.143:6818","nonce":38339}]},"public_addr":"172.21.15.143:6806/38339","cluster_addr":"172.21.15.143:6813/38339","heartbeat_back_addr":"172.21.15.143:6823/38339","heartbeat_front_addr":"172.21.15.143:6818/38339","state":["exists","up"]},{"osd":6,"uuid":"9b549fb1-77f3-4d4c-983e-581ded595cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":38347},{"type":"v1","addr":"172.21.15.143:6822","nonce":38347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6825","nonce":38347},{"type":"v1","addr":"172.21.15.143:6826","nonce":38347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":38347},{"type":"v1","addr":"172.21.15.143:6831","nonce":38347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":38347},{"type":"v1","addr":"172.21.15.143:6829","nonce":38347}]},"public_addr":"172.21.15.143:6822/38347","cluster_addr":"172.21.15.143:6826/38347","heartbeat_back_addr":"172.21.15.143:6831/38347","heartbeat_front_addr":"172.21.15.143:6829/38347","state":["exists","up"]},{"osd":7,"uuid":"5f43eba7-83f0-47d5-b3bd-1500df1ffdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":38348},{"type":"v1","addr":"172.21.15.143:6801","nonce":38348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":38348},{"type":"v1","addr":"172.21.15.143:6803","nonce":38348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6811","nonce":38348},{"type":"v1","addr":"172.21.15.143:6815","nonce":38348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6805","nonce":38348},{"type":"v1","addr":"172.21.15.143:6808","nonce":38348}]},"public_addr":"172.21.15.143:6801/38348","cluster_addr":"172.21.15.143:6803/38348","heartbeat_back_addr":"172.21.15.143:6815/38348","heartbeat_front_addr":"172.21.15.143:6808/38348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.423529+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.599096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669081+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.620824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.669722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.489072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.673858+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:03.604192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6836/2766727867":"2023-12-20T16:18:17.997769+0000","172.21.15.119:6834/2766727867":"2023-12-20T16:18:17.997769+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa42c065a90 msgr2=0x7fa42c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa42c065a90 0x7fa42c067f50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0ad000 tx=0x7fa43c0a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 msgr2=0x7fa44c0c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 0x7fa44c0c6290 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c490 tx=0x7fa434001e80 comp rx=0 tx=0).stop 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 shutdown_connections 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fa42c065a90 0x7fa42c067f50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa44c0cc970 0x7fa44c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa44c06c1b0 0x7fa44c0c6290 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 --2- 172.21.15.119:0/1471265039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa44c06bdd0 0x7fa44c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 >> 172.21.15.119:0/1471265039 conn(0x7fa44c0ce130 msgr2=0x7fa44c14db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 shutdown_connections 2023-12-19T16:18:24.569 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:24.563+0000 7fa44b59e640 1 -- 172.21.15.119:0/1471265039 wait complete. 2023-12-19T16:18:25.587 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T16:18:25.588 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.735+0000 7f492c8d0640 1 Processor -- start 2023-12-19T16:18:25.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.735+0000 7f492c8d0640 1 -- start start 2023-12-19T16:18:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492c8d0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f492815ff00 0x7f49280d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492c8d0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f49280d11a0 0x7f4928160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492c8d0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4928160ac0 0x7f49280cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492c8d0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49280cce60 con 0x7f4928160ac0 2023-12-19T16:18:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492c8d0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49281602e0 con 0x7f49280d11a0 2023-12-19T16:18:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492c8d0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4928161390 con 0x7f492815ff00 2023-12-19T16:18:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4928160ac0 0x7f49280cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4928160ac0 0x7f49280cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50116/0 (socket says 172.21.15.119:50116) 2023-12-19T16:18:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 -- 172.21.15.119:0/1892042749 learned_addr learned my addr 172.21.15.119:0/1892042749 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492659c640 1 --2- 172.21.15.119:0/1892042749 >> v2:172.21.15.143:3300/0 conn(0x7f49280d11a0 0x7f4928160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f4926d9d640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f492815ff00 0x7f49280d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 -- 172.21.15.119:0/1892042749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f492815ff00 msgr2=0x7f49280d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f492815ff00 0x7f49280d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 -- 172.21.15.119:0/1892042749 >> v2:172.21.15.143:3300/0 conn(0x7f49280d11a0 msgr2=0x7f4928160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 --2- 172.21.15.119:0/1892042749 >> v2:172.21.15.143:3300/0 conn(0x7f49280d11a0 0x7f4928160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 -- 172.21.15.119:0/1892042749 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492806c690 con 0x7f4928160ac0 2023-12-19T16:18:25.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f4926d9d640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f492815ff00 0x7f49280d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.739+0000 7f492759e640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4928160ac0 0x7f49280cda00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f492808a500 tx=0x7f492001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ee3d5c7e4563a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f4925d9b640 1 -- 172.21.15.119:0/1892042749 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200af400 con 0x7f4928160ac0 2023-12-19T16:18:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f4925d9b640 1 -- 172.21.15.119:0/1892042749 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49200ab050 con 0x7f4928160ac0 2023-12-19T16:18:25.747 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f4925d9b640 1 -- 172.21.15.119:0/1892042749 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200af780 con 0x7f4928160ac0 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- 172.21.15.119:0/1892042749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4928160ac0 msgr2=0x7f49280cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4928160ac0 0x7f49280cda00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f492808a500 tx=0x7f492001f1c0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- 172.21.15.119:0/1892042749 shutdown_connections 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4928160ac0 0x7f49280cda00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- 172.21.15.119:0/1892042749 >> v2:172.21.15.143:3300/0 conn(0x7f49280d11a0 0x7f4928160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- 172.21.15.119:0/1892042749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f492815ff00 0x7f49280d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- 172.21.15.119:0/1892042749 >> 172.21.15.119:0/1892042749 conn(0x7f492809b950 msgr2=0x7f49280d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- 172.21.15.119:0/1892042749 shutdown_connections 2023-12-19T16:18:25.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- 172.21.15.119:0/1892042749 wait complete. 2023-12-19T16:18:25.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 Processor -- start 2023-12-19T16:18:25.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- start start 2023-12-19T16:18:25.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49280d11a0 0x7f49280c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f492815ff00 0x7f49280c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4928160ac0 0x7f49280cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492815b1a0 con 0x7f492815ff00 2023-12-19T16:18:25.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280c93e0 con 0x7f49280d11a0 2023-12-19T16:18:25.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.743+0000 7f492c8d0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49280c9f50 con 0x7f4928160ac0 2023-12-19T16:18:25.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f492815ff00 0x7f49280c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f4926d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49280d11a0 0x7f49280c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f492815ff00 0x7f49280c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50122/0 (socket says 172.21.15.119:50122) 2023-12-19T16:18:25.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 -- 172.21.15.119:0/3502205567 learned_addr learned my addr 172.21.15.119:0/3502205567 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:25.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492759e640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4928160ac0 0x7f49280cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 -- 172.21.15.119:0/3502205567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4928160ac0 msgr2=0x7f49280cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4928160ac0 0x7f49280cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 -- 172.21.15.119:0/3502205567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49280d11a0 msgr2=0x7f49280c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49280d11a0 0x7f49280c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 -- 172.21.15.119:0/3502205567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920009b30 con 0x7f492815ff00 2023-12-19T16:18:25.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f4926d9d640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49280d11a0 0x7f49280c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:25.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492659c640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f492815ff00 0x7f49280c8ea0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f491c00e880 tx=0x7f491c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00c940 con 0x7f492815ff00 2023-12-19T16:18:25.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00caa0 con 0x7f492815ff00 2023-12-19T16:18:25.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00ce10 con 0x7f492815ff00 2023-12-19T16:18:25.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49280ca1a0 con 0x7f492815ff00 2023-12-19T16:18:25.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49281f5650 con 0x7f492815ff00 2023-12-19T16:18:25.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f492806cc50 con 0x7f492815ff00 2023-12-19T16:18:25.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.747+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f491c013470 con 0x7f492815ff00 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f490f7fe640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4914065a60 0x7f4914067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f491c083510 con 0x7f492815ff00 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f4926d9d640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4914065a60 0x7f4914067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f490f7fe640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7f491406bd60 0x7f491406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 --> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f491406e870 con 0x7f491406bd60 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f491c083880 con 0x7f492815ff00 2023-12-19T16:18:25.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f492759e640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7f491406bd60 0x7f491406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f4926d9d640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4914065a60 0x7f4914067f20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4918009d40 tx=0x7f4918008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f492759e640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7f491406bd60 0x7f491406e1a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.751+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== osd.0 v2:172.21.15.119:6800/38164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f491406e870 con 0x7f491406bd60 2023-12-19T16:18:25.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 --> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f492815f7e0 con 0x7f491406bd60 2023-12-19T16:18:25.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f490f7fe640 1 -- 172.21.15.119:0/3502205567 <== osd.0 v2:172.21.15.119:6800/38164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f492815f7e0 con 0x7f491406bd60 2023-12-19T16:18:25.768 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:25.769 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:25.769 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:25.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7f491406bd60 msgr2=0x7f491406e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6800/38164,v1:172.21.15.119:6801/38164] conn(0x7f491406bd60 0x7f491406e1a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4914065a60 msgr2=0x7f4914067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f4914065a60 0x7f4914067f20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4918009d40 tx=0x7f4918008040 comp rx=0 tx=0).stop 2023-12-19T16:18:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f492815ff00 msgr2=0x7f49280c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 --2- 172.21.15.119:0/3502205567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f492815ff00 0x7f49280c8ea0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f491c00e880 tx=0x7f491c00ed40 comp rx=0 tx=0).stop 2023-12-19T16:18:25.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492759e640 1 -- 172.21.15.119:0/3502205567 reap_dead start 2023-12-19T16:18:25.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 shutdown_connections 2023-12-19T16:18:25.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 >> 172.21.15.119:0/3502205567 conn(0x7f492809b950 msgr2=0x7f49280d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 shutdown_connections 2023-12-19T16:18:25.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.763+0000 7f492c8d0640 1 -- 172.21.15.119:0/3502205567 wait complete. 2023-12-19T16:18:25.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T16:18:25.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 Processor -- start 2023-12-19T16:18:25.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 -- start start 2023-12-19T16:18:25.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a6c0cefe0 0x7f6a6c0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c15d2d0 0x7f6a6c15d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c15cf10 con 0x7f6a6c15cb30 2023-12-19T16:18:25.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c15e000 con 0x7f6a6c0cefe0 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a71666640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0cf960 con 0x7f6a6c15d2d0 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a6c0cefe0 0x7f6a6c0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a6c0cefe0 0x7f6a6c0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50134/0 (socket says 172.21.15.119:50134) 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a6affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6a6c15cb30 0x7f6a6c06bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38238/0 (socket says 172.21.15.119:38238) 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 -- 172.21.15.119:0/3869325528 learned_addr learned my addr 172.21.15.119:0/3869325528 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a6b7fe640 1 --2- 172.21.15.119:0/3869325528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c15d2d0 0x7f6a6c15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 -- 172.21.15.119:0/3869325528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c15d2d0 msgr2=0x7f6a6c15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 --2- 172.21.15.119:0/3869325528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c15d2d0 0x7f6a6c15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 -- 172.21.15.119:0/3869325528 >> v1:172.21.15.119:6789/0 conn(0x7f6a6c15cb30 legacy=0x7f6a6c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a627fc640 1 -- 172.21.15.119:0/3869325528 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c06ae40 con 0x7f6a6c0cefe0 2023-12-19T16:18:25.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.923+0000 7f6a6a7fc640 1 -- 172.21.15.119:0/3869325528 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494024886 0 0) 0x7f6a6c15cf10 con 0x7f6a6c15cb30 2023-12-19T16:18:25.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a627fc640 1 --2- 172.21.15.119:0/3869325528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c0cefe0 0x7f6a6c0cf420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009870 tx=0x7f6a5401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c944afd053d5a110 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a6a7fc640 1 -- 172.21.15.119:0/3869325528 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540aa670 con 0x7f6a6c0cefe0 2023-12-19T16:18:25.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a6a7fc640 1 -- 172.21.15.119:0/3869325528 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a540aa7d0 con 0x7f6a6c0cefe0 2023-12-19T16:18:25.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a6a7fc640 1 -- 172.21.15.119:0/3869325528 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540aab60 con 0x7f6a6c0cefe0 2023-12-19T16:18:25.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 -- 172.21.15.119:0/3869325528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c0cefe0 msgr2=0x7f6a6c0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 --2- 172.21.15.119:0/3869325528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c0cefe0 0x7f6a6c0cf420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009870 tx=0x7f6a5401c510 comp rx=0 tx=0).stop 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 -- 172.21.15.119:0/3869325528 shutdown_connections 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 --2- 172.21.15.119:0/3869325528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c15d2d0 0x7f6a6c15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 --2- 172.21.15.119:0/3869325528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c0cefe0 0x7f6a6c0cf420 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 -- 172.21.15.119:0/3869325528 >> 172.21.15.119:0/3869325528 conn(0x7f6a6c089fb0 msgr2=0x7f6a6c09b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 -- 172.21.15.119:0/3869325528 shutdown_connections 2023-12-19T16:18:25.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.927+0000 7f6a71666640 1 -- 172.21.15.119:0/3869325528 wait complete. 2023-12-19T16:18:25.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 Processor -- start 2023-12-19T16:18:25.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 -- start start 2023-12-19T16:18:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c0cefe0 0x7f6a6c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 0x7f6a6c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6c15d2d0 0x7f6a6c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c14f990 con 0x7f6a6c15cb30 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c1567b0 con 0x7f6a6c15d2d0 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c14ed80 con 0x7f6a6c0cefe0 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 0x7f6a6c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 0x7f6a6c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50144/0 (socket says 172.21.15.119:50144) 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 -- 172.21.15.119:0/4284425503 learned_addr learned my addr 172.21.15.119:0/4284425503 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:25.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a6affd640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c0cefe0 0x7f6a6c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a6b7fe640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6c15d2d0 0x7f6a6c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 -- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c0cefe0 msgr2=0x7f6a6c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c0cefe0 0x7f6a6c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 -- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6c15d2d0 msgr2=0x7f6a6c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6c15d2d0 0x7f6a6c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.937 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 -- 172.21.15.119:0/4284425503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540094d0 con 0x7f6a6c15cb30 2023-12-19T16:18:25.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a627fc640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 0x7f6a6c0cbc30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6a540ac040 tx=0x7f6a5401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540aad50 con 0x7f6a6c15cb30 2023-12-19T16:18:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a540b7070 con 0x7f6a6c15cb30 2023-12-19T16:18:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004220 con 0x7f6a6c15cb30 2023-12-19T16:18:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c14f060 con 0x7f6a6c15cb30 2023-12-19T16:18:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.931+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c14f620 con 0x7f6a6c15cb30 2023-12-19T16:18:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.935+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c06a7c0 con 0x7f6a6c15cb30 2023-12-19T16:18:25.939 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.935+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a54004380 con 0x7f6a6c15cb30 2023-12-19T16:18:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.935+0000 7f6a63fff640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a4c065a60 0x7f6a4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.935+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6a5411cf40 con 0x7f6a6c15cb30 2023-12-19T16:18:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.935+0000 7f6a6affd640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a4c065a60 0x7f6a4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.940 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.935+0000 7f6a6affd640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a4c065a60 0x7f6a4c067f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001030 tx=0x7f6a5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.945 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:25.939+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6a540ea9c0 con 0x7f6a6c15cb30 2023-12-19T16:18:26.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.087+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a6c06b6e0 con 0x7f6a4c065a60 2023-12-19T16:18:26.094 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a63fff640 1 -- 172.21.15.119:0/4284425503 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a5c001500 con 0x7f6a4c065a60 2023-12-19T16:18:26.094 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T16:18:26.095 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a4c065a60 msgr2=0x7f6a4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.095 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a4c065a60 0x7f6a4c067f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001030 tx=0x7f6a5c009040 comp rx=0 tx=0).stop 2023-12-19T16:18:26.095 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 msgr2=0x7f6a6c0cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 0x7f6a6c0cbc30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6a540ac040 tx=0x7f6a5401ad50 comp rx=0 tx=0).stop 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 shutdown_connections 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f6a4c065a60 0x7f6a4c067f20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6c15d2d0 0x7f6a6c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a6c15cb30 0x7f6a6c0cbc30 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 --2- 172.21.15.119:0/4284425503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6c0cefe0 0x7f6a6c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 >> 172.21.15.119:0/4284425503 conn(0x7f6a6c089fb0 msgr2=0x7f6a6c0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 shutdown_connections 2023-12-19T16:18:26.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.091+0000 7f6a71666640 1 -- 172.21.15.119:0/4284425503 wait complete. 2023-12-19T16:18:26.114 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T16:18:26.114 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:26.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 Processor -- start 2023-12-19T16:18:26.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 -- start start 2023-12-19T16:18:26.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f02340ce5d0 0x7f02340ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f023406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02340b28a0 con 0x7f023415e2d0 2023-12-19T16:18:26.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340ac1a0 con 0x7f02340ce5d0 2023-12-19T16:18:26.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.251+0000 7f023b266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02340ceef0 con 0x7f023406d440 2023-12-19T16:18:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239803640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f023415e2d0 0x7f023415e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38248/0 (socket says 172.21.15.119:38248) 2023-12-19T16:18:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239803640 1 -- 172.21.15.119:0/1891877243 learned_addr learned my addr 172.21.15.119:0/1891877243 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239002640 1 --2- 172.21.15.119:0/1891877243 >> v2:172.21.15.119:3300/0 conn(0x7f02340ce5d0 0x7f02340ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0238801640 1 --2- 172.21.15.119:0/1891877243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f023406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239002640 1 -- 172.21.15.119:0/1891877243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 msgr2=0x7f023406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239002640 1 --2- 172.21.15.119:0/1891877243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f023406d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239002640 1 -- 172.21.15.119:0/1891877243 >> v1:172.21.15.119:6789/0 conn(0x7f023415e2d0 legacy=0x7f023415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239002640 1 -- 172.21.15.119:0/1891877243 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023415ab30 con 0x7f02340ce5d0 2023-12-19T16:18:26.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f022bfff640 1 -- 172.21.15.119:0/1891877243 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996658939 0 0) 0x7f02340b28a0 con 0x7f023415e2d0 2023-12-19T16:18:26.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f0239002640 1 --2- 172.21.15.119:0/1891877243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f02340ce9b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f02300097c0 tx=0x7f023001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eaaf4ef58c65a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f022bfff640 1 -- 172.21.15.119:0/1891877243 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300ab650 con 0x7f02340ce5d0 2023-12-19T16:18:26.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f022bfff640 1 -- 172.21.15.119:0/1891877243 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300ab7b0 con 0x7f02340ce5d0 2023-12-19T16:18:26.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.255+0000 7f022bfff640 1 -- 172.21.15.119:0/1891877243 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300abb40 con 0x7f02340ce5d0 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- 172.21.15.119:0/1891877243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 msgr2=0x7f02340ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 --2- 172.21.15.119:0/1891877243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f02340ce9b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f02300097c0 tx=0x7f023001c450 comp rx=0 tx=0).stop 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- 172.21.15.119:0/1891877243 shutdown_connections 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 --2- 172.21.15.119:0/1891877243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f023406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 --2- 172.21.15.119:0/1891877243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f02340ce9b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- 172.21.15.119:0/1891877243 >> 172.21.15.119:0/1891877243 conn(0x7f0234069e70 msgr2=0x7f023406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- 172.21.15.119:0/1891877243 shutdown_connections 2023-12-19T16:18:26.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- 172.21.15.119:0/1891877243 wait complete. 2023-12-19T16:18:26.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 Processor -- start 2023-12-19T16:18:26.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- start start 2023-12-19T16:18:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f02341538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f0234159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f023415e2d0 0x7f023415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234154490 con 0x7f02340ce5d0 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02340c5980 con 0x7f023415e2d0 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f023b266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0234153ed0 con 0x7f023406d440 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f0238801640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f0234159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f0238801640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f0234159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50168/0 (socket says 172.21.15.119:50168) 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f0238801640 1 -- 172.21.15.119:0/2661280990 learned_addr learned my addr 172.21.15.119:0/2661280990 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f0239002640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f02341538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.259+0000 7f0239803640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f023415e2d0 0x7f023415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0238801640 1 -- 172.21.15.119:0/2661280990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 msgr2=0x7f02341538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0238801640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f023406d440 0x7f02341538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0238801640 1 -- 172.21.15.119:0/2661280990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f023415e2d0 msgr2=0x7f023415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0238801640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f023415e2d0 0x7f023415a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0238801640 1 -- 172.21.15.119:0/2661280990 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009420 con 0x7f02340ce5d0 2023-12-19T16:18:26.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0238801640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f0234159d00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f022400e870 tx=0x7f022400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224009510 con 0x7f02340ce5d0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022400eec0 con 0x7f02340ce5d0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400cb40 con 0x7f02340ce5d0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02341541b0 con 0x7f02340ce5d0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0234152a20 con 0x7f02340ce5d0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02340b2530 con 0x7f02340ce5d0 2023-12-19T16:18:26.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f022400ccc0 con 0x7f02340ce5d0 2023-12-19T16:18:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.263+0000 7f0229ffb640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0224082fe0 con 0x7f02340ce5d0 2023-12-19T16:18:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0239002640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0229ffb640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7f021806bd60 0x7f021806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 --> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f021806e870 con 0x7f021806bd60 2023-12-19T16:18:26.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02240856a0 con 0x7f02340ce5d0 2023-12-19T16:18:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0239803640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7f021806bd60 0x7f021806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0239002640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f02300af000 tx=0x7f02300a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0239803640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7f021806bd60 0x7f021806e1a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.267+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== osd.1 v2:172.21.15.119:6808/38165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f021806e870 con 0x7f021806bd60 2023-12-19T16:18:26.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 --> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02340b2250 con 0x7f021806bd60 2023-12-19T16:18:26.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f0229ffb640 1 -- 172.21.15.119:0/2661280990 <== osd.1 v2:172.21.15.119:6808/38165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f022c004df0 con 0x7f021806bd60 2023-12-19T16:18:26.283 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7f021806bd60 msgr2=0x7f021806e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6808/38165,v1:172.21.15.119:6809/38165] conn(0x7f021806bd60 0x7f021806e1a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 msgr2=0x7f0218067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f0218065a60 0x7f0218067f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f02300af000 tx=0x7f02300a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 msgr2=0x7f0234159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 --2- 172.21.15.119:0/2661280990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02340ce5d0 0x7f0234159d00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f022400e870 tx=0x7f022400ec70 comp rx=0 tx=0).stop 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f0239803640 1 -- 172.21.15.119:0/2661280990 reap_dead start 2023-12-19T16:18:26.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 shutdown_connections 2023-12-19T16:18:26.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 >> 172.21.15.119:0/2661280990 conn(0x7f0234069e70 msgr2=0x7f023406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 shutdown_connections 2023-12-19T16:18:26.286 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.279+0000 7f023b266640 1 -- 172.21.15.119:0/2661280990 wait complete. 2023-12-19T16:18:26.302 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T16:18:26.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 Processor -- start 2023-12-19T16:18:26.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 -- start start 2023-12-19T16:18:26.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba4815a680 0x7fba4815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba480cac10 0x7fba4815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4815f100 con 0x7fba4815afa0 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba480ca7d0 con 0x7fba480cac10 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba4e96d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4815e860 con 0x7fba4815a680 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba480cac10 0x7fba4815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba480cac10 0x7fba4815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50178/0 (socket says 172.21.15.119:50178) 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 -- 172.21.15.119:0/3338884230 learned_addr learned my addr 172.21.15.119:0/3338884230 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba47fff640 1 --2- 172.21.15.119:0/3338884230 >> v2:172.21.15.143:3300/0 conn(0x7fba4815a680 0x7fba4815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 -- 172.21.15.119:0/3338884230 >> v2:172.21.15.143:3300/0 conn(0x7fba4815a680 msgr2=0x7fba4815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 --2- 172.21.15.119:0/3338884230 >> v2:172.21.15.143:3300/0 conn(0x7fba4815a680 0x7fba4815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 -- 172.21.15.119:0/3338884230 >> v1:172.21.15.143:6789/0 conn(0x7fba4815afa0 legacy=0x7fba4806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.438+0000 7fba477fe640 1 -- 172.21.15.119:0/3338884230 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4815eb40 con 0x7fba480cac10 2023-12-19T16:18:26.446 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba477fe640 1 --2- 172.21.15.119:0/3338884230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba480cac10 0x7fba4815aa60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009870 tx=0x7fba3c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e110413e602d0de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba46ffd640 1 -- 172.21.15.119:0/3338884230 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0ad680 con 0x7fba480cac10 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba46ffd640 1 -- 172.21.15.119:0/3338884230 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c0ad7e0 con 0x7fba480cac10 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba46ffd640 1 -- 172.21.15.119:0/3338884230 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0adb70 con 0x7fba480cac10 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 -- 172.21.15.119:0/3338884230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba480cac10 msgr2=0x7fba4815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 --2- 172.21.15.119:0/3338884230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba480cac10 0x7fba4815aa60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009870 tx=0x7fba3c01c470 comp rx=0 tx=0).stop 2023-12-19T16:18:26.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 -- 172.21.15.119:0/3338884230 shutdown_connections 2023-12-19T16:18:26.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 --2- 172.21.15.119:0/3338884230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba480cac10 0x7fba4815aa60 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.448 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 --2- 172.21.15.119:0/3338884230 >> v2:172.21.15.143:3300/0 conn(0x7fba4815a680 0x7fba4815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 -- 172.21.15.119:0/3338884230 >> 172.21.15.119:0/3338884230 conn(0x7fba4806a3e0 msgr2=0x7fba480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 -- 172.21.15.119:0/3338884230 shutdown_connections 2023-12-19T16:18:26.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.442+0000 7fba4e96d640 1 -- 172.21.15.119:0/3338884230 wait complete. 2023-12-19T16:18:26.449 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 Processor -- start 2023-12-19T16:18:26.450 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- start start 2023-12-19T16:18:26.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba480cac10 0x7fba48153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.451 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4815a680 0x7fba48154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 0x7fba480cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba48154360 con 0x7fba4815afa0 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480cc990 con 0x7fba4815a680 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba48154d70 con 0x7fba480cac10 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 0x7fba480cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba47fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba480cac10 0x7fba48153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 0x7fba480cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50188/0 (socket says 172.21.15.119:50188) 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 -- 172.21.15.119:0/2392832508 learned_addr learned my addr 172.21.15.119:0/2392832508 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba47fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba480cac10 0x7fba48153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:49622/0 (socket says 172.21.15.119:49622) 2023-12-19T16:18:26.452 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba477fe640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4815a680 0x7fba48154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 -- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba480cac10 msgr2=0x7fba48153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba480cac10 0x7fba48153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 -- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4815a680 msgr2=0x7fba48154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4815a680 0x7fba48154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 -- 172.21.15.119:0/2392832508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0094d0 con 0x7fba4815afa0 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba477fe640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4815a680 0x7fba48154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:26.453 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4cf0a640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 0x7fba480cce20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c790 tx=0x7fba4000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4000cea0 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba40003b80 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba480cd360 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4000a7f0 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba480cc340 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.446+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba480735b0 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.450+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba4000a950 con 0x7fba4815afa0 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.450+0000 7fba44ff9640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba34065a60 0x7fba34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.455 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.450+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fba40082b40 con 0x7fba4815afa0 2023-12-19T16:18:26.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.450+0000 7fba47fff640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba34065a60 0x7fba34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.456 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.450+0000 7fba47fff640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba34065a60 0x7fba34067f20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba48155010 tx=0x7fba38009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.459 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.454+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba40050800 con 0x7fba4815afa0 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.606+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fba480704c0 con 0x7fba34065a60 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.606+0000 7fba44ff9640 1 -- 172.21.15.119:0/2392832508 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fba38011a60 con 0x7fba34065a60 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.606+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba34065a60 msgr2=0x7fba34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.606+0000 7fba4e96d640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba34065a60 0x7fba34067f20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba48155010 tx=0x7fba38009190 comp rx=0 tx=0).stop 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.606+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 msgr2=0x7fba480cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.606+0000 7fba4e96d640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 0x7fba480cce20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c790 tx=0x7fba4000cc50 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 shutdown_connections 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fba34065a60 0x7fba34067f20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4815a680 0x7fba48154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba4815afa0 0x7fba480cce20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 --2- 172.21.15.119:0/2392832508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba480cac10 0x7fba48153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 >> 172.21.15.119:0/2392832508 conn(0x7fba4806a3e0 msgr2=0x7fba480af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 shutdown_connections 2023-12-19T16:18:26.615 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.610+0000 7fba4e96d640 1 -- 172.21.15.119:0/2392832508 wait complete. 2023-12-19T16:18:26.633 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T16:18:26.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 Processor -- start 2023-12-19T16:18:26.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 -- start start 2023-12-19T16:18:26.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f910015c710 0x7f91000ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f910006b3c0 0x7f91000c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91000ca9f0 con 0x7f91000714c0 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91000c3b40 con 0x7f910015c710 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f910548c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91000cacd0 con 0x7f910006b3c0 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f910015c710 0x7f91000ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f910015c710 0x7f91000ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50198/0 (socket says 172.21.15.119:50198) 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 -- 172.21.15.119:0/1101359893 learned_addr learned my addr 172.21.15.119:0/1101359893 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90ff7fe640 1 --2- 172.21.15.119:0/1101359893 >> v2:172.21.15.143:3300/0 conn(0x7f910006b3c0 0x7f91000c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 -- 172.21.15.119:0/1101359893 >> v2:172.21.15.143:3300/0 conn(0x7f910006b3c0 msgr2=0x7f91000c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 --2- 172.21.15.119:0/1101359893 >> v2:172.21.15.143:3300/0 conn(0x7f910006b3c0 0x7f91000c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 -- 172.21.15.119:0/1101359893 >> v1:172.21.15.143:6789/0 conn(0x7f91000714c0 legacy=0x7f910006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90feffd640 1 -- 172.21.15.119:0/1101359893 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000cafb0 con 0x7f910015c710 2023-12-19T16:18:26.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.774+0000 7f90ff7fe640 1 --2- 172.21.15.119:0/1101359893 >> v2:172.21.15.143:3300/0 conn(0x7f910006b3c0 0x7f91000c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:26.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f90feffd640 1 --2- 172.21.15.119:0/1101359893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f91000ca0f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f91000ce7e0 tx=0x7f90f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e37fa01e11eb1d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f90fe7fc640 1 -- 172.21.15.119:0/1101359893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00ab610 con 0x7f910015c710 2023-12-19T16:18:26.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f90fe7fc640 1 -- 172.21.15.119:0/1101359893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f00ab770 con 0x7f910015c710 2023-12-19T16:18:26.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f90fe7fc640 1 -- 172.21.15.119:0/1101359893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00abb00 con 0x7f910015c710 2023-12-19T16:18:26.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 -- 172.21.15.119:0/1101359893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 msgr2=0x7f91000ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 --2- 172.21.15.119:0/1101359893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f91000ca0f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f91000ce7e0 tx=0x7f90f001c500 comp rx=0 tx=0).stop 2023-12-19T16:18:26.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 -- 172.21.15.119:0/1101359893 shutdown_connections 2023-12-19T16:18:26.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 --2- 172.21.15.119:0/1101359893 >> v2:172.21.15.143:3300/0 conn(0x7f910006b3c0 0x7f91000c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 --2- 172.21.15.119:0/1101359893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f91000ca0f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 -- 172.21.15.119:0/1101359893 >> 172.21.15.119:0/1101359893 conn(0x7f9100070530 msgr2=0x7f9100070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 -- 172.21.15.119:0/1101359893 shutdown_connections 2023-12-19T16:18:26.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 -- 172.21.15.119:0/1101359893 wait complete. 2023-12-19T16:18:26.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 Processor -- start 2023-12-19T16:18:26.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.778+0000 7f910548c640 1 -- start start 2023-12-19T16:18:26.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f910006b3c0 0x7f91000c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91000714c0 0x7f9100159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f9100151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91001521e0 con 0x7f910015c710 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9100156200 con 0x7f91000714c0 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91001526c0 con 0x7f910006b3c0 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f9100151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90f7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91000714c0 0x7f9100159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90f7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91000714c0 0x7f9100159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:58796/0 (socket says 172.21.15.119:58796) 2023-12-19T16:18:26.788 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90f7fff640 1 -- 172.21.15.119:0/101676910 learned_addr learned my addr 172.21.15.119:0/101676910 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f9100151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50202/0 (socket says 172.21.15.119:50202) 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90feffd640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f910006b3c0 0x7f91000c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 -- 172.21.15.119:0/101676910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f910006b3c0 msgr2=0x7f91000c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f910006b3c0 0x7f91000c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 -- 172.21.15.119:0/101676910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91000714c0 msgr2=0x7f9100159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91000714c0 0x7f9100159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 -- 172.21.15.119:0/101676910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00094d0 con 0x7f910015c710 2023-12-19T16:18:26.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90ff7fe640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f9100151ca0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f90f8007e60 tx=0x7f90f800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f80039a0 con 0x7f910015c710 2023-12-19T16:18:26.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f800f040 con 0x7f910015c710 2023-12-19T16:18:26.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9100156450 con 0x7f910015c710 2023-12-19T16:18:26.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8003d20 con 0x7f910015c710 2023-12-19T16:18:26.790 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9100156a10 con 0x7f910015c710 2023-12-19T16:18:26.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.782+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f910004e000 con 0x7f910015c710 2023-12-19T16:18:26.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90f8004030 con 0x7f910015c710 2023-12-19T16:18:26.791 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f90e0065a60 0x7f90e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f90f80831b0 con 0x7f910015c710 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90feffd640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f90e0065a60 0x7f90e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f90e006bd60 0x7f90e006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 --> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90e006e870 con 0x7f90e006bd60 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90f8085790 con 0x7f910015c710 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f7fff640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f90e006bd60 0x7f90e006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.792 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90feffd640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f90e0065a60 0x7f90e0067f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f90f00af000 tx=0x7f90f00b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f7fff640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f90e006bd60 0x7f90e006e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.786+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== osd.2 v2:172.21.15.119:6816/38166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f90e006e870 con 0x7f90e006bd60 2023-12-19T16:18:26.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.798+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 --> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f910006b7c0 con 0x7f90e006bd60 2023-12-19T16:18:26.805 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.798+0000 7f90f77fe640 1 -- 172.21.15.119:0/101676910 <== osd.2 v2:172.21.15.119:6816/38166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f910006b7c0 con 0x7f90e006bd60 2023-12-19T16:18:26.805 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:26.805 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:26.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.798+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f90e006bd60 msgr2=0x7f90e006e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.798+0000 7f910548c640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6816/38166,v1:172.21.15.119:6817/38166] conn(0x7f90e006bd60 0x7f90e006e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f90e0065a60 msgr2=0x7f90e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f90e0065a60 0x7f90e0067f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f90f00af000 tx=0x7f90f00b6040 comp rx=0 tx=0).stop 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 msgr2=0x7f9100151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 --2- 172.21.15.119:0/101676910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f910015c710 0x7f9100151ca0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f90f8007e60 tx=0x7f90f800d4a0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f90ff7fe640 1 -- 172.21.15.119:0/101676910 reap_dead start 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 shutdown_connections 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 >> 172.21.15.119:0/101676910 conn(0x7f9100070530 msgr2=0x7f9100158650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 shutdown_connections 2023-12-19T16:18:26.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.802+0000 7f910548c640 1 -- 172.21.15.119:0/101676910 wait complete. 2023-12-19T16:18:26.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T16:18:26.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 Processor -- start 2023-12-19T16:18:26.962 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 -- start start 2023-12-19T16:18:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1818069ca0 0x7f181806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f181815caf0 0x7f18180cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18180ccde0 con 0x7f18180cdc20 2023-12-19T16:18:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181806a5c0 con 0x7f181815caf0 2023-12-19T16:18:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f181d4d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18180cc820 con 0x7f1818069ca0 2023-12-19T16:18:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18167fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f181815caf0 0x7f18180cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18177fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f18180cdc20 0x7f18180717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38252/0 (socket says 172.21.15.119:38252) 2023-12-19T16:18:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18177fe640 1 -- 172.21.15.119:0/1645553144 learned_addr learned my addr 172.21.15.119:0/1645553144 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f1816ffd640 1 --2- 172.21.15.119:0/1645553144 >> v2:172.21.15.143:3300/0 conn(0x7f1818069ca0 0x7f181806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18167fc640 1 -- 172.21.15.119:0/1645553144 >> v2:172.21.15.143:3300/0 conn(0x7f1818069ca0 msgr2=0x7f181806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18167fc640 1 --2- 172.21.15.119:0/1645553144 >> v2:172.21.15.143:3300/0 conn(0x7f1818069ca0 0x7f181806a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18167fc640 1 -- 172.21.15.119:0/1645553144 >> v1:172.21.15.119:6789/0 conn(0x7f18180cdc20 legacy=0x7f18180717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f18167fc640 1 -- 172.21.15.119:0/1645553144 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180ccb00 con 0x7f181815caf0 2023-12-19T16:18:26.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f1815ffb640 1 -- 172.21.15.119:0/1645553144 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542456001 0 0) 0x7f18180ccde0 con 0x7f18180cdc20 2023-12-19T16:18:26.965 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.958+0000 7f1816ffd640 1 --2- 172.21.15.119:0/1645553144 >> v2:172.21.15.143:3300/0 conn(0x7f1818069ca0 0x7f181806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:26.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f18167fc640 1 --2- 172.21.15.119:0/1645553144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f18180cbef0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f181806dce0 tx=0x7f180c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e264bf46ff0c4d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.966 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f1815ffb640 1 -- 172.21.15.119:0/1645553144 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c0a7070 con 0x7f181815caf0 2023-12-19T16:18:26.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f1815ffb640 1 -- 172.21.15.119:0/1645553144 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c0ab430 con 0x7f181815caf0 2023-12-19T16:18:26.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f1815ffb640 1 -- 172.21.15.119:0/1645553144 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c0ab7c0 con 0x7f181815caf0 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 -- 172.21.15.119:0/1645553144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 msgr2=0x7f18180cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 --2- 172.21.15.119:0/1645553144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f18180cbef0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f181806dce0 tx=0x7f180c01c430 comp rx=0 tx=0).stop 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 -- 172.21.15.119:0/1645553144 shutdown_connections 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 --2- 172.21.15.119:0/1645553144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f18180cbef0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 --2- 172.21.15.119:0/1645553144 >> v2:172.21.15.143:3300/0 conn(0x7f1818069ca0 0x7f181806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 -- 172.21.15.119:0/1645553144 >> 172.21.15.119:0/1645553144 conn(0x7f181806cf80 msgr2=0x7f181806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 -- 172.21.15.119:0/1645553144 shutdown_connections 2023-12-19T16:18:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.962+0000 7f181d4d1640 1 -- 172.21.15.119:0/1645553144 wait complete. 2023-12-19T16:18:26.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 Processor -- start 2023-12-19T16:18:26.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- start start 2023-12-19T16:18:26.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1818069ca0 0x7f181815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18180cdc20 0x7f18180c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f1818153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181815c0e0 con 0x7f181815caf0 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181815ab20 con 0x7f1818069ca0 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181815ae00 con 0x7f18180cdc20 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f1818153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f1818153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50222/0 (socket says 172.21.15.119:50222) 2023-12-19T16:18:26.972 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 -- 172.21.15.119:0/59137361 learned_addr learned my addr 172.21.15.119:0/59137361 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f1816ffd640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1818069ca0 0x7f181815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18167fc640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18180cdc20 0x7f18180c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 -- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18180cdc20 msgr2=0x7f18180c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18180cdc20 0x7f18180c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 -- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1818069ca0 msgr2=0x7f181815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1818069ca0 0x7f181815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 -- 172.21.15.119:0/59137361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009420 con 0x7f181815caf0 2023-12-19T16:18:26.973 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f18177fe640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f1818153fe0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1810001570 tx=0x7f181000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000a640 con 0x7f181815caf0 2023-12-19T16:18:26.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000a7c0 con 0x7f181815caf0 2023-12-19T16:18:26.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181815b0e0 con 0x7f181815caf0 2023-12-19T16:18:26.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000ab70 con 0x7f181815caf0 2023-12-19T16:18:26.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1818154de0 con 0x7f181815caf0 2023-12-19T16:18:26.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.966+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181804e000 con 0x7f181815caf0 2023-12-19T16:18:26.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.970+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f181000acd0 con 0x7f181815caf0 2023-12-19T16:18:26.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.970+0000 7f17ff7fe640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1804065a60 0x7f1804067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.970+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1810082790 con 0x7f181815caf0 2023-12-19T16:18:26.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.970+0000 7f1816ffd640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1804065a60 0x7f1804067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.970+0000 7f1816ffd640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1804065a60 0x7f1804067f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1808009950 tx=0x7f1808008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:26.974+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f18100503c0 con 0x7f181815caf0 2023-12-19T16:18:27.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.122+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f18180cc430 con 0x7f1804065a60 2023-12-19T16:18:27.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.122+0000 7f17ff7fe640 1 -- 172.21.15.119:0/59137361 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1808004020 con 0x7f1804065a60 2023-12-19T16:18:27.128 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T16:18:27.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1804065a60 msgr2=0x7f1804067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1804065a60 0x7f1804067f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1808009950 tx=0x7f1808008040 comp rx=0 tx=0).stop 2023-12-19T16:18:27.130 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 msgr2=0x7f1818153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f1818153fe0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1810001570 tx=0x7f181000cca0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 shutdown_connections 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f1804065a60 0x7f1804067f20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f181815caf0 0x7f1818153fe0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18180cdc20 0x7f18180c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 --2- 172.21.15.119:0/59137361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1818069ca0 0x7f181815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 >> 172.21.15.119:0/59137361 conn(0x7f181806cf80 msgr2=0x7f18180ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 shutdown_connections 2023-12-19T16:18:27.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.126+0000 7f181d4d1640 1 -- 172.21.15.119:0/59137361 wait complete. 2023-12-19T16:18:27.149 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T16:18:27.149 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:27.290 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0e38f640 1 Processor -- start 2023-12-19T16:18:27.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0e38f640 1 -- start start 2023-12-19T16:18:27.291 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0e38f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2a0806c530 0x7f2a080ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0e38f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0815cdf0 con 0x7f2a080ceb10 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0e38f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0806ca80 con 0x7f2a08146370 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0e38f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a080cef80 con 0x7f2a0806c530 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0c92c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2a080ceb10 0x7f2a08144840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38268/0 (socket says 172.21.15.119:38268) 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a0c92c640 1 -- 172.21.15.119:0/4034848126 learned_addr learned my addr 172.21.15.119:0/4034848126 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a077fe640 1 --2- 172.21.15.119:0/4034848126 >> v2:172.21.15.143:3300/0 conn(0x7f2a0806c530 0x7f2a080ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a06ffd640 1 -- 172.21.15.119:0/4034848126 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586871658 0 0) 0x7f2a0815cdf0 con 0x7f2a080ceb10 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a06ffd640 1 -- 172.21.15.119:0/4034848126 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f0003530 con 0x7f2a080ceb10 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a077fe640 1 -- 172.21.15.119:0/4034848126 >> v1:172.21.15.143:6789/0 conn(0x7f2a08146370 legacy=0x7f2a080cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a077fe640 1 -- 172.21.15.119:0/4034848126 >> v1:172.21.15.119:6789/0 conn(0x7f2a080ceb10 legacy=0x7f2a08144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.286+0000 7f2a077fe640 1 -- 172.21.15.119:0/4034848126 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0806cd60 con 0x7f2a0806c530 2023-12-19T16:18:27.295 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a077fe640 1 --2- 172.21.15.119:0/4034848126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0806c530 0x7f2a080ce5d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0097f0 tx=0x7f29fc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d8c76360b4f607 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a06ffd640 1 -- 172.21.15.119:0/4034848126 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0ab600 con 0x7f2a0806c530 2023-12-19T16:18:27.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a06ffd640 1 -- 172.21.15.119:0/4034848126 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc0a7050 con 0x7f2a0806c530 2023-12-19T16:18:27.296 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a06ffd640 1 -- 172.21.15.119:0/4034848126 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0ab960 con 0x7f2a0806c530 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4034848126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0806c530 msgr2=0x7f2a080ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 --2- 172.21.15.119:0/4034848126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0806c530 0x7f2a080ce5d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0097f0 tx=0x7f29fc01c480 comp rx=0 tx=0).stop 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4034848126 shutdown_connections 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 --2- 172.21.15.119:0/4034848126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0806c530 0x7f2a080ce5d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4034848126 >> 172.21.15.119:0/4034848126 conn(0x7f2a08069e70 msgr2=0x7f2a0806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4034848126 shutdown_connections 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.290+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4034848126 wait complete. 2023-12-19T16:18:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 Processor -- start 2023-12-19T16:18:27.298 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 -- start start 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a0806c530 0x7f2a08097620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a080ceb10 0x7f2a080950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a08146370 0x7f2a08152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081580b0 con 0x7f2a0806c530 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08095610 con 0x7f2a08146370 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081527c0 con 0x7f2a080ceb10 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a0806c530 0x7f2a08097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a0806c530 0x7f2a08097620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50226/0 (socket says 172.21.15.119:50226) 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 -- 172.21.15.119:0/4219845685 learned_addr learned my addr 172.21.15.119:0/4219845685 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a077fe640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a080ceb10 0x7f2a080950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0c92c640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a08146370 0x7f2a08152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 -- 172.21.15.119:0/4219845685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a080ceb10 msgr2=0x7f2a080950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a080ceb10 0x7f2a080950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 -- 172.21.15.119:0/4219845685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a08146370 msgr2=0x7f2a08152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a08146370 0x7f2a08152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 -- 172.21.15.119:0/4219845685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc009420 con 0x7f2a0806c530 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a07fff640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a0806c530 0x7f2a08097620 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c480 tx=0x7f29f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80052d0 con 0x7f2a0806c530 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8005430 con 0x7f2a0806c530 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8007260 con 0x7f2a0806c530 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0806dca0 con 0x7f2a0806c530 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.294+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a080b0a20 con 0x7f2a0806c530 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a080b08a0 con 0x7f2a0806c530 2023-12-19T16:18:27.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f29f80073c0 con 0x7f2a0806c530 2023-12-19T16:18:27.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a04ff9640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29f4065a60 0x7f29f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f29f8082730 con 0x7f2a0806c530 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a077fe640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29f4065a60 0x7f29f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a04ff9640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7f29f406bd60 0x7f29f406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 --> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29f406e870 con 0x7f29f406bd60 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29f8084df0 con 0x7f2a0806c530 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a0c92c640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7f29f406bd60 0x7f29f406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a077fe640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29f4065a60 0x7f29f4067f20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ad000 tx=0x7f29fc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.298+0000 7f2a0c92c640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7f29f406bd60 0x7f29f406e1a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.306 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.302+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== osd.3 v2:172.21.15.119:6824/38170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f29f406e870 con 0x7f29f406bd60 2023-12-19T16:18:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 --> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2a0806db20 con 0x7f29f406bd60 2023-12-19T16:18:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a04ff9640 1 -- 172.21.15.119:0/4219845685 <== osd.3 v2:172.21.15.119:6824/38170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2a00001fb0 con 0x7f29f406bd60 2023-12-19T16:18:27.318 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:27.318 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:27.319 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7f29f406bd60 msgr2=0x7f29f406e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6824/38170,v1:172.21.15.119:6825/38170] conn(0x7f29f406bd60 0x7f29f406e1a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29f4065a60 msgr2=0x7f29f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f29f4065a60 0x7f29f4067f20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ad000 tx=0x7f29fc0a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a0806c530 msgr2=0x7f2a08097620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 --2- 172.21.15.119:0/4219845685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a0806c530 0x7f2a08097620 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c480 tx=0x7f29f800c940 comp rx=0 tx=0).stop 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0c92c640 1 -- 172.21.15.119:0/4219845685 reap_dead start 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 shutdown_connections 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 >> 172.21.15.119:0/4219845685 conn(0x7f2a08069e70 msgr2=0x7f2a0806ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.320 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 shutdown_connections 2023-12-19T16:18:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.314+0000 7f2a0e38f640 1 -- 172.21.15.119:0/4219845685 wait complete. 2023-12-19T16:18:27.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T16:18:27.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 Processor -- start 2023-12-19T16:18:27.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 -- start start 2023-12-19T16:18:27.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff1c00cdd40 0x7ff1c00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c006fdb0 0x7ff1c0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c0160690 con 0x7ff1c015c9d0 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c01603f0 con 0x7ff1c00cdd40 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c6866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00b0d80 con 0x7ff1c006fdb0 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff1c00cdd40 0x7ff1c00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff1c00cdd40 0x7ff1c00cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50236/0 (socket says 172.21.15.119:50236) 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 -- 172.21.15.119:0/2856523334 learned_addr learned my addr 172.21.15.119:0/2856523334 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1c4e03640 1 --2- 172.21.15.119:0/2856523334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c006fdb0 0x7ff1c0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 -- 172.21.15.119:0/2856523334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c006fdb0 msgr2=0x7ff1c0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:27.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 --2- 172.21.15.119:0/2856523334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c006fdb0 0x7ff1c0070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 -- 172.21.15.119:0/2856523334 >> v1:172.21.15.143:6789/0 conn(0x7ff1c015c9d0 legacy=0x7ff1c0160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:27.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.474+0000 7ff1bf7fe640 1 -- 172.21.15.119:0/2856523334 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00ccb00 con 0x7ff1c00cdd40 2023-12-19T16:18:27.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1bf7fe640 1 --2- 172.21.15.119:0/2856523334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00cdd40 0x7ff1c00cc400 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009870 tx=0x7ff1b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c5ad2472d5267 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1beffd640 1 -- 172.21.15.119:0/2856523334 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40aa640 con 0x7ff1c00cdd40 2023-12-19T16:18:27.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1beffd640 1 -- 172.21.15.119:0/2856523334 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b40aa7a0 con 0x7ff1c00cdd40 2023-12-19T16:18:27.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1beffd640 1 -- 172.21.15.119:0/2856523334 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40aab30 con 0x7ff1c00cdd40 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 -- 172.21.15.119:0/2856523334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00cdd40 msgr2=0x7ff1c00cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 --2- 172.21.15.119:0/2856523334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00cdd40 0x7ff1c00cc400 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009870 tx=0x7ff1b401c500 comp rx=0 tx=0).stop 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 -- 172.21.15.119:0/2856523334 shutdown_connections 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 --2- 172.21.15.119:0/2856523334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c006fdb0 0x7ff1c0070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 --2- 172.21.15.119:0/2856523334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c00cdd40 0x7ff1c00cc400 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 -- 172.21.15.119:0/2856523334 >> 172.21.15.119:0/2856523334 conn(0x7ff1c006a3e0 msgr2=0x7ff1c00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 -- 172.21.15.119:0/2856523334 shutdown_connections 2023-12-19T16:18:27.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.478+0000 7ff1c6866640 1 -- 172.21.15.119:0/2856523334 wait complete. 2023-12-19T16:18:27.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 Processor -- start 2023-12-19T16:18:27.485 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- start start 2023-12-19T16:18:27.487 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1c006fdb0 0x7ff1c015b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c00cdd40 0x7ff1c00714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 0x7ff1c014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c015b980 con 0x7ff1c015c9d0 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0070b40 con 0x7ff1c006fdb0 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0159a00 con 0x7ff1c00cdd40 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 0x7ff1c014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 0x7ff1c014a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50240/0 (socket says 172.21.15.119:50240) 2023-12-19T16:18:27.488 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 -- 172.21.15.119:0/1717638664 learned_addr learned my addr 172.21.15.119:0/1717638664 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1bf7fe640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c00cdd40 0x7ff1c00714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1bffff640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1c006fdb0 0x7ff1c015b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 -- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c00cdd40 msgr2=0x7ff1c00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c00cdd40 0x7ff1c00714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 -- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1c006fdb0 msgr2=0x7ff1c015b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1c006fdb0 0x7ff1c015b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 -- 172.21.15.119:0/1717638664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40094d0 con 0x7ff1c015c9d0 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1bffff640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1c006fdb0 0x7ff1c015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:27.489 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c4e03640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 0x7ff1c014a770 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8007e40 tx=0x7ff1b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8014620 con 0x7ff1c015c9d0 2023-12-19T16:18:27.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b800ee90 con 0x7ff1c015c9d0 2023-12-19T16:18:27.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c01613b0 con 0x7ff1c015c9d0 2023-12-19T16:18:27.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80149e0 con 0x7ff1c015c9d0 2023-12-19T16:18:27.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c0070d90 con 0x7ff1c015c9d0 2023-12-19T16:18:27.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.482+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c00735b0 con 0x7ff1c015c9d0 2023-12-19T16:18:27.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.486+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff1b8014b40 con 0x7ff1c015c9d0 2023-12-19T16:18:27.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.486+0000 7ff1bcff9640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff1ac065a60 0x7ff1ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.486+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff1b8083930 con 0x7ff1c015c9d0 2023-12-19T16:18:27.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.486+0000 7ff1bffff640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff1ac065a60 0x7ff1ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.486+0000 7ff1bffff640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff1ac065a60 0x7ff1ac067f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000a850 tx=0x7ff1b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.490+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff1b8051520 con 0x7ff1c015c9d0 2023-12-19T16:18:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.638+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1c0161230 con 0x7ff1ac065a60 2023-12-19T16:18:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.638+0000 7ff1bcff9640 1 -- 172.21.15.119:0/1717638664 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff1b000ae80 con 0x7ff1ac065a60 2023-12-19T16:18:27.645 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff1ac065a60 msgr2=0x7ff1ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff1ac065a60 0x7ff1ac067f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000a850 tx=0x7ff1b0008040 comp rx=0 tx=0).stop 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 msgr2=0x7ff1c014a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 0x7ff1c014a770 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8007e40 tx=0x7ff1b800e4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 shutdown_connections 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7ff1ac065a60 0x7ff1ac067f20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1c015c9d0 0x7ff1c014a770 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1c00cdd40 0x7ff1c00714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.647 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 --2- 172.21.15.119:0/1717638664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1c006fdb0 0x7ff1c015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 >> 172.21.15.119:0/1717638664 conn(0x7ff1c006a3e0 msgr2=0x7ff1c00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 shutdown_connections 2023-12-19T16:18:27.648 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.642+0000 7ff1c6866640 1 -- 172.21.15.119:0/1717638664 wait complete. 2023-12-19T16:18:27.666 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T16:18:27.666 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.802+0000 7fac3268c640 1 Processor -- start 2023-12-19T16:18:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.802+0000 7fac3268c640 1 -- start start 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac3268c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ce6a0 0x7fac2c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac3268c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0ad6e0 con 0x7fac2c0c89f0 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac3268c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0ad9c0 con 0x7fac2c0ca200 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac3268c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c159b20 con 0x7fac2c0ce6a0 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac30c29640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fac2c0c89f0 0x7fac2c0c8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38282/0 (socket says 172.21.15.119:38282) 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac30c29640 1 -- 172.21.15.119:0/2144650357 learned_addr learned my addr 172.21.15.119:0/2144650357 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:27.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2bfff640 1 --2- 172.21.15.119:0/2144650357 >> v2:172.21.15.143:3300/0 conn(0x7fac2c0ce6a0 0x7fac2c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499212997 0 0) 0x7fac2c0ad6e0 con 0x7fac2c0c89f0 2023-12-19T16:18:27.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac14003530 con 0x7fac2c0c89f0 2023-12-19T16:18:27.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365386452 0 0) 0x7fac2c0ad9c0 con 0x7fac2c0ca200 2023-12-19T16:18:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c0ad6e0 con 0x7fac2c0ca200 2023-12-19T16:18:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2bfff640 1 -- 172.21.15.119:0/2144650357 >> v1:172.21.15.143:6789/0 conn(0x7fac2c0ca200 legacy=0x7fac2c0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2453975210 0 0) 0x7fac14003530 con 0x7fac2c0c89f0 2023-12-19T16:18:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2bfff640 1 -- 172.21.15.119:0/2144650357 >> v1:172.21.15.119:6789/0 conn(0x7fac2c0c89f0 legacy=0x7fac2c0c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.806+0000 7fac2bfff640 1 -- 172.21.15.119:0/2144650357 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c06be20 con 0x7fac2c0ce6a0 2023-12-19T16:18:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac2bfff640 1 --2- 172.21.15.119:0/2144650357 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 0x7fac2c0ca730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0097f0 tx=0x7fac1c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bfe8df25a39848f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24001a00 con 0x7fac2c0ce6a0 2023-12-19T16:18:27.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c0a7050 con 0x7fac2c0ce6a0 2023-12-19T16:18:27.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac2affd640 1 -- 172.21.15.119:0/2144650357 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0ab620 con 0x7fac2c0ce6a0 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 -- 172.21.15.119:0/2144650357 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 msgr2=0x7fac2c0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 --2- 172.21.15.119:0/2144650357 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 0x7fac2c0ca730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0097f0 tx=0x7fac1c01c370 comp rx=0 tx=0).stop 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 -- 172.21.15.119:0/2144650357 shutdown_connections 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 --2- 172.21.15.119:0/2144650357 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 0x7fac2c0ca730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 -- 172.21.15.119:0/2144650357 >> 172.21.15.119:0/2144650357 conn(0x7fac2c069e70 msgr2=0x7fac2c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 -- 172.21.15.119:0/2144650357 shutdown_connections 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 -- 172.21.15.119:0/2144650357 wait complete. 2023-12-19T16:18:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 Processor -- start 2023-12-19T16:18:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.810+0000 7fac3268c640 1 -- start start 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c0c89f0 0x7fac2c0978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c0ca200 0x7fac2c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 0x7fac2c15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c7000 con 0x7fac2c0c89f0 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c72e0 con 0x7fac2c0ce6a0 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c75c0 con 0x7fac2c0ca200 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c0c89f0 0x7fac2c0978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c0c89f0 0x7fac2c0978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50254/0 (socket says 172.21.15.119:50254) 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 -- 172.21.15.119:0/1422918811 learned_addr learned my addr 172.21.15.119:0/1422918811 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2b7fe640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c0ca200 0x7fac2c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac30c29640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 0x7fac2c15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 -- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c0ca200 msgr2=0x7fac2c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac2c0ca200 0x7fac2c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 -- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 msgr2=0x7fac2c15b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac2c0ce6a0 0x7fac2c15b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 -- 172.21.15.119:0/1422918811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009420 con 0x7fac2c0c89f0 2023-12-19T16:18:27.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac2bfff640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c0c89f0 0x7fac2c0978f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fac1c019fa0 tx=0x7fac1c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.820 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c006e20 con 0x7fac2c0c89f0 2023-12-19T16:18:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c0b4400 con 0x7fac2c0c89f0 2023-12-19T16:18:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c0c78a0 con 0x7fac2c0c89f0 2023-12-19T16:18:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0b4770 con 0x7fac2c0c89f0 2023-12-19T16:18:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c097e30 con 0x7fac2c0c89f0 2023-12-19T16:18:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac2c06c6c0 con 0x7fac2c0c89f0 2023-12-19T16:18:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.814+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac1c0b2040 con 0x7fac2c0c89f0 2023-12-19T16:18:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac28ff9640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac18065a60 0x7fac18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fac1c11d750 con 0x7fac2c0c89f0 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac28ff9640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7fac1806bd60 0x7fac1806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 --> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac1806e870 con 0x7fac1806bd60 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac1c11dac0 con 0x7fac2c0c89f0 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac2b7fe640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac18065a60 0x7fac18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac30c29640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7fac1806bd60 0x7fac1806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac2b7fe640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac18065a60 0x7fac18067f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fac2c159770 tx=0x7fac20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.823 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac30c29640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7fac1806bd60 0x7fac1806e1a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.824 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.818+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== osd.4 v2:172.21.15.143:6807/38338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fac1806e870 con 0x7fac1806bd60 2023-12-19T16:18:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 --> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fac2c06c3e0 con 0x7fac1806bd60 2023-12-19T16:18:27.836 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac28ff9640 1 -- 172.21.15.119:0/1422918811 <== osd.4 v2:172.21.15.143:6807/38338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fac240070f0 con 0x7fac1806bd60 2023-12-19T16:18:27.836 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:27.836 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:27.837 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7fac1806bd60 msgr2=0x7fac1806e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.143:6807/38338,v1:172.21.15.143:6809/38338] conn(0x7fac1806bd60 0x7fac1806e1a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac18065a60 msgr2=0x7fac18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fac18065a60 0x7fac18067f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fac2c159770 tx=0x7fac20009040 comp rx=0 tx=0).stop 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c0c89f0 msgr2=0x7fac2c0978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 --2- 172.21.15.119:0/1422918811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac2c0c89f0 0x7fac2c0978f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fac1c019fa0 tx=0x7fac1c019110 comp rx=0 tx=0).stop 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac30c29640 1 -- 172.21.15.119:0/1422918811 reap_dead start 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 shutdown_connections 2023-12-19T16:18:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 >> 172.21.15.119:0/1422918811 conn(0x7fac2c069e70 msgr2=0x7fac2c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 shutdown_connections 2023-12-19T16:18:27.839 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.830+0000 7fac3268c640 1 -- 172.21.15.119:0/1422918811 wait complete. 2023-12-19T16:18:27.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T16:18:27.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bd5f2c640 1 Processor -- start 2023-12-19T16:18:27.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bd5f2c640 1 -- start start 2023-12-19T16:18:27.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bd5f2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3bd0158c20 0x7f3bd0070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bd5f2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd0070b80 con 0x7f3bd00cb180 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bd5f2c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd0070e60 con 0x7f3bd015c800 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bd5f2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd0071140 con 0x7f3bd0158c20 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3bd0158c20 0x7f3bd0070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3bd0158c20 0x7f3bd0070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50260/0 (socket says 172.21.15.119:50260) 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3bd00cb180 0x7f3bd00ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38290/0 (socket says 172.21.15.119:38290) 2023-12-19T16:18:27.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcf7fe640 1 -- 172.21.15.119:0/119329972 learned_addr learned my addr 172.21.15.119:0/119329972 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:27.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcf7fe640 1 -- 172.21.15.119:0/119329972 >> v1:172.21.15.143:6789/0 conn(0x7f3bd015c800 legacy=0x7f3bd00caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:27.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcf7fe640 1 -- 172.21.15.119:0/119329972 >> v1:172.21.15.119:6789/0 conn(0x7f3bd00cb180 legacy=0x7f3bd00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bcf7fe640 1 -- 172.21.15.119:0/119329972 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0071420 con 0x7f3bd0158c20 2023-12-19T16:18:27.997 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.990+0000 7f3bceffd640 1 -- 172.21.15.119:0/119329972 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072719758 0 0) 0x7f3bd0070b80 con 0x7f3bd00cb180 2023-12-19T16:18:27.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bcf7fe640 1 --2- 172.21.15.119:0/119329972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd0070510 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000bb10 tx=0x7f3bc001f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1f49dec3daf38f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bceffd640 1 -- 172.21.15.119:0/119329972 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00a7b80 con 0x7f3bd0158c20 2023-12-19T16:18:27.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bceffd640 1 -- 172.21.15.119:0/119329972 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00a7ce0 con 0x7f3bd0158c20 2023-12-19T16:18:27.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bceffd640 1 -- 172.21.15.119:0/119329972 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00af660 con 0x7f3bd0158c20 2023-12-19T16:18:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/119329972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 msgr2=0x7f3bd0070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/119329972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd0070510 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000bb10 tx=0x7f3bc001f570 comp rx=0 tx=0).stop 2023-12-19T16:18:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/119329972 shutdown_connections 2023-12-19T16:18:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/119329972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd0070510 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/119329972 >> 172.21.15.119:0/119329972 conn(0x7f3bd006a3e0 msgr2=0x7f3bd00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/119329972 shutdown_connections 2023-12-19T16:18:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.994+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/119329972 wait complete. 2023-12-19T16:18:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 Processor -- start 2023-12-19T16:18:28.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- start start 2023-12-19T16:18:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd00cb180 0x7f3bd00ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd014ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd015c800 0x7f3bd00c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0159790 con 0x7f3bd0158c20 2023-12-19T16:18:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00aee80 con 0x7f3bd00cb180 2023-12-19T16:18:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00ae340 con 0x7f3bd015c800 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd014ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd014ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50272/0 (socket says 172.21.15.119:50272) 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 -- 172.21.15.119:0/1563381786 learned_addr learned my addr 172.21.15.119:0/1563381786 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bcf7fe640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd00cb180 0x7f3bd00ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bcffff640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd015c800 0x7f3bd00c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 -- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd015c800 msgr2=0x7f3bd00c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd015c800 0x7f3bd00c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 -- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd00cb180 msgr2=0x7f3bd00ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd00cb180 0x7f3bd00ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 -- 172.21.15.119:0/1563381786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc000b770 con 0x7f3bd0158c20 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bc7fff640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd014ab60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800b410 tx=0x7f3bb800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8004020 con 0x7f3bd0158c20 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8004180 con 0x7f3bd0158c20 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd00c8800 con 0x7f3bd0158c20 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8011630 con 0x7f3bd0158c20 2023-12-19T16:18:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd00ae8c0 con 0x7f3bd0158c20 2023-12-19T16:18:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:27.998+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd00735b0 con 0x7f3bd0158c20 2023-12-19T16:18:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.002+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bb8011790 con 0x7f3bd0158c20 2023-12-19T16:18:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.002+0000 7f3bccff9640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3bb0065a60 0x7f3bb0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.002+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3bb8082d30 con 0x7f3bd0158c20 2023-12-19T16:18:28.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.002+0000 7f3bcf7fe640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3bb0065a60 0x7f3bb0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.002+0000 7f3bcf7fe640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3bb0065a60 0x7f3bb0067f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b1000 tx=0x7f3bc0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.006+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3bb8050810 con 0x7f3bd0158c20 2023-12-19T16:18:28.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bd00ce160 con 0x7f3bb0065a60 2023-12-19T16:18:28.162 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bccff9640 1 -- 172.21.15.119:0/1563381786 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3bd00ce160 con 0x7f3bb0065a60 2023-12-19T16:18:28.162 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3bb0065a60 msgr2=0x7f3bb0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3bb0065a60 0x7f3bb0067f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b1000 tx=0x7f3bc0004740 comp rx=0 tx=0).stop 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 msgr2=0x7f3bd014ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd014ab60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800b410 tx=0x7f3bb800b8d0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 shutdown_connections 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3bb0065a60 0x7f3bb0067f20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd015c800 0x7f3bd00c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bd0158c20 0x7f3bd014ab60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 --2- 172.21.15.119:0/1563381786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd00cb180 0x7f3bd00ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 >> 172.21.15.119:0/1563381786 conn(0x7f3bd006a3e0 msgr2=0x7f3bd014fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 shutdown_connections 2023-12-19T16:18:28.165 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.158+0000 7f3bd5f2c640 1 -- 172.21.15.119:0/1563381786 wait complete. 2023-12-19T16:18:28.183 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T16:18:28.183 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:28.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 Processor -- start 2023-12-19T16:18:28.326 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 -- start start 2023-12-19T16:18:28.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7600ca200 0x7fe7600ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 0x7fe7600c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7600ad6e0 con 0x7fe7600ce6a0 2023-12-19T16:18:28.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe760159b20 con 0x7fe7600ca200 2023-12-19T16:18:28.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe7686fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600ad9c0 con 0x7fe7600c89f0 2023-12-19T16:18:28.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7600ca200 0x7fe7600ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe766c99640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 0x7fe7600c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7600ca200 0x7fe7600ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:58872/0 (socket says 172.21.15.119:58872) 2023-12-19T16:18:28.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe766498640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe7600ce6a0 0x7fe7600cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.119:54944/0 (socket says 172.21.15.119:54944) 2023-12-19T16:18:28.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe766c99640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 0x7fe7600c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.119:49678/0 (socket says 172.21.15.119:49678) 2023-12-19T16:18:28.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 -- 172.21.15.119:0/2630485855 learned_addr learned my addr 172.21.15.119:0/2630485855 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:28.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 -- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 msgr2=0x7fe7600c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 --2- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 0x7fe7600c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 -- 172.21.15.119:0/2630485855 >> v1:172.21.15.143:6789/0 conn(0x7fe7600ce6a0 legacy=0x7fe7600cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe765c97640 1 -- 172.21.15.119:0/2630485855 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76006be20 con 0x7fe7600ca200 2023-12-19T16:18:28.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.322+0000 7fe766c99640 1 --2- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 0x7fe7600c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:28.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe765c97640 1 --2- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 0x7fe7600ca730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe75000bb40 tx=0x7fe75001ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1170ad99b36b224 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe765496640 1 -- 172.21.15.119:0/2630485855 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a7b90 con 0x7fe7600ca200 2023-12-19T16:18:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe765496640 1 -- 172.21.15.119:0/2630485855 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500a7cf0 con 0x7fe7600ca200 2023-12-19T16:18:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe765496640 1 -- 172.21.15.119:0/2630485855 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500af660 con 0x7fe7600ca200 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 -- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 msgr2=0x7fe7600ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 --2- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 0x7fe7600ca730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe75000bb40 tx=0x7fe75001ebc0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 -- 172.21.15.119:0/2630485855 shutdown_connections 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 --2- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600c89f0 0x7fe7600c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 --2- 172.21.15.119:0/2630485855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 0x7fe7600ca730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 -- 172.21.15.119:0/2630485855 >> 172.21.15.119:0/2630485855 conn(0x7fe760069e70 msgr2=0x7fe76006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 -- 172.21.15.119:0/2630485855 shutdown_connections 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.326+0000 7fe7686fc640 1 -- 172.21.15.119:0/2630485855 wait complete. 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 Processor -- start 2023-12-19T16:18:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 -- start start 2023-12-19T16:18:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7600c89f0 0x7fe760097a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 0x7fe7600acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600ce6a0 0x7fe7600c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76015acb0 con 0x7fe7600c89f0 2023-12-19T16:18:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76015bb10 con 0x7fe7600ca200 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600ad220 con 0x7fe7600ce6a0 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7600c89f0 0x7fe760097a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7600c89f0 0x7fe760097a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50278/0 (socket says 172.21.15.119:50278) 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 -- 172.21.15.119:0/3045728701 learned_addr learned my addr 172.21.15.119:0/3045728701 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe765c97640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 0x7fe7600acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766c99640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600ce6a0 0x7fe7600c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 -- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600ce6a0 msgr2=0x7fe7600c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7600ce6a0 0x7fe7600c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 -- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 msgr2=0x7fe7600acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7600ca200 0x7fe7600acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 -- 172.21.15.119:0/3045728701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758009a70 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe766498640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7600c89f0 0x7fe760097a60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c430 tx=0x7fe75c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0074e0 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c007640 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c004a10 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75000b770 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.330+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76006cd60 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe76006cbe0 con 0x7fe7600c89f0 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe75c004b70 con 0x7fe7600c89f0 2023-12-19T16:18:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe756ffd640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe744065a60 0x7fe744067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe75c0829b0 con 0x7fe7600c89f0 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe765c97640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe744065a60 0x7fe744067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe756ffd640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7fe74406bd60 0x7fe74406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 --> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe74406e870 con 0x7fe74406bd60 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe75c087280 con 0x7fe7600c89f0 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe766c99640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7fe74406bd60 0x7fe74406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe765c97640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe744065a60 0x7fe744067f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe7500b1000 tx=0x7fe750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.334+0000 7fe766c99640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7fe74406bd60 0x7fe74406e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.338+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== osd.5 v2:172.21.15.143:6804/38339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe74406e870 con 0x7fe74406bd60 2023-12-19T16:18:28.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 --> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe76006c6c0 con 0x7fe74406bd60 2023-12-19T16:18:28.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe756ffd640 1 -- 172.21.15.119:0/3045728701 <== osd.5 v2:172.21.15.143:6804/38339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe75800f040 con 0x7fe74406bd60 2023-12-19T16:18:28.355 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:28.355 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:28.355 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:28.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7fe74406bd60 msgr2=0x7fe74406e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.143:6804/38339,v1:172.21.15.143:6806/38339] conn(0x7fe74406bd60 0x7fe74406e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe744065a60 msgr2=0x7fe744067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe744065a60 0x7fe744067f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe7500b1000 tx=0x7fe750008040 comp rx=0 tx=0).stop 2023-12-19T16:18:28.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7600c89f0 msgr2=0x7fe760097a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 --2- 172.21.15.119:0/3045728701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7600c89f0 0x7fe760097a60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c430 tx=0x7fe75c00c830 comp rx=0 tx=0).stop 2023-12-19T16:18:28.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe766c99640 1 -- 172.21.15.119:0/3045728701 reap_dead start 2023-12-19T16:18:28.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 shutdown_connections 2023-12-19T16:18:28.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 >> 172.21.15.119:0/3045728701 conn(0x7fe760069e70 msgr2=0x7fe7600cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 shutdown_connections 2023-12-19T16:18:28.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.350+0000 7fe7686fc640 1 -- 172.21.15.119:0/3045728701 wait complete. 2023-12-19T16:18:28.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T16:18:28.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.506+0000 7f8e229f0640 1 Processor -- start 2023-12-19T16:18:28.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.506+0000 7f8e229f0640 1 -- start start 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e229f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15a680 0x7f8e1c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e229f0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c15f100 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e229f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c0ca7d0 con 0x7f8e1c0cac10 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e229f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c15e860 con 0x7f8e1c15a680 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e20f8d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8e1c06fdb0 0x7f8e1c0c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38294/0 (socket says 172.21.15.119:38294) 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e20f8d640 1 -- 172.21.15.119:0/2787098522 learned_addr learned my addr 172.21.15.119:0/2787098522 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1bfff640 1 --2- 172.21.15.119:0/2787098522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15a680 0x7f8e1c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178037962 0 0) 0x7f8e1c15f100 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e04003530 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739487636 0 0) 0x7f8e1c0ca7d0 con 0x7f8e1c0cac10 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e1c15f100 con 0x7f8e1c0cac10 2023-12-19T16:18:28.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1bfff640 1 -- 172.21.15.119:0/2787098522 >> v1:172.21.15.143:6789/0 conn(0x7f8e1c0cac10 legacy=0x7f8e1c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1846957869 0 0) 0x7f8e04003530 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1bfff640 1 -- 172.21.15.119:0/2787098522 >> v1:172.21.15.119:6789/0 conn(0x7f8e1c06fdb0 legacy=0x7f8e1c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.510+0000 7f8e1bfff640 1 -- 172.21.15.119:0/2787098522 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c15eb40 con 0x7f8e1c15a680 2023-12-19T16:18:28.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e1bfff640 1 --2- 172.21.15.119:0/2787098522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15a680 0x7f8e1c15e160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0097f0 tx=0x7f8e0c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1d5bd37c7c8259 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14001a00 con 0x7f8e1c15a680 2023-12-19T16:18:28.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0a7050 con 0x7f8e1c15a680 2023-12-19T16:18:28.518 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e1affd640 1 -- 172.21.15.119:0/2787098522 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0ab620 con 0x7f8e1c15a680 2023-12-19T16:18:28.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 -- 172.21.15.119:0/2787098522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15a680 msgr2=0x7f8e1c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 --2- 172.21.15.119:0/2787098522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15a680 0x7f8e1c15e160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0097f0 tx=0x7f8e0c01c350 comp rx=0 tx=0).stop 2023-12-19T16:18:28.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 -- 172.21.15.119:0/2787098522 shutdown_connections 2023-12-19T16:18:28.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 --2- 172.21.15.119:0/2787098522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15a680 0x7f8e1c15e160 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 -- 172.21.15.119:0/2787098522 >> 172.21.15.119:0/2787098522 conn(0x7f8e1c06a3e0 msgr2=0x7f8e1c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 -- 172.21.15.119:0/2787098522 shutdown_connections 2023-12-19T16:18:28.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 -- 172.21.15.119:0/2787098522 wait complete. 2023-12-19T16:18:28.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 Processor -- start 2023-12-19T16:18:28.520 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.514+0000 7f8e229f0640 1 -- start start 2023-12-19T16:18:28.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 0x7f8e1c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cac10 0x7f8e1c0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15a680 0x7f8e1c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.522 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0ad4c0 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c4000 con 0x7f8e1c15a680 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0acc60 con 0x7f8e1c0cac10 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 0x7f8e1c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 0x7f8e1c0c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50288/0 (socket says 172.21.15.119:50288) 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 -- 172.21.15.119:0/844932522 learned_addr learned my addr 172.21.15.119:0/844932522 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e20f8d640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15a680 0x7f8e1c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1b7fe640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cac10 0x7f8e1c0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 -- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cac10 msgr2=0x7f8e1c0c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.523 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cac10 0x7f8e1c0c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 -- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15a680 msgr2=0x7f8e1c1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15a680 0x7f8e1c1564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.524 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 -- 172.21.15.119:0/844932522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c009420 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e1bfff640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 0x7f8e1c0c4200 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c019f80 tx=0x7f8e0c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0b6480 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0b6600 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c0c4870 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0b69b0 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.525 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0ad1e0 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0735b0 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.518+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e0c0b2040 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.522+0000 7f8e18ff9640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8e08065a60 0x7f8e08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.526 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.522+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8e0c11d660 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.522+0000 7f8e1b7fe640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8e08065a60 0x7f8e08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.527 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.522+0000 7f8e1b7fe640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8e08065a60 0x7f8e08067f20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c155310 tx=0x7f8e10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.530 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.526+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e0c0eb280 con 0x7f8e1c06fdb0 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.674+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e1c070650 con 0x7f8e08065a60 2023-12-19T16:18:28.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.674+0000 7f8e18ff9640 1 -- 172.21.15.119:0/844932522 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e100014e0 con 0x7f8e08065a60 2023-12-19T16:18:28.681 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T16:18:28.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8e08065a60 msgr2=0x7f8e08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8e08065a60 0x7f8e08067f20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c155310 tx=0x7f8e10009040 comp rx=0 tx=0).stop 2023-12-19T16:18:28.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 msgr2=0x7f8e1c0c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.685 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 0x7f8e1c0c4200 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c019f80 tx=0x7f8e0c0190f0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 shutdown_connections 2023-12-19T16:18:28.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8e08065a60 0x7f8e08067f20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15a680 0x7f8e1c1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cac10 0x7f8e1c0c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 --2- 172.21.15.119:0/844932522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e1c06fdb0 0x7f8e1c0c4200 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 >> 172.21.15.119:0/844932522 conn(0x7f8e1c06a3e0 msgr2=0x7f8e1c15aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 shutdown_connections 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.678+0000 7f8e229f0640 1 -- 172.21.15.119:0/844932522 wait complete. 2023-12-19T16:18:28.701 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T16:18:28.702 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:28.843 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 Processor -- start 2023-12-19T16:18:28.844 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 -- start start 2023-12-19T16:18:28.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a5c0cc9a0 0x7f7a5c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0b1a50 0x7f7a5c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7a5c0abdd0 0x7f7a5c070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0b3070 con 0x7f7a5c0cc9a0 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0ce860 con 0x7f7a5c0abdd0 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.838+0000 7f7a631a2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cd2c0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a5c0cc9a0 0x7f7a5c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a5c0cc9a0 0x7f7a5c0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50302/0 (socket says 172.21.15.119:50302) 2023-12-19T16:18:28.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 -- 172.21.15.119:0/2650481 learned_addr learned my addr 172.21.15.119:0/2650481 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a6199f640 1 --2- 172.21.15.119:0/2650481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0b1a50 0x7f7a5c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a629a1640 1 --2- 172.21.15.119:0/2650481 >> v2:172.21.15.143:3300/0 conn(0x7f7a5c0abdd0 0x7f7a5c070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 -- 172.21.15.119:0/2650481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0b1a50 msgr2=0x7f7a5c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 --2- 172.21.15.119:0/2650481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0b1a50 0x7f7a5c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 -- 172.21.15.119:0/2650481 >> v2:172.21.15.143:3300/0 conn(0x7f7a5c0abdd0 msgr2=0x7f7a5c070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 --2- 172.21.15.119:0/2650481 >> v2:172.21.15.143:3300/0 conn(0x7f7a5c0abdd0 0x7f7a5c070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 -- 172.21.15.119:0/2650481 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0cdfc0 con 0x7f7a5c0cc9a0 2023-12-19T16:18:28.847 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a629a1640 1 --2- 172.21.15.119:0/2650481 >> v2:172.21.15.143:3300/0 conn(0x7f7a5c0abdd0 0x7f7a5c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:28.848 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a621a0640 1 --2- 172.21.15.119:0/2650481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0cc9a0 0x7f7a5c0ccd80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0cb4d0 tx=0x7f7a5801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbb37f131c1e021 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a6119e640 1 -- 172.21.15.119:0/2650481 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580ac600 con 0x7f7a5c0cc9a0 2023-12-19T16:18:28.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a6119e640 1 -- 172.21.15.119:0/2650481 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a580a8050 con 0x7f7a5c0cc9a0 2023-12-19T16:18:28.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.842+0000 7f7a6119e640 1 -- 172.21.15.119:0/2650481 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580ac980 con 0x7f7a5c0cc9a0 2023-12-19T16:18:28.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- 172.21.15.119:0/2650481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0cc9a0 msgr2=0x7f7a5c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- 172.21.15.119:0/2650481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0cc9a0 0x7f7a5c0ccd80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0cb4d0 tx=0x7f7a5801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- 172.21.15.119:0/2650481 shutdown_connections 2023-12-19T16:18:28.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- 172.21.15.119:0/2650481 >> v2:172.21.15.143:3300/0 conn(0x7f7a5c0abdd0 0x7f7a5c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- 172.21.15.119:0/2650481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0b1a50 0x7f7a5c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- 172.21.15.119:0/2650481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0cc9a0 0x7f7a5c0ccd80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- 172.21.15.119:0/2650481 >> 172.21.15.119:0/2650481 conn(0x7f7a5c0ceea0 msgr2=0x7f7a5c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- 172.21.15.119:0/2650481 shutdown_connections 2023-12-19T16:18:28.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- 172.21.15.119:0/2650481 wait complete. 2023-12-19T16:18:28.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 Processor -- start 2023-12-19T16:18:28.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- start start 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0abdd0 0x7f7a5c15ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0b1a50 0x7f7a5c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5c0cc9a0 0x7f7a5c15d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1512a0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c150690 con 0x7f7a5c0cc9a0 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a631a2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c150970 con 0x7f7a5c0abdd0 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0b1a50 0x7f7a5c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0b1a50 0x7f7a5c14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50316/0 (socket says 172.21.15.119:50316) 2023-12-19T16:18:28.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 -- 172.21.15.119:0/1609601093 learned_addr learned my addr 172.21.15.119:0/1609601093 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a621a0640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0abdd0 0x7f7a5c15ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a629a1640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5c0cc9a0 0x7f7a5c15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 -- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0abdd0 msgr2=0x7f7a5c15ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a5c0abdd0 0x7f7a5c15ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 -- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5c0cc9a0 msgr2=0x7f7a5c15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a5c0cc9a0 0x7f7a5c15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.846+0000 7f7a6199f640 1 -- 172.21.15.119:0/1609601093 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580094d0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a6199f640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0b1a50 0x7f7a5c14f970 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00d5f0 tx=0x7f7a4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0125f0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c012750 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c012ae0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c150c50 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c14feb0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a5c070960 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a4c012c40 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a40065a60 0x7f7a40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7a4c0833f0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7f7a4006bd60 0x7f7a4006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a621a0640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a40065a60 0x7f7a40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 --> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a4006e870 con 0x7f7a4006bd60 2023-12-19T16:18:28.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a4c085ab0 con 0x7f7a5c0b1a50 2023-12-19T16:18:28.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.850+0000 7f7a629a1640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7f7a4006bd60 0x7f7a4006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.854+0000 7f7a621a0640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a40065a60 0x7f7a40067f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a580ae000 tx=0x7f7a580a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.854+0000 7f7a629a1640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7f7a4006bd60 0x7f7a4006e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.854+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== osd.6 v2:172.21.15.143:6819/38347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7a4006e870 con 0x7f7a4006bd60 2023-12-19T16:18:28.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 --> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7a5c070680 con 0x7f7a4006bd60 2023-12-19T16:18:28.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a52ffd640 1 -- 172.21.15.119:0/1609601093 <== osd.6 v2:172.21.15.143:6819/38347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7a5400f040 con 0x7f7a4006bd60 2023-12-19T16:18:28.873 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:28.873 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:28.873 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:28.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7f7a4006bd60 msgr2=0x7f7a4006e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.143:6819/38347,v1:172.21.15.143:6822/38347] conn(0x7f7a4006bd60 0x7f7a4006e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a40065a60 msgr2=0x7f7a40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f7a40065a60 0x7f7a40067f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a580ae000 tx=0x7f7a580a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0b1a50 msgr2=0x7f7a5c14f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 --2- 172.21.15.119:0/1609601093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a5c0b1a50 0x7f7a5c14f970 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00d5f0 tx=0x7f7a4c00dab0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a629a1640 1 -- 172.21.15.119:0/1609601093 reap_dead start 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 shutdown_connections 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 >> 172.21.15.119:0/1609601093 conn(0x7f7a5c0ceea0 msgr2=0x7f7a5c0acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 shutdown_connections 2023-12-19T16:18:28.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:28.866+0000 7f7a631a2640 1 -- 172.21.15.119:0/1609601093 wait complete. 2023-12-19T16:18:28.893 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T16:18:29.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b7d266640 1 Processor -- start 2023-12-19T16:18:29.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b7d266640 1 -- start start 2023-12-19T16:18:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b7d266640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b780cf0d0 0x7f8b780cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b7d266640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b780cfa70 con 0x7f8b781648d0 2023-12-19T16:18:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b7d266640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b780d11c0 con 0x7f8b7815ca40 2023-12-19T16:18:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b7d266640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780d0310 con 0x7f8b780cf0d0 2023-12-19T16:18:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b767fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b780cf0d0 0x7f8b780cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b777fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8b781648d0 0x7f8b78166cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38300/0 (socket says 172.21.15.119:38300) 2023-12-19T16:18:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b767fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b780cf0d0 0x7f8b780cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50328/0 (socket says 172.21.15.119:50328) 2023-12-19T16:18:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b777fe640 1 -- 172.21.15.119:0/1654273040 learned_addr learned my addr 172.21.15.119:0/1654273040 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b767fc640 1 -- 172.21.15.119:0/1654273040 >> v1:172.21.15.143:6789/0 conn(0x7f8b7815ca40 legacy=0x7f8b780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b767fc640 1 -- 172.21.15.119:0/1654273040 >> v1:172.21.15.119:6789/0 conn(0x7f8b781648d0 legacy=0x7f8b78166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b75ffb640 1 -- 172.21.15.119:0/1654273040 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221996942 0 0) 0x7f8b780cfa70 con 0x7f8b781648d0 2023-12-19T16:18:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.026+0000 7f8b767fc640 1 -- 172.21.15.119:0/1654273040 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780d05b0 con 0x7f8b780cf0d0 2023-12-19T16:18:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b767fc640 1 --2- 172.21.15.119:0/1654273040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b780cf0d0 0x7f8b780cf530 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097a0 tx=0x7f8b6c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e448e0db4824cc9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b75ffb640 1 -- 172.21.15.119:0/1654273040 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0a7070 con 0x7f8b780cf0d0 2023-12-19T16:18:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b75ffb640 1 -- 172.21.15.119:0/1654273040 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c0ab430 con 0x7f8b780cf0d0 2023-12-19T16:18:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b75ffb640 1 -- 172.21.15.119:0/1654273040 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0ab7c0 con 0x7f8b780cf0d0 2023-12-19T16:18:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 -- 172.21.15.119:0/1654273040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b780cf0d0 msgr2=0x7f8b780cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 --2- 172.21.15.119:0/1654273040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b780cf0d0 0x7f8b780cf530 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097a0 tx=0x7f8b6c01c430 comp rx=0 tx=0).stop 2023-12-19T16:18:29.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 -- 172.21.15.119:0/1654273040 shutdown_connections 2023-12-19T16:18:29.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 --2- 172.21.15.119:0/1654273040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b780cf0d0 0x7f8b780cf530 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 -- 172.21.15.119:0/1654273040 >> 172.21.15.119:0/1654273040 conn(0x7f8b78089fb0 msgr2=0x7f8b780d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 -- 172.21.15.119:0/1654273040 shutdown_connections 2023-12-19T16:18:29.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.030+0000 7f8b7d266640 1 -- 172.21.15.119:0/1654273040 wait complete. 2023-12-19T16:18:29.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 Processor -- start 2023-12-19T16:18:29.038 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 -- start start 2023-12-19T16:18:29.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b780cf0d0 0x7f8b7815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b7815ca40 0x7f8b7815e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 0x7f8b7814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780c6250 con 0x7f8b781648d0 2023-12-19T16:18:29.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780b0120 con 0x7f8b780cf0d0 2023-12-19T16:18:29.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780b0400 con 0x7f8b7815ca40 2023-12-19T16:18:29.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 0x7f8b7814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 0x7f8b7814fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50342/0 (socket says 172.21.15.119:50342) 2023-12-19T16:18:29.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 -- 172.21.15.119:0/2407202738 learned_addr learned my addr 172.21.15.119:0/2407202738 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:29.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b76ffd640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b780cf0d0 0x7f8b7815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b767fc640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b7815ca40 0x7f8b7815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 -- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b7815ca40 msgr2=0x7f8b7815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b7815ca40 0x7f8b7815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 -- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b780cf0d0 msgr2=0x7f8b7815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b780cf0d0 0x7f8b7815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 -- 172.21.15.119:0/2407202738 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0093b0 con 0x7f8b781648d0 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b777fe640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 0x7f8b7814fca0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c780 tx=0x7f8b7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70004d70 con 0x7f8b781648d0 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7000a640 con 0x7f8b781648d0 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7815d250 con 0x7f8b781648d0 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000a9f0 con 0x7f8b781648d0 2023-12-19T16:18:29.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.034+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7815fd40 con 0x7f8b781648d0 2023-12-19T16:18:29.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.038+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7804e000 con 0x7f8b781648d0 2023-12-19T16:18:29.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.038+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8b7000ab50 con 0x7f8b781648d0 2023-12-19T16:18:29.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.038+0000 7f8b5f7fe640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8b64065a60 0x7f8b64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.038+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8b70082540 con 0x7f8b781648d0 2023-12-19T16:18:29.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.038+0000 7f8b76ffd640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8b64065a60 0x7f8b64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.045 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.038+0000 7f8b76ffd640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8b64065a60 0x7f8b64067f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b78168190 tx=0x7f8b68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.042+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8b70050200 con 0x7f8b781648d0 2023-12-19T16:18:29.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b780b0290 con 0x7f8b64065a60 2023-12-19T16:18:29.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b5f7fe640 1 -- 172.21.15.119:0/2407202738 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8b780b0290 con 0x7f8b64065a60 2023-12-19T16:18:29.198 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T16:18:29.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8b64065a60 msgr2=0x7f8b64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8b64065a60 0x7f8b64067f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b78168190 tx=0x7f8b68009040 comp rx=0 tx=0).stop 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 msgr2=0x7f8b7814fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 0x7f8b7814fca0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c780 tx=0x7f8b7000cc40 comp rx=0 tx=0).stop 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 shutdown_connections 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f8b64065a60 0x7f8b64067f20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b781648d0 0x7f8b7814fca0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b7815ca40 0x7f8b7815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 --2- 172.21.15.119:0/2407202738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b780cf0d0 0x7f8b7815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 >> 172.21.15.119:0/2407202738 conn(0x7f8b78089fb0 msgr2=0x7f8b780b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 shutdown_connections 2023-12-19T16:18:29.201 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.194+0000 7f8b7d266640 1 -- 172.21.15.119:0/2407202738 wait complete. 2023-12-19T16:18:29.218 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T16:18:29.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 Processor -- start 2023-12-19T16:18:29.362 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 -- start start 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3d9415da20 0x7f3d940cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d940cd000 0x7f3d940ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940d0200 con 0x7f3d940d0f60 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940cd850 con 0x7f3d940cd000 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9ae2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940d0b40 con 0x7f3d9415da20 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d99627640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3d940d0f60 0x7f3d940cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38312/0 (socket says 172.21.15.119:38312) 2023-12-19T16:18:29.363 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d99627640 1 -- 172.21.15.119:0/3973729819 learned_addr learned my addr 172.21.15.119:0/3973729819 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:29.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9a629640 1 --2- 172.21.15.119:0/3973729819 >> v2:172.21.15.119:3300/0 conn(0x7f3d940cd000 0x7f3d940ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d99e28640 1 --2- 172.21.15.119:0/3973729819 >> v2:172.21.15.143:3300/0 conn(0x7f3d9415da20 0x7f3d940cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d98e26640 1 -- 172.21.15.119:0/3973729819 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364224324 0 0) 0x7f3d940d0200 con 0x7f3d940d0f60 2023-12-19T16:18:29.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d98e26640 1 -- 172.21.15.119:0/3973729819 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80003530 con 0x7f3d940d0f60 2023-12-19T16:18:29.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9a629640 1 -- 172.21.15.119:0/3973729819 >> v2:172.21.15.143:3300/0 conn(0x7f3d9415da20 msgr2=0x7f3d940cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:29.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9a629640 1 --2- 172.21.15.119:0/3973729819 >> v2:172.21.15.143:3300/0 conn(0x7f3d9415da20 0x7f3d940cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9a629640 1 -- 172.21.15.119:0/3973729819 >> v1:172.21.15.119:6789/0 conn(0x7f3d940d0f60 legacy=0x7f3d940cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.365 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.358+0000 7f3d9a629640 1 -- 172.21.15.119:0/3973729819 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9415de00 con 0x7f3d940cd000 2023-12-19T16:18:29.366 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9a629640 1 --2- 172.21.15.119:0/3973729819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d940ce4f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3d940b21f0 tx=0x7f3d8c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6bd06e42d3dec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d98e26640 1 -- 172.21.15.119:0/3973729819 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0a5850 con 0x7f3d940cd000 2023-12-19T16:18:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d98e26640 1 -- 172.21.15.119:0/3973729819 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0a59b0 con 0x7f3d940cd000 2023-12-19T16:18:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d98e26640 1 -- 172.21.15.119:0/3973729819 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0a5d40 con 0x7f3d940cd000 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/3973729819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 msgr2=0x7f3d940ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 --2- 172.21.15.119:0/3973729819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d940ce4f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3d940b21f0 tx=0x7f3d8c01c880 comp rx=0 tx=0).stop 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/3973729819 shutdown_connections 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 --2- 172.21.15.119:0/3973729819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d940ce4f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 --2- 172.21.15.119:0/3973729819 >> v2:172.21.15.143:3300/0 conn(0x7f3d9415da20 0x7f3d940cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/3973729819 >> 172.21.15.119:0/3973729819 conn(0x7f3d94069ca0 msgr2=0x7f3d9406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/3973729819 shutdown_connections 2023-12-19T16:18:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.362+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/3973729819 wait complete. 2023-12-19T16:18:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 Processor -- start 2023-12-19T16:18:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- start start 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d9414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d940d0f60 0x7f3d9406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d9415da20 0x7f3d9406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c3f10 con 0x7f3d940cd000 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94159a30 con 0x7f3d940d0f60 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94159d10 con 0x7f3d9415da20 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d9414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d9414a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50360/0 (socket says 172.21.15.119:50360) 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 -- 172.21.15.119:0/4058416669 learned_addr learned my addr 172.21.15.119:0/4058416669 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99627640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d940d0f60 0x7f3d9406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9a629640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d9415da20 0x7f3d9406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 -- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d9415da20 msgr2=0x7f3d9406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d9415da20 0x7f3d9406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 -- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d940d0f60 msgr2=0x7f3d9406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d940d0f60 0x7f3d9406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 -- 172.21.15.119:0/4058416669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c009a70 con 0x7f3d940cd000 2023-12-19T16:18:29.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d99e28640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d9414a570 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e870 tx=0x7f3d9000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90009510 con 0x7f3d940cd000 2023-12-19T16:18:29.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000eec0 con 0x7f3d940cd000 2023-12-19T16:18:29.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94159ff0 con 0x7f3d940cd000 2023-12-19T16:18:29.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000cb40 con 0x7f3d940cd000 2023-12-19T16:18:29.374 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94157890 con 0x7f3d940cd000 2023-12-19T16:18:29.375 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.366+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d940d0760 con 0x7f3d940cd000 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d9000cca0 con 0x7f3d940cd000 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d78065a60 0x7f3d78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3d90083110 con 0x7f3d940cd000 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d99627640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d78065a60 0x7f3d78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7f3d7806bd60 0x7f3d7806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 --> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d7806e870 con 0x7f3d7806bd60 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d900856f0 con 0x7f3d940cd000 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d9a629640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7f3d7806bd60 0x7f3d7806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d99627640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d78065a60 0x7f3d78067f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d940b1fc0 tx=0x7f3d84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d9a629640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7f3d7806bd60 0x7f3d7806e1a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.377 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.370+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== osd.7 v2:172.21.15.143:6800/38348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d7806e870 con 0x7f3d7806bd60 2023-12-19T16:18:29.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.382+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 --> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3d94159e80 con 0x7f3d7806bd60 2023-12-19T16:18:29.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d8a7fc640 1 -- 172.21.15.119:0/4058416669 <== osd.7 v2:172.21.15.143:6800/38348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3d94159e80 con 0x7f3d7806bd60 2023-12-19T16:18:29.389 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-19T16:18:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:29.390 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7f3d7806bd60 msgr2=0x7f3d7806e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.143:6800/38348,v1:172.21.15.143:6801/38348] conn(0x7f3d7806bd60 0x7f3d7806e1a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d78065a60 msgr2=0x7f3d78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f3d78065a60 0x7f3d78067f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d940b1fc0 tx=0x7f3d84009040 comp rx=0 tx=0).stop 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 msgr2=0x7f3d9414a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 --2- 172.21.15.119:0/4058416669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d940cd000 0x7f3d9414a570 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e870 tx=0x7f3d9000ec70 comp rx=0 tx=0).stop 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9a629640 1 -- 172.21.15.119:0/4058416669 reap_dead start 2023-12-19T16:18:29.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 shutdown_connections 2023-12-19T16:18:29.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 >> 172.21.15.119:0/4058416669 conn(0x7f3d94069ca0 msgr2=0x7f3d9406b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 shutdown_connections 2023-12-19T16:18:29.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.386+0000 7f3d9ae2a640 1 -- 172.21.15.119:0/4058416669 wait complete. 2023-12-19T16:18:29.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T16:18:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 Processor -- start 2023-12-19T16:18:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 -- start start 2023-12-19T16:18:29.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b81570c0 0x7f28b806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28b806c320 0x7f28b80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80c9460 con 0x7f28b80c9e30 2023-12-19T16:18:29.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b806c7a0 con 0x7f28b806c320 2023-12-19T16:18:29.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28becc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b81574a0 con 0x7f28b81570c0 2023-12-19T16:18:29.548 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28b806c320 0x7f28b80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28b806c320 0x7f28b80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50366/0 (socket says 172.21.15.119:50366) 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28bd261640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f28b80c9e30 0x7f28b815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38324/0 (socket says 172.21.15.119:38324) 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 -- 172.21.15.119:0/2366413496 learned_addr learned my addr 172.21.15.119:0/2366413496 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28bca60640 1 --2- 172.21.15.119:0/2366413496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b81570c0 0x7f28b806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 -- 172.21.15.119:0/2366413496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b81570c0 msgr2=0x7f28b806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 --2- 172.21.15.119:0/2366413496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b81570c0 0x7f28b806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 -- 172.21.15.119:0/2366413496 >> v1:172.21.15.119:6789/0 conn(0x7f28b80c9e30 legacy=0x7f28b815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b7fff640 1 -- 172.21.15.119:0/2366413496 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80c8b30 con 0x7f28b806c320 2023-12-19T16:18:29.549 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.542+0000 7f28b77fe640 1 -- 172.21.15.119:0/2366413496 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241626827 0 0) 0x7f28b80c9460 con 0x7f28b80c9e30 2023-12-19T16:18:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28b7fff640 1 --2- 172.21.15.119:0/2366413496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b806c320 0x7f28b80c98f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009870 tx=0x7f28a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4be6fe2d2509945 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28b77fe640 1 -- 172.21.15.119:0/2366413496 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40ad640 con 0x7f28b806c320 2023-12-19T16:18:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28b77fe640 1 -- 172.21.15.119:0/2366413496 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a40ad7a0 con 0x7f28b806c320 2023-12-19T16:18:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28b77fe640 1 -- 172.21.15.119:0/2366413496 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40adb30 con 0x7f28b806c320 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 -- 172.21.15.119:0/2366413496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b806c320 msgr2=0x7f28b80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 --2- 172.21.15.119:0/2366413496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b806c320 0x7f28b80c98f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009870 tx=0x7f28a401c480 comp rx=0 tx=0).stop 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 -- 172.21.15.119:0/2366413496 shutdown_connections 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 --2- 172.21.15.119:0/2366413496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b806c320 0x7f28b80c98f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 --2- 172.21.15.119:0/2366413496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b81570c0 0x7f28b806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 -- 172.21.15.119:0/2366413496 >> 172.21.15.119:0/2366413496 conn(0x7f28b806a3e0 msgr2=0x7f28b80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 -- 172.21.15.119:0/2366413496 shutdown_connections 2023-12-19T16:18:29.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.546+0000 7f28becc4640 1 -- 172.21.15.119:0/2366413496 wait complete. 2023-12-19T16:18:29.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 Processor -- start 2023-12-19T16:18:29.553 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- start start 2023-12-19T16:18:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28b806c320 0x7f28b814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b80c9e30 0x7f28b80c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 0x7f28b80c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b814f1f0 con 0x7f28b81570c0 2023-12-19T16:18:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80cb2c0 con 0x7f28b806c320 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80cb5a0 con 0x7f28b80c9e30 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 0x7f28b80c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 0x7f28b80c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50382/0 (socket says 172.21.15.119:50382) 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 -- 172.21.15.119:0/1771543029 learned_addr learned my addr 172.21.15.119:0/1771543029 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28b7fff640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b80c9e30 0x7f28b80c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bca60640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28b806c320 0x7f28b814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 -- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b80c9e30 msgr2=0x7f28b80c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b80c9e30 0x7f28b80c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 -- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28b806c320 msgr2=0x7f28b814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28b806c320 0x7f28b814ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 -- 172.21.15.119:0/1771543029 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a40094d0 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28bd261640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 0x7f28b80c5990 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f28b0001570 tx=0x7f28b000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000a640 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b000a7c0 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000ab70 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80cb880 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80cbe40 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.550+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b80735b0 con 0x7f28b81570c0 2023-12-19T16:18:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.554+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28b000acd0 con 0x7f28b81570c0 2023-12-19T16:18:29.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.554+0000 7f28b57fa640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f289c065ae0 0x7f289c067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.554+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f28b0082830 con 0x7f28b81570c0 2023-12-19T16:18:29.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.554+0000 7f28bca60640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f289c065ae0 0x7f289c067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.554+0000 7f28bca60640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f289c065ae0 0x7f289c067fa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f28b8150000 tx=0x7f28ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.562 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.558+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f28b00504d0 con 0x7f28b81570c0 2023-12-19T16:18:29.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.706+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f28b80cb710 con 0x7f289c065ae0 2023-12-19T16:18:29.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.706+0000 7f28b57fa640 1 -- 172.21.15.119:0/1771543029 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28b80cb710 con 0x7f289c065ae0 2023-12-19T16:18:29.713 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f289c065ae0 msgr2=0x7f289c067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f289c065ae0 0x7f289c067fa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f28b8150000 tx=0x7f28ac009190 comp rx=0 tx=0).stop 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 msgr2=0x7f28b80c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 0x7f28b80c5990 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f28b0001570 tx=0x7f28b000cca0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 shutdown_connections 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f289c065ae0 0x7f289c067fa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b81570c0 0x7f28b80c5990 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.715 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28b80c9e30 0x7f28b80c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 --2- 172.21.15.119:0/1771543029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28b806c320 0x7f28b814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 >> 172.21.15.119:0/1771543029 conn(0x7f28b806a3e0 msgr2=0x7f28b8159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 shutdown_connections 2023-12-19T16:18:29.716 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.710+0000 7f28becc4640 1 -- 172.21.15.119:0/1771543029 wait complete. 2023-12-19T16:18:29.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:29.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 Processor -- start 2023-12-19T16:18:29.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 -- start start 2023-12-19T16:18:29.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb400cf0d0 0x7fbb400cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb401648d0 0x7fbb40166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb400cfa70 con 0x7fbb4015ca40 2023-12-19T16:18:29.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb400d11c0 con 0x7fbb400cf0d0 2023-12-19T16:18:29.872 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb45509640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400d0310 con 0x7fbb401648d0 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb367fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb400cf0d0 0x7fbb400cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb401648d0 0x7fbb40166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb367fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb400cf0d0 0x7fbb400cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.119:58932/0 (socket says 172.21.15.119:58932) 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb367fc640 1 -- 172.21.15.119:0/4045726379 learned_addr learned my addr 172.21.15.119:0/4045726379 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/4045726379 >> v2:172.21.15.143:3300/0 conn(0x7fbb400cf0d0 msgr2=0x7fbb400cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb3f7fe640 1 --2- 172.21.15.119:0/4045726379 >> v2:172.21.15.143:3300/0 conn(0x7fbb400cf0d0 0x7fbb400cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/4045726379 >> v1:172.21.15.143:6789/0 conn(0x7fbb4015ca40 legacy=0x7fbb400cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.866+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/4045726379 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb400d05b0 con 0x7fbb401648d0 2023-12-19T16:18:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb3f7fe640 1 --2- 172.21.15.119:0/4045726379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb401648d0 0x7fbb40166cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb380097c0 tx=0x7fbb3801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15bb6f06b1ff04f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb3e7fc640 1 -- 172.21.15.119:0/4045726379 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380ab650 con 0x7fbb401648d0 2023-12-19T16:18:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb3e7fc640 1 -- 172.21.15.119:0/4045726379 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380ab7b0 con 0x7fbb401648d0 2023-12-19T16:18:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb3e7fc640 1 -- 172.21.15.119:0/4045726379 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380abb40 con 0x7fbb401648d0 2023-12-19T16:18:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 -- 172.21.15.119:0/4045726379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb401648d0 msgr2=0x7fbb40166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 --2- 172.21.15.119:0/4045726379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb401648d0 0x7fbb40166cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb380097c0 tx=0x7fbb3801c450 comp rx=0 tx=0).stop 2023-12-19T16:18:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 -- 172.21.15.119:0/4045726379 shutdown_connections 2023-12-19T16:18:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 --2- 172.21.15.119:0/4045726379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb401648d0 0x7fbb40166cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 --2- 172.21.15.119:0/4045726379 >> v2:172.21.15.143:3300/0 conn(0x7fbb400cf0d0 0x7fbb400cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 -- 172.21.15.119:0/4045726379 >> 172.21.15.119:0/4045726379 conn(0x7fbb40089fb0 msgr2=0x7fbb400d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 -- 172.21.15.119:0/4045726379 shutdown_connections 2023-12-19T16:18:29.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.870+0000 7fbb45509640 1 -- 172.21.15.119:0/4045726379 wait complete. 2023-12-19T16:18:29.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 Processor -- start 2023-12-19T16:18:29.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 -- start start 2023-12-19T16:18:29.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb400cf0d0 0x7fbb40157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb4015ca40 0x7fbb401579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 0x7fbb4015eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40164e50 con 0x7fbb401648d0 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40165130 con 0x7fbb4015ca40 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40165410 con 0x7fbb400cf0d0 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 0x7fbb4015eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 0x7fbb4015eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50392/0 (socket says 172.21.15.119:50392) 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/120610806 learned_addr learned my addr 172.21.15.119:0/120610806 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb367fc640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb4015ca40 0x7fbb401579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3effd640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb400cf0d0 0x7fbb40157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb400cf0d0 msgr2=0x7fbb40157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb400cf0d0 0x7fbb40157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb4015ca40 msgr2=0x7fbb401579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb4015ca40 0x7fbb401579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 -- 172.21.15.119:0/120610806 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38009420 con 0x7fbb401648d0 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb3f7fe640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 0x7fbb4015eed0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fbb3801ab00 tx=0x7fbb380191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380abdf0 con 0x7fbb401648d0 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380bf450 con 0x7fbb401648d0 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380bf800 con 0x7fbb401648d0 2023-12-19T16:18:29.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb401656f0 con 0x7fbb401648d0 2023-12-19T16:18:29.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.874+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb40156080 con 0x7fbb401648d0 2023-12-19T16:18:29.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.878+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb40165930 con 0x7fbb401648d0 2023-12-19T16:18:29.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.878+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb380bf960 con 0x7fbb401648d0 2023-12-19T16:18:29.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.878+0000 7fbb37fff640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb20065a60 0x7fbb20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.878+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbb3811daf0 con 0x7fbb401648d0 2023-12-19T16:18:29.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.878+0000 7fbb3effd640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb20065a60 0x7fbb20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.878+0000 7fbb3effd640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb20065a60 0x7fbb20067f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000fc0 tx=0x7fbb30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.887 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:29.882+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb40165930 con 0x7fbb401648d0 2023-12-19T16:18:30.037 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.034+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb401652a0 con 0x7fbb20065a60 2023-12-19T16:18:30.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.034+0000 7fbb37fff640 1 -- 172.21.15.119:0/120610806 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50414 (secure 0 0 0) 0x7fbb401652a0 con 0x7fbb20065a60 2023-12-19T16:18:30.040 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:30.040 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:18:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb20065a60 msgr2=0x7fbb20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb20065a60 0x7fbb20067f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000fc0 tx=0x7fbb30009040 comp rx=0 tx=0).stop 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 msgr2=0x7fbb4015eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 0x7fbb4015eed0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fbb3801ab00 tx=0x7fbb380191f0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 shutdown_connections 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fbb20065a60 0x7fbb20067f20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb4015ca40 0x7fbb401579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb401648d0 0x7fbb4015eed0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 --2- 172.21.15.119:0/120610806 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb400cf0d0 0x7fbb40157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 >> 172.21.15.119:0/120610806 conn(0x7fbb40089fb0 msgr2=0x7fbb4015bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:30.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 shutdown_connections 2023-12-19T16:18:30.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:30.038+0000 7fbb45509640 1 -- 172.21.15.119:0/120610806 wait complete. 2023-12-19T16:18:30.061 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-12-19T16:18:28.487871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222280,"kb_used_data":6664,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752440,"statfs":{"total":773094113280,"available":772866498560,"internally_reserved":0,"allocated":6823936,"data_stored":3690256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.200918"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-19T16:18:20.443042+0000","last_change":"2023-12-19T16:15:10.160922+0000","last_active":"2023-12-19T16:18:20.443042+0000","last_peered":"2023-12-19T16:18:20.443042+0000","last_clean":"2023-12-19T16:18:20.443042+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:18:20.443042+0000","last_undegraded":"2023-12-19T16:18:20.443042+0000","last_fullsized":"2023-12-19T16:18:20.443042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:08.709675+0000","last_clean_scrub_stamp":"2023-12-19T16:15:08.709675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:03.106448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":904058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.77700000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.88400000000000001,"5min":1.05,"15min":1.05},"last":0.753},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73699999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.56799999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.87,"5min":1.006,"15min":1.006},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67300000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93999999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.495},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98299999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90000000000000002,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96399999999999997,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71499999999999997,"15min":0.76200000000000001},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81999999999999995,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.90400000000000003}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.97499999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90100000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.78900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.874,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0469999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.873}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.125,"15min":1.125},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.50900000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1.641,"15min":1.641},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.75900000000000001,"15min":0.80800000000000005},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93700000000000006,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.625}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.92700000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.81399999999999995,"15min":0.91800000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66700000000000004,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80000000000000004,"5min":1.135,"15min":1.135},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90200000000000002,"5min":1.74,"15min":1.74},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81999999999999995,"5min":1.115,"15min":1.115},"last":0.60699999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":0.997,"15min":0.997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94499999999999995,"5min":1.179,"15min":1.179},"last":0.85699999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0109999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85899999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71399999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.002,"15min":1.002},"last":0.90100000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.874}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.56000000000000005,"15min":0.63200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77400000000000002,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.78900000000000003,"15min":0.95199999999999996},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.497}]},{"osd":1,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.51400000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51400000000000001,"5min":2.577,"15min":2.577},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.78700000000000003,"15min":0.92700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.59499999999999997,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.63500000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.85999999999999999,"15min":1.018},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.57899999999999996,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68200000000000005,"5min":2.907,"15min":2.907},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85699999999999998,"15min":0.90300000000000002},"min":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95599999999999996,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.88500000000000001},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97699999999999998,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95499999999999996,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.022},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99299999999999999,"5min":1.708,"15min":1.708},"last":0.94099999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82799999999999996,"15min":0.872},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95499999999999996,"5min":2.742,"15min":2.742},"last":0.99199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49199999999999999,"15min":0.53100000000000003},"min":{"1min":0.255,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71799999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.313},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.56399999999999995,"15min":0.61899999999999999},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.55200000000000005,"15min":0.60399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57399999999999995,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60999999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.437}]},{"osd":3,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50700000000000001,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63200000000000001,"5min":1.962,"15min":1.962},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":1.974,"15min":1.974},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.105,"5min":1.877,"15min":1.877},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.81599999999999995,"15min":0.873},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.82699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0660000000000001,"5min":1.655,"15min":1.655},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81599999999999995,"15min":0.85799999999999998},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0860000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1299999999999999,"5min":2.032,"15min":2.032},"last":0.628},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.159,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.872,"15min":0.93600000000000005},"min":{"1min":0.56200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.091,"5min":2.706,"15min":2.706},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.22,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.77400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.434,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.53900000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.38200000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65000000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.623}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95899999999999996,"5min":1.054,"15min":1.054},"last":0.65800000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.55300000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.012,"5min":1.502,"15min":1.502},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1479999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":904058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.44500000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.39300000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.437},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81999999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.46,"15min":1.46},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":1.093,"15min":1.093},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.752}]},{"osd":6,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":1.506,"15min":1.506},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.133,"15min":1.133},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.749,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:30.066 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T16:15:08.709675+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=16, tm_min=15, tm_sec=8, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=16, tm_min=18, tm_sec=24, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T16:18:30.066 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T16:18:48.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:48.875 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:50.067 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:50.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f5818473640 1 Processor -- start 2023-12-19T16:18:50.216 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f5818473640 1 -- start start 2023-12-19T16:18:50.218 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f5818473640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f58100ca000 0x7f5810164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f5818473640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58100c9460 con 0x7f58101570c0 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f5818473640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58101574a0 con 0x7f581006c4f0 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f5818473640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100c8b30 con 0x7f58100ca000 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.210+0000 7f581620f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f58101570c0 0x7f581006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:57544/0 (socket says 172.21.15.119:57544) 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 -- 172.21.15.119:0/2850166355 learned_addr learned my addr 172.21.15.119:0/2850166355 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037417303 0 0) 0x7f58100c9460 con 0x7f58101570c0 2023-12-19T16:18:50.219 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f5816a10640 1 --2- 172.21.15.119:0/2850166355 >> v2:172.21.15.143:3300/0 conn(0x7f58100ca000 0x7f5810164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57fc005740 con 0x7f58101570c0 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672189899 0 0) 0x7f57fc005740 con 0x7f58101570c0 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 >> v2:172.21.15.143:3300/0 conn(0x7f58100ca000 msgr2=0x7f5810164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 --2- 172.21.15.119:0/2850166355 >> v2:172.21.15.143:3300/0 conn(0x7f58100ca000 0x7f5810164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 >> v1:172.21.15.143:6789/0 conn(0x7f581006c4f0 legacy=0x7f58100c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100c8e10 con 0x7f58101570c0 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1102317365 0 0) 0x7f580c001680 con 0x7f58101570c0 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 >> v1:172.21.15.119:6789/0 conn(0x7f58101570c0 legacy=0x7f581006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.220 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f57fc005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57fc0069e0 0x7f57fc006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57fc0073a0 0x7f57fc00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100c8b30 con 0x7f57fc005b90 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc00e340 con 0x7f57fc0073a0 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc00e500 con 0x7f57fc0069e0 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f57fc005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f5816a10640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57fc0073a0 0x7f57fc00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f5815a0e640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57fc0069e0 0x7f57fc006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.221 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 -- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57fc0069e0 msgr2=0x7f57fc006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:50.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57fc0069e0 0x7f57fc006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 -- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57fc0073a0 msgr2=0x7f57fc00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:50.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57fc0073a0 0x7f57fc00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f581620f640 1 -- 172.21.15.119:0/2850166355 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc005740 con 0x7f57fc005b90 2023-12-19T16:18:50.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f5816a10640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57fc0073a0 0x7f57fc00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:50.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.214+0000 7f5816a10640 1 -- 172.21.15.119:0/2850166355 reap_dead start 2023-12-19T16:18:50.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f581620f640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f57fc005fb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c240 tx=0x7f580c01cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f0fe4f8bd186c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c005ae0 con 0x7f57fc005b90 2023-12-19T16:18:50.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c005c40 con 0x7f57fc005b90 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f581520d640 1 -- 172.21.15.119:0/2850166355 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c0a6a10 con 0x7f57fc005b90 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 -- 172.21.15.119:0/2850166355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 msgr2=0x7f57fc005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f57fc005fb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c240 tx=0x7f580c01cc90 comp rx=0 tx=0).stop 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 -- 172.21.15.119:0/2850166355 shutdown_connections 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 --2- 172.21.15.119:0/2850166355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f57fc005fb0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 -- 172.21.15.119:0/2850166355 >> 172.21.15.119:0/2850166355 conn(0x7f581006a3e0 msgr2=0x7f58100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 -- 172.21.15.119:0/2850166355 shutdown_connections 2023-12-19T16:18:50.224 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 -- 172.21.15.119:0/2850166355 wait complete. 2023-12-19T16:18:50.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 Processor -- start 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.218+0000 7f5818473640 1 -- start start 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f581014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58100cc9a0 0x7f5810158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58100cce20 0x7f5810159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100c6670 con 0x7f57fc005b90 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100c6f10 con 0x7f58100cce20 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100cd380 con 0x7f58100cc9a0 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f581014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f581014a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35326/0 (socket says 172.21.15.119:35326) 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 -- 172.21.15.119:0/3532908293 learned_addr learned my addr 172.21.15.119:0/3532908293 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5815a0e640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58100cc9a0 0x7f5810158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5816a10640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58100cce20 0x7f5810159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 -- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58100cc9a0 msgr2=0x7f5810158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58100cc9a0 0x7f5810158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 -- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58100cce20 msgr2=0x7f5810159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58100cce20 0x7f5810159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 -- 172.21.15.119:0/3532908293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100c68c0 con 0x7f57fc005b90 2023-12-19T16:18:50.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5816a10640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58100cce20 0x7f5810159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:50.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f581620f640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f581014a8d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c240 tx=0x7f57fc007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c0b5070 con 0x7f57fc005b90 2023-12-19T16:18:50.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c0a67d0 con 0x7f57fc005b90 2023-12-19T16:18:50.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c0a6b80 con 0x7f57fc005b90 2023-12-19T16:18:50.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58100c6ba0 con 0x7f57fc005b90 2023-12-19T16:18:50.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58101f4e60 con 0x7f57fc005b90 2023-12-19T16:18:50.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58100735b0 con 0x7f57fc005b90 2023-12-19T16:18:50.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.222+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f580c0a6ce0 con 0x7f57fc005b90 2023-12-19T16:18:50.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.226+0000 7f5806ffd640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f57f4065a90 0x7f57f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.226+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f580c11de10 con 0x7f57fc005b90 2023-12-19T16:18:50.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.226+0000 7f5815a0e640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f57f4065a90 0x7f57f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.226+0000 7f5815a0e640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f57f4065a90 0x7f57f4067f50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5800007fd0 tx=0x7f5800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.230+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f580c121030 con 0x7f57fc005b90 2023-12-19T16:18:50.379 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.374+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 --> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58100c90f0 con 0x7f57f4065a90 2023-12-19T16:18:50.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5806ffd640 1 -- 172.21.15.119:0/3532908293 <== mgr.4107 v2:172.21.15.119:6832/38078 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50279 (secure 0 0 0) 0x7f5800001c50 con 0x7f57f4065a90 2023-12-19T16:18:50.383 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:50.384 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2023-12-19T16:18:50.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f57f4065a90 msgr2=0x7f57f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f57f4065a90 0x7f57f4067f50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5800007fd0 tx=0x7f5800009040 comp rx=0 tx=0).stop 2023-12-19T16:18:50.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 msgr2=0x7f581014a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f581014a8d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c240 tx=0x7f57fc007a10 comp rx=0 tx=0).stop 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 shutdown_connections 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f57f4065a90 0x7f57f4067f50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58100cce20 0x7f5810159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58100cc9a0 0x7f5810158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 --2- 172.21.15.119:0/3532908293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57fc005b90 0x7f581014a8d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 >> 172.21.15.119:0/3532908293 conn(0x7f581006a3e0 msgr2=0x7f581015b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 shutdown_connections 2023-12-19T16:18:50.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.378+0000 7f5818473640 1 -- 172.21.15.119:0/3532908293 wait complete. 2023-12-19T16:18:50.404 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2023-12-19T16:18:48.492643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222280,"kb_used_data":6664,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752440,"statfs":{"total":773094113280,"available":772866498560,"internally_reserved":0,"allocated":6823936,"data_stored":3690256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002995"},"pg_stats":[{"pgid":"1.0","version":"58'119","reported_seq":211,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-19T16:18:29.917546+0000","last_change":"2023-12-19T16:18:29.917666+0000","last_active":"2023-12-19T16:18:29.917546+0000","last_peered":"2023-12-19T16:18:29.917546+0000","last_clean":"2023-12-19T16:18:29.917546+0000","last_became_active":"2023-12-19T16:15:10.159511+0000","last_became_peered":"2023-12-19T16:15:10.159511+0000","last_unstale":"2023-12-19T16:18:29.917546+0000","last_undegraded":"2023-12-19T16:18:29.917546+0000","last_fullsized":"2023-12-19T16:18:29.917546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'119","last_scrub_stamp":"2023-12-19T16:18:29.917519+0000","last_deep_scrub":"58'119","last_deep_scrub_stamp":"2023-12-19T16:18:29.917519+0000","last_clean_scrub_stamp":"2023-12-19T16:18:29.917519+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:01:18.820379+0000","scrub_duration":0.0074612309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":904058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.73699999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.88400000000000001,"5min":1.05,"15min":1.05},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82599999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.753},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90700000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.56799999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.87,"5min":1.006,"15min":1.006},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.85999999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93999999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98299999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.877}]},{"osd":6,"last update":"Tue Dec 19 16:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90000000000000002,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96399999999999997,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71499999999999997,"15min":0.76200000000000001},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81999999999999995,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.91600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.878}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72399999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90100000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.78900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.874,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.79700000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.67300000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0469999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.89700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.125,"15min":1.125},"last":0.499},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.371}]},{"osd":1,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.624}]},{"osd":2,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1.641,"15min":1.641},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.75900000000000001,"15min":0.80800000000000005},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93700000000000006,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.61099999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71399999999999997,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.92700000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.81399999999999995,"15min":0.91800000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":7.1559999999999997,"15min":7.1559999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66700000000000004,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80000000000000004,"5min":1.135,"15min":1.135},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.90200000000000002,"5min":1.74,"15min":1.74},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81999999999999995,"5min":1.115,"15min":1.115},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":0.997,"15min":0.997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94499999999999995,"5min":1.179,"15min":1.179},"last":0.66900000000000004}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0109999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85899999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46100000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.002,"15min":1.002},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.56000000000000005,"15min":0.63200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77400000000000002,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.78900000000000003,"15min":0.95199999999999996},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.51400000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51400000000000001,"5min":2.577,"15min":2.577},"last":0.372},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.78700000000000003,"15min":0.92700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.59499999999999997,"5min":8.1259999999999994,"15min":8.1259999999999994},"last":0.42899999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.85999999999999999,"15min":1.018},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":8.1720000000000006,"15min":8.1720000000000006},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.57899999999999996,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68200000000000005,"5min":2.907,"15min":2.907},"last":0.502}]},{"osd":4,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85699999999999998,"15min":0.90300000000000002},"min":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95599999999999996,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.746},{"interface":"front","average":{"1min":0.754,"5min":0.80900000000000005,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.88500000000000001},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97699999999999998,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95499999999999996,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":0.626},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99299999999999999,"5min":1.708,"15min":1.708},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82799999999999996,"15min":0.872},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95499999999999996,"5min":2.742,"15min":2.742},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49199999999999999,"15min":0.53100000000000003},"min":{"1min":0.255,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71799999999999997,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.56399999999999995,"15min":0.61899999999999999},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.55200000000000005,"15min":0.60399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57399999999999995,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60999999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50700000000000001,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63200000000000001,"5min":1.962,"15min":1.962},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":1.974,"15min":1.974},"last":0.68600000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.105,"5min":1.877,"15min":1.877},"last":1.02},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.81599999999999995,"15min":0.873},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.82699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0660000000000001,"5min":1.655,"15min":1.655},"last":1.034},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81599999999999995,"15min":0.85799999999999998},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0860000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1299999999999999,"5min":2.032,"15min":2.032},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.159,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.97599999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.872,"15min":0.93600000000000005},"min":{"1min":0.56200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.091,"5min":2.706,"15min":2.706},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.22,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.0089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":313690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.434,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.436}]},{"osd":2,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.53900000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65000000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95899999999999996,"5min":1.054,"15min":1.054},"last":0.73799999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.55300000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.012,"5min":1.502,"15min":1.502},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1479999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":904058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.44500000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46000000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.625},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81999999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.46,"15min":1.46},"last":0.434}]},{"osd":4,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":1.093,"15min":1.093},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":1.506,"15min":1.506},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.133,"15min":1.133},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.749,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:50.453 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T16:18:50.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.582+0000 7f5446309640 1 Processor -- start 2023-12-19T16:18:50.588 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.582+0000 7f5446309640 1 -- start start 2023-12-19T16:18:50.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f5446309640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5440153020 0x7f54400c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f5446309640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f54400ceaa0 0x7f5440070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f5446309640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400c9730 con 0x7f54401598d0 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f5446309640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400c8e00 con 0x7f54400ceaa0 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f5446309640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54400c90e0 con 0x7f5440153020 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f54448a6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f54400ceaa0 0x7f5440070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f543f7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f54401598d0 0x7f54400ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:57548/0 (socket says 172.21.15.119:57548) 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f543f7fe640 1 -- 172.21.15.119:0/3121685138 learned_addr learned my addr 172.21.15.119:0/3121685138 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-12-19T16:18:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f543ffff640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5440153020 0x7f54400c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f54448a6640 1 -- 172.21.15.119:0/3121685138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5440153020 msgr2=0x7f54400c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:50.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f54448a6640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5440153020 0x7f54400c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f54448a6640 1 -- 172.21.15.119:0/3121685138 >> v1:172.21.15.119:6789/0 conn(0x7f54401598d0 legacy=0x7f54400ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f54448a6640 1 -- 172.21.15.119:0/3121685138 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400c93c0 con 0x7f54400ceaa0 2023-12-19T16:18:50.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f543effd640 1 -- 172.21.15.119:0/3121685138 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116128387 0 0) 0x7f54400c9730 con 0x7f54401598d0 2023-12-19T16:18:50.592 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f543ffff640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5440153020 0x7f54400c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:50.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.586+0000 7f54448a6640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54400ceaa0 0x7f5440070590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5438009d90 tx=0x7f543801c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adca4381bd058763 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f543effd640 1 -- 172.21.15.119:0/3121685138 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380a5830 con 0x7f54400ceaa0 2023-12-19T16:18:50.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f543effd640 1 -- 172.21.15.119:0/3121685138 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54380a5990 con 0x7f54400ceaa0 2023-12-19T16:18:50.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f543effd640 1 -- 172.21.15.119:0/3121685138 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380a5d20 con 0x7f54400ceaa0 2023-12-19T16:18:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- 172.21.15.119:0/3121685138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54400ceaa0 msgr2=0x7f5440070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54400ceaa0 0x7f5440070590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5438009d90 tx=0x7f543801c7d0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- 172.21.15.119:0/3121685138 shutdown_connections 2023-12-19T16:18:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54400ceaa0 0x7f5440070590 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 --2- 172.21.15.119:0/3121685138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5440153020 0x7f54400c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- 172.21.15.119:0/3121685138 >> 172.21.15.119:0/3121685138 conn(0x7f544006a2a0 msgr2=0x7f54400aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- 172.21.15.119:0/3121685138 shutdown_connections 2023-12-19T16:18:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- 172.21.15.119:0/3121685138 wait complete. 2023-12-19T16:18:50.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 Processor -- start 2023-12-19T16:18:50.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- start start 2023-12-19T16:18:50.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f54400ceaa0 0x7f54401529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5440153020 0x7f544014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 0x7f54401581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544014f940 con 0x7f54401598d0 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544014fc20 con 0x7f5440153020 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.590+0000 7f5446309640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544014ff00 con 0x7f54400ceaa0 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 0x7f54401581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 0x7f54401581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35334/0 (socket says 172.21.15.119:35334) 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 -- 172.21.15.119:0/4104833932 learned_addr learned my addr 172.21.15.119:0/4104833932 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f543ffff640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f54400ceaa0 0x7f54401529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f543f7fe640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5440153020 0x7f544014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 -- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f54400ceaa0 msgr2=0x7f54401529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f54400ceaa0 0x7f54401529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 -- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5440153020 msgr2=0x7f544014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5440153020 0x7f544014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 -- 172.21.15.119:0/4104833932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009a70 con 0x7f54401598d0 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f54448a6640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 0x7f54401581e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f543801a460 tx=0x7f54380195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438003ba0 con 0x7f54401598d0 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438003d00 con 0x7f54401598d0 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54401501e0 con 0x7f54401598d0 2023-12-19T16:18:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380ad850 con 0x7f54401598d0 2023-12-19T16:18:50.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544014e2a0 con 0x7f54401598d0 2023-12-19T16:18:50.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544004e000 con 0x7f54401598d0 2023-12-19T16:18:50.601 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.594+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54380b4070 con 0x7f54401598d0 2023-12-19T16:18:50.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.598+0000 7f543cff9640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f542c065a60 0x7f542c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.598+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f543811dc40 con 0x7f54401598d0 2023-12-19T16:18:50.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.598+0000 7f543ffff640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f542c065a60 0x7f542c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.598+0000 7f543ffff640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f542c065a60 0x7f542c067f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5430006e90 tx=0x7f5430008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.598+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54380eb7e0 con 0x7f54401598d0 2023-12-19T16:18:50.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.750+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5440150690 con 0x7f54401598d0 2023-12-19T16:18:50.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.754+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f54380eb7e0 con 0x7f54401598d0 2023-12-19T16:18:50.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f543cff9640 1 -- 172.21.15.119:0/4104833932 <== mon.0 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f54380eee00 con 0x7f54401598d0 2023-12-19T16:18:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f542c065a60 msgr2=0x7f542c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f542c065a60 0x7f542c067f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5430006e90 tx=0x7f5430008040 comp rx=0 tx=0).stop 2023-12-19T16:18:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 msgr2=0x7f54401581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 0x7f54401581e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f543801a460 tx=0x7f54380195d0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 shutdown_connections 2023-12-19T16:18:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7f542c065a60 0x7f542c067f20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5440153020 0x7f544014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401598d0 0x7f54401581e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 --2- 172.21.15.119:0/4104833932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f54400ceaa0 0x7f54401529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 >> 172.21.15.119:0/4104833932 conn(0x7f544006a2a0 msgr2=0x7f5440156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:50.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 shutdown_connections 2023-12-19T16:18:50.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.758+0000 7f5446309640 1 -- 172.21.15.119:0/4104833932 wait complete. 2023-12-19T16:18:50.784 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:18:50.784 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:50.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a8efc640 1 Processor -- start 2023-12-19T16:18:50.922 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a8efc640 1 -- start start 2023-12-19T16:18:50.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a8efc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe0a40cac10 0x7fe0a415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a8efc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a415f100 con 0x7fe0a415a680 2023-12-19T16:18:50.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a8efc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40ca7d0 con 0x7fe0a406fdb0 2023-12-19T16:18:50.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a8efc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a415e860 con 0x7fe0a40cac10 2023-12-19T16:18:50.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a1d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe0a40cac10 0x7fe0a415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a1d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe0a40cac10 0x7fe0a415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35348/0 (socket says 172.21.15.119:35348) 2023-12-19T16:18:50.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a1d9b640 1 -- 172.21.15.119:0/2060532470 learned_addr learned my addr 172.21.15.119:0/2060532470 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:50.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a1d9b640 1 -- 172.21.15.119:0/2060532470 >> v1:172.21.15.143:6789/0 conn(0x7fe0a406fdb0 legacy=0x7fe0a40c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a1d9b640 1 -- 172.21.15.119:0/2060532470 >> v1:172.21.15.119:6789/0 conn(0x7fe0a415a680 legacy=0x7fe0a415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a159a640 1 -- 172.21.15.119:0/2060532470 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399423146 0 0) 0x7fe0a415f100 con 0x7fe0a415a680 2023-12-19T16:18:50.925 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.918+0000 7fe0a1d9b640 1 -- 172.21.15.119:0/2060532470 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a415eb40 con 0x7fe0a40cac10 2023-12-19T16:18:50.926 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a1d9b640 1 --2- 172.21.15.119:0/2060532470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a40cac10 0x7fe0a415e160 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe098009870 tx=0x7fe09801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e51b27a51f410ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a159a640 1 -- 172.21.15.119:0/2060532470 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980aa610 con 0x7fe0a40cac10 2023-12-19T16:18:50.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a159a640 1 -- 172.21.15.119:0/2060532470 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0980a6040 con 0x7fe0a40cac10 2023-12-19T16:18:50.927 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a159a640 1 -- 172.21.15.119:0/2060532470 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980aa9b0 con 0x7fe0a40cac10 2023-12-19T16:18:50.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 -- 172.21.15.119:0/2060532470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a40cac10 msgr2=0x7fe0a415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/2060532470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a40cac10 0x7fe0a415e160 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe098009870 tx=0x7fe09801c4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.928 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 -- 172.21.15.119:0/2060532470 shutdown_connections 2023-12-19T16:18:50.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/2060532470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a40cac10 0x7fe0a415e160 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 -- 172.21.15.119:0/2060532470 >> 172.21.15.119:0/2060532470 conn(0x7fe0a406a3e0 msgr2=0x7fe0a40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:50.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 -- 172.21.15.119:0/2060532470 shutdown_connections 2023-12-19T16:18:50.929 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.922+0000 7fe0a8efc640 1 -- 172.21.15.119:0/2060532470 wait complete. 2023-12-19T16:18:50.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 Processor -- start 2023-12-19T16:18:50.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- start start 2023-12-19T16:18:50.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a406fdb0 0x7fe0a41529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a40cac10 0x7fe0a4157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 0x7fe0a4153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c5750 con 0x7fe0a415a680 2023-12-19T16:18:50.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4158820 con 0x7fe0a406fdb0 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4157f80 con 0x7fe0a40cac10 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 0x7fe0a4153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 0x7fe0a4153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35354/0 (socket says 172.21.15.119:35354) 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 -- 172.21.15.119:0/3821519830 learned_addr learned my addr 172.21.15.119:0/3821519830 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a259c640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a406fdb0 0x7fe0a41529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a1d9b640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a40cac10 0x7fe0a4157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 -- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a40cac10 msgr2=0x7fe0a4157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a40cac10 0x7fe0a4157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 -- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a406fdb0 msgr2=0x7fe0a41529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a406fdb0 0x7fe0a41529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 -- 172.21.15.119:0/3821519830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980094d0 con 0x7fe0a415a680 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a2d9d640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 0x7fe0a4153b00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c760 tx=0x7fe09c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c003b80 con 0x7fe0a415a680 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe09c003ce0 con 0x7fe0a415a680 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a4070750 con 0x7fe0a415a680 2023-12-19T16:18:50.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00aa50 con 0x7fe0a415a680 2023-12-19T16:18:50.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a40c5960 con 0x7fe0a415a680 2023-12-19T16:18:50.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.926+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a40735b0 con 0x7fe0a415a680 2023-12-19T16:18:50.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.930+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe09c00abb0 con 0x7fe0a415a680 2023-12-19T16:18:50.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.930+0000 7fe092ffd640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe084065a60 0x7fe084067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:50.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.930+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe09c082d80 con 0x7fe0a415a680 2023-12-19T16:18:50.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.930+0000 7fe0a259c640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe084065a60 0x7fe084067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:50.936 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.930+0000 7fe0a259c640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe084065a60 0x7fe084067f20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe094000f70 tx=0x7fe094009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:50.938 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:50.934+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe09c050880 con 0x7fe0a415a680 2023-12-19T16:18:51.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0a4158370 con 0x7fe0a415a680 2023-12-19T16:18:51.119 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe092ffd640 1 -- 172.21.15.119:0/3821519830 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe09c00ae60 con 0x7fe0a415a680 2023-12-19T16:18:51.120 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-19T16:18:51.120 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3804987155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3804987155},{"type":"v1","addr":"172.21.15.143:6835","nonce":3804987155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1848464640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1848464640},{"type":"v1","addr":"172.21.15.119:6837","nonce":1848464640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/3264369281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3264369281},{"type":"v1","addr":"172.21.15.143:6833","nonce":3264369281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6636,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/37559619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":37559619},{"type":"v1","addr":"172.21.15.119:6836","nonce":37559619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-12-19T16:18:51.120 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 28 2023-12-19T16:18:51.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe084065a60 msgr2=0x7fe084067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:51.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe084065a60 0x7fe084067f20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe094000f70 tx=0x7fe094009040 comp rx=0 tx=0).stop 2023-12-19T16:18:51.121 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 msgr2=0x7fe0a4153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 0x7fe0a4153b00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c760 tx=0x7fe09c00cc20 comp rx=0 tx=0).stop 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 shutdown_connections 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:6832/38078,v1:172.21.15.119:6833/38078] conn(0x7fe084065a60 0x7fe084067f20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a415a680 0x7fe0a4153b00 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a40cac10 0x7fe0a4157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 --2- 172.21.15.119:0/3821519830 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a406fdb0 0x7fe0a41529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:51.122 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 >> 172.21.15.119:0/3821519830 conn(0x7fe0a406a3e0 msgr2=0x7fe0a40c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:51.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 shutdown_connections 2023-12-19T16:18:51.123 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-19T16:18:51.114+0000 7fe0a8efc640 1 -- 172.21.15.119:0/3821519830 wait complete. 2023-12-19T16:18:51.140 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T16:18:51.140 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T16:18:51.140 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:18:51.140 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:51.153 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:18:51.153 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:18:51.153 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:51.210 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:18:51.210 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:18:51.210 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:51.225 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:18:51.226 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:18:51.226 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:51.285 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:18:51.286 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T16:18:51.286 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T16:18:51.286 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:53.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-19T16:18:57.388 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T16:18:57.389 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T16:18:57.389 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:57.446 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T16:18:57.447 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T16:18:57.447 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:57.522 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T16:18:57.522 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T16:18:57.522 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:18:59.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-19T16:18:59.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-19T16:19:03.624 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T16:19:03.625 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T16:19:03.625 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:03.718 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T16:19:03.719 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T16:19:03.719 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:05.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-19T16:19:05.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-19T16:19:09.821 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T16:19:09.822 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T16:19:09.822 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:09.878 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T16:19:09.878 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T16:19:09.878 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:09.971 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T16:19:09.972 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T16:19:09.972 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T16:19:09.972 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:10.028 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T16:19:10.029 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T16:19:10.029 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:10.081 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T16:19:10.081 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T16:19:10.082 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T16:19:10.082 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:10.101 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T16:19:10.101 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T16:19:10.101 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:10.122 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T16:19:10.122 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T16:19:10.122 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:10.186 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T16:19:10.186 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T16:19:10.187 DEBUG:teuthology.orchestra.run.smithi119:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T16:19:10.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-19T16:19:10.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-19T16:19:10.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-19T16:19:10.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:19:10.220 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T16:19:10.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:19:10.485 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T16:19:10.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:19:10.717 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T16:19:10.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:19:10.886 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T16:19:11.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:19:11.078 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T16:19:11.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:19:11.268 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T16:19:11.434 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:19:11.435 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T16:19:11.603 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:19:11.604 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T16:19:11.775 INFO:tasks.ceph:Archiving mon data... 2023-12-19T16:19:11.776 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/data/mon.a.tgz 2023-12-19T16:19:11.776 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-12-19T16:19:11.785 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.vKwbIH9LmL 2023-12-19T16:19:11.786 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vKwbIH9LmL 2023-12-19T16:19:11.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.vKwbIH9LmL 2023-12-19T16:19:12.002 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.vKwbIH9LmL is 368KB 2023-12-19T16:19:12.067 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.vKwbIH9LmL 2023-12-19T16:19:12.076 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/data/mon.b.tgz 2023-12-19T16:19:12.076 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-12-19T16:19:12.086 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.FZXTTeMQlI 2023-12-19T16:19:12.086 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FZXTTeMQlI 2023-12-19T16:19:12.248 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.FZXTTeMQlI 2023-12-19T16:19:12.324 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.FZXTTeMQlI is 484KB 2023-12-19T16:19:12.392 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.FZXTTeMQlI 2023-12-19T16:19:12.401 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/data/mon.c.tgz 2023-12-19T16:19:12.401 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-12-19T16:19:12.453 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.XBFpsDMlUs 2023-12-19T16:19:12.454 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XBFpsDMlUs 2023-12-19T16:19:12.617 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.XBFpsDMlUs 2023-12-19T16:19:12.690 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.XBFpsDMlUs is 484KB 2023-12-19T16:19:12.760 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.XBFpsDMlUs 2023-12-19T16:19:12.769 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T16:19:12.773 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T16:19:12.777 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T16:19:12.830 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T16:19:12.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T16:19:12.839 DEBUG:teuthology.orchestra.run.smithi143:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T16:19:12.868 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T16:19:12.903 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T16:19:12.910 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T16:19:12.912 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/remote/smithi119/crash 2023-12-19T16:19:12.913 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T16:19:12.938 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/remote/smithi143/crash 2023-12-19T16:19:12.939 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T16:19:12.972 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T16:19:12.972 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:12.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:13.057 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:13.079 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:13.117 INFO:tasks.ceph:Compressing logs... 2023-12-19T16:19:13.117 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:13.124 DEBUG:teuthology.orchestra.run.smithi143:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:15.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-19T16:19:15.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-19T16:19:17.146 INFO:tasks.ceph:Archiving logs... 2023-12-19T16:19:17.146 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/remote/smithi119/log 2023-12-19T16:19:17.147 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T16:19:17.885 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/remote/smithi143/log 2023-12-19T16:19:17.886 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T16:19:18.293 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T16:19:18.303 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T16:19:18.303 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T16:19:18.307 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T16:19:18.393 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T16:19:18.404 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T16:19:18.404 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:19:18.408 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:19:18.421 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:19:18.421 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2023-12-19T16:19:18.421 INFO:teuthology.orchestra.run.smithi119.stdout:*hv01.front.sepi 44.4.53.2 2 u 62 64 177 0.090 -1.068 0.679 2023-12-19T16:19:18.421 INFO:teuthology.orchestra.run.smithi119.stdout:+hv02.front.sepi 63.231.80.2 3 u 64 64 177 0.081 -0.826 0.787 2023-12-19T16:19:18.421 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 62 64 177 0.120 -1.562 0.857 2023-12-19T16:19:18.422 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:19:18.424 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:19:18.425 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2023-12-19T16:19:18.425 INFO:teuthology.orchestra.run.smithi143.stdout:*hv01.front.sepi 44.4.53.2 2 u 59 64 177 0.152 -1.253 1.083 2023-12-19T16:19:18.425 INFO:teuthology.orchestra.run.smithi143.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 177 0.119 -0.990 1.090 2023-12-19T16:19:18.425 INFO:teuthology.orchestra.run.smithi143.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.100 -1.683 1.103 2023-12-19T16:19:18.425 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:19:18.426 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T16:19:18.527 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T16:19:18.527 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T16:19:18.559 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T16:19:18.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T16:19:18.583 INFO:teuthology.task.internal:Duration was 993.767571 seconds 2023-12-19T16:19:18.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T16:19:18.594 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T16:19:18.595 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T16:19:18.599 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T16:19:18.696 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T16:19:18.697 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-12-19T16:19:18.697 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T16:19:18.719 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2023-12-19T16:19:18.720 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T16:19:18.743 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T16:19:18.744 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:18.764 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:18.825 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T16:19:18.825 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T16:19:18.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T16:19:18.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T16:19:18.948 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T16:19:18.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T16:19:18.968 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T16:19:18.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T16:19:19.001 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:19.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:19.030 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-12-19T16:19:19.052 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2023-12-19T16:19:19.071 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:19.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:19:19.104 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:19.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:19:19.121 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T16:19:19.132 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T16:19:19.133 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/remote/smithi119 2023-12-19T16:19:19.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T16:19:19.172 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087/remote/smithi143 2023-12-19T16:19:19.173 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T16:19:19.201 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T16:19:19.202 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T16:19:19.212 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T16:19:19.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T16:19:19.263 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T16:19:19.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T16:19:19.275 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T16:19:19.275 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T16:19:19.279 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T16:19:19.284 INFO:teuthology.orchestra.run.smithi119.stdout: 655427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 16:19 /home/ubuntu/cephtest 2023-12-19T16:19:19.307 INFO:teuthology.orchestra.run.smithi143.stdout: 658054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 16:19 /home/ubuntu/cephtest 2023-12-19T16:19:19.308 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T16:19:19.320 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T16:19:19.350 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T16:19:19.375 DEBUG:teuthology.nuke:shortname: smithi119 2023-12-19T16:19:19.376 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T16:19:19.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:52:19.970286', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7ubHdMglsVfADcIX6+TdDQP7AHO9OIje4N+g6wC7pIhNSkUzrRjeTf9EbRvWOJHucTfdljWCbDgOYMGe3c7n4='} 2023-12-19T16:19:19.404 DEBUG:teuthology.nuke:shortname: smithi143 2023-12-19T16:19:19.404 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T16:19:19.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:52:19.972092', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4JsTmELUGAxtWiLy97OLPdKNJuCwF4+uobIfinfHx9ozX0ZziFF0TJYfE2SG8DTLC9C9KAPUJCdxK/nFn0eW8='} 2023-12-19T16:19:19.461 INFO:teuthology.orchestra.console.smithi119:Power off 2023-12-19T16:19:19.461 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:19:19.486 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-12-19T16:19:19.487 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:19.503 INFO:teuthology.orchestra.console.smithi143:Power off 2023-12-19T16:19:19.503 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:19:19.513 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-19T16:19:19.524 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-12-19T16:19:19.525 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:19.549 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-19T16:19:23.514 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:23.550 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:23.626 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-19T16:19:23.662 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-19T16:19:27.627 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:27.663 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:27.738 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-19T16:19:27.772 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-19T16:19:27.873 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-12-19T16:19:31.741 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:31.852 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-19T16:19:31.953 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-12-19T16:19:32.060 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 993.767570734024 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=460e5fa0834c4f26b457d58e2af65d0e status: fail success: false 2023-12-19T16:19:32.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:19:32.148 INFO:teuthology.run:FAIL